Data Engineer

Location: Hyderabad

Experience: 2–5 years

Notice Period: Immediate to 15 days

We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have strong experience in building data pipelines, working with modern data platforms, and implementing scalable cloud-based solutions. This role requires hands-on expertise in SQL, Python, PySpark, and AWS, along with solid understanding of data modelling and transformation frameworks.

Key Responsibilities

·        Design, develop, and optimize scalable data pipelines and ETL workflows.

·        Build and manage data models using DBT and integrate datasets for analytics and reporting.

·        Work with Snowflake to write efficient SQL queries and manage data warehousing activities.

·        Develop distributed data processing solutions using PySpark on Databricks.

·        Implement data ingestion frameworks using Python, APIs, and AWS services.

·        Collaborate with cross-functional teams to understand data requirements and deliver solutions.

·        Ensure data quality, reliability, and performance across pipelines.

·        Deploy and maintain data workflows using CI/CD and version control best practices.

Mandatory Skills

·        Minimum 2 years of hands-on experience in:

o   SQL (Snowflake)

o   DBT

o   PySpark (Databricks)

o   Python with strong understanding of OOP concepts

o   AWS services: S3, ECS, SQS, Lambda, EMR

·        Experience with file formats: CSV, JSON, Parquet

·        Experience with API integrations using Python

·        Strong communication skills

Secondary / Good-to-Have Skills

·        Experience with Sigma or Tableau for data visualization

·        Linux CLI proficiency

·        Python web scraping experience

·        Exposure to Datadog for monitoring

·        Experience with GitHub for version control and CI/CD

·        Knowledge of Terraform

·        Computer Science degree from a reputed academic institution