Data Engineer

Exp: 5+yrs Location: India Key Responsibilities Design and implement data pipelines using S3 Medallion Architecture (Bronze, Silver, Gold layers) Build and maintain scalable ETL/ELT workflows using AWS Lambda and Step Functions Develop data ingestion frameworks to pull data from external APIs Transform and load data into Amazon Redshift for analytics and reporting Write efficient, reusable, and scalable code in Python Ensure data quality, validation, and monitoring across pipelines Optimize data storage and query performance in S3 and Redshift Collaborate with data analysts, data scientists, and business stakeholders Implement logging, alerting, and error-handling mechanisms Maintain documentation for pipelines, data models, and workflows Required Skills & Qualifications Strong hands-on experience with AWS services: S3 (data lake design) Redshift Lambda Step Functions Solid understanding of Medallion Architecture (Bronze/Silver/Gold layers) Proficiency in Python for data engineering tasks Experience with API integrations (REST/JSON, authentication, pagination handling) Strong SQL skills and experience with data warehousing concepts Familiarity with workflow orchestration and event-driven architectures Understanding of data modeling and schema design Preferred Qualifications Experience with Glue / Athena / EMR (nice to have) Knowledge of CI/CD pipelines for data workflows Experience with data quality frameworks and monitoring tools Exposure to streaming pipelines (Kafka/Kinesis) is a plus Familiarity with infrastructure as code (Terraform/CloudFormation)