Senior Data Engineer - Contract/ Immediate Joiners Only
Epitria Consulting
Job Description
We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have strong expertise in Databricks, Delta Lake, and advanced Python programming. Experience with Apache Airflow, AWS S3, AWS DMS, PostgreSQL, advanced SQL.
Job Details: Duration: 6 Months Location: Remote Shift: 1:00 PM - 10:00 PM IST Immediate Joiners Only Good to Have: PowerBI Reporting Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks and Delta Lake. Manage and govern data assets using Databricks Unity Catalog. Develop and optimize ETL workflows using Apache Airflow.
Work with AWS services including S3 buckets and Database Migration Service (DMS) for data storage and migration. Write complex SQL queries and optimize database performance in PostgreSQL. Create insightful reports and dashboards using PowerBI.
Collaborate with data analysts, and other stakeholders to meet data requirements. Ensure data quality, security, and compliance throughout the data lifecycle. Required Skills Strong experience with Databricks Unity Catalog and Delta Lake.
High proficiency in Python programming. Hands-on experience with Apache Airflow for workflow orchestration. Familiarity with AWS S3 buckets and AWS DMS.
Expertise in PostgreSQL and advanced SQL querying. Experience in PowerBI reporting and dashboard creation. Strong problem-solving skills and attention to detail.
Preferred Qualifications Bachelorโs degree in Computer Science, Engineering, or related field. Experience with cloud data platforms and big data technologies. Knowledge of data governance and security best practices.