Data Engineer
Compunnel, Inc.
Job Description
We are seeking a skilled and innovative Data Engineer to join our fast-paced, agile development teams. In this role, you will collaborate with cross-functional squads to design, build, and maintain scalable data pipelines and solutions using modern cloud technologies such as Databricks and Snowflake. You’ll work closely with developers, product experts, and site reliability engineers in a highly collaborative, international environment.
Key Responsibilities Design, develop, and deploy scalable ETL pipelines using Python and Databricks Extract, transform, and load data from a variety of sources to meet analytical and operational needs Build reliable, performant, and monitored data pipelines with error handling and recovery strategies Collaborate with stakeholders to understand data requirements and translate them into technical solutions Write clean, testable, and well-documented code Conduct code reviews and maintain high-quality standards across all development efforts Utilize REST APIs to integrate data sources and services Maintain up-to-date documentation for data flows, processes, and systems Optimize and automate recurring data engineering tasks Required Qualifications Proficiency in Python for data engineering, including writing efficient, maintainable code Experience with Databricks and building data pipelines in a cloud environment Hands-on experience with Snowflake or other modern data warehouse technologies Strong understanding of ETL concepts, data modeling, and data warehousing best practices Familiarity with REST APIs and data integration techniques Experience working with Git or similar version control systems Solid understanding of Linux/Unix environments Proven ability to work in an Agile environment and contribute to cross-functional teams Excellent problem-solving skills and attention to detail Preferred Qualifications (Nice to Have) Experience with data orchestration tools such as Apache Airflow Familiarity with Power BI or other data visualization platforms Exposure to big data technologies (e.g., Hadoop, Spark) Background in database performance tuning or administration Certifications (if any) certifications if required or preferred – e.g., Azure Data Engineer Associate, Databricks certification Email ID * This field is required Please enter valid emailId. Cell phone * This field is required Please enter valid cell phone. First Name * This field is required Please enter valid first name.
Last Name * This field is required Please enter valid last name. #J-18808-Ljbffr