Expert Cloud Data Engineer
Hudson Manpower
Job Description
Role Overview:
We are looking for an Expert Cloud Data Engineer with 10โ12 years of experience to architect, build, and maintain scalable, high-performance data platforms. The role focuses on designing robust data pipelines and enabling advanced analytics using modern cloud and data technologies.
Key Responsibilities:
Design, develop, and maintain scalable data pipelines using Databricks
Build and optimize data processing workflows on Azure cloud platform
Implement and manage MLflow for end-to-end machine learning lifecycle
Develop and manage Snowflake-based data warehousing solutions
Ensure high data quality, governance, security, and performance
Optimize data ingestion, transformation, and storage processes
Troubleshoot and resolve data-related issues across systems
Collaborate with data scientists, analysts, and engineering teams
Required Skills:
10โ12 years of experience in data engineering and cloud platforms
Strong expertise in Azure (ADF, ADLS, Synapse, etc.)
Hands-on experience with Databricks (Spark, Delta Lake)
Proficiency in MLflow for experiment tracking and deployment
Strong experience with Snowflake architecture and optimization
Expertise in SQL, Python, and distributed data processing
Experience building scalable, production-grade data pipelines