Azure Data Engineer

🚀 Hiring: Azure Data Engineer

We are looking for an experienced Azure Data Engineer to join our team and work on large-scale data engineering, cloud data platforms, data warehousing, analytics, and big-data initiatives.

The ideal candidate will have strong hands-on experience with the Microsoft Azure Data Engineering ecosystem, including Azure Data Factory, Azure Databricks, Azure Blob Storage, Apache Spark, SQL, Snowflake, ETL/ELT, Data Warehousing, DataOps, and CI/CD.

Key Responsibilities

• Develop prototypes, proof-of-concepts, and technical solutions using multiple data sources, AI/ML methods, and big-data technologies.
• Design, develop, implement, and deploy scalable data platforms and databases across cloud infrastructures.
• Build and optimize data pipelines for structured and unstructured data.
• Port and migrate data across different data sources, databases, and platforms to improve performance, scalability, accessibility, and analytics capabilities.
• Develop technical solutions that combine disparate data sources to generate meaningful business insights.
• Work closely with Data Architects, Data Scientists, BI teams, and business stakeholders to deliver enterprise data solutions.
• Design and implement robust ETL/ELT pipelines and data processing workflows.
• Process and manage large-scale datasets, including multi-terabyte data environments.
• Develop data processing solutions using Azure Databricks and Apache Spark.
• Implement data warehousing solutions using Snowflake and apply appropriate data modelling techniques.
• Implement and maintain data quality, data governance, and data transformation processes.
• Monitor data pipelines, identify bottlenecks, troubleshoot failures, and continuously improve pipeline performance.
• Contribute to DataOps, workflow orchestration, monitoring, automation, and CI/CD initiatives.
• Support analytics and machine-learning applications by developing reliable and scalable data processing workflows.
• Collaborate with globally distributed teams and stakeholders to understand requirements and deliver technical solutions.
• Stay current with emerging cloud, big-data, analytics, and data engineering technologies and identify opportunities for innovation.

Required Technical Skills & Experience

Azure Data Engineering

• 4+ years of professional experience in Data Engineering / Data Platform development.
• Strong hands-on experience with the Azure Data Engineering ecosystem.
• Excellent knowledge of:
• Azure Data Factory (ADF)
• Azure Databricks
• Azure Blob Storage
• Apache Spark
• Azure-based data storage and processing services
• Experience designing and implementing scalable cloud-based data architectures.

SQL & Databases

• Strong expertise in SQL and relational database technologies.
• Experience with T-SQL, Microsoft SQL Server, Oracle, or equivalent technologies.
• Strong understanding of relational database design.
• Experience processing and managing large-scale datasets, including multi-TB environments.
• Experience with database migration, optimization, performance tuning, and data integration.

Data Warehousing

• Strong experience with Snowflake.
• Excellent understanding of:
• Data Warehousing
• Data Modelling
• Star Schema
• Snowflake Schema
• Fact and Dimension Tables
• ETL/ELT Architecture
• Slowly Changing Dimensions
• Data Warehouse Design Principles

ETL / Data Transformation

• Strong understanding of Extract, Transform & Load (ETL/ELT) concepts.
• Hands-on experience developing complex data transformation pipelines.
• Experience integrating data from multiple heterogeneous sources.
• Ability to optimize data pipelines for performance, reliability, and scalability.

Big Data & Distributed Processing

• Strong interest and hands-on experience in Big Data technologies.
• Experience with Apache Spark and Azure Databricks.
• Ability to design and implement distributed data processing workflows.
• Experience working with large volumes of structured and unstructured data.

DataOps / DevOps

• Good understanding of DataOps and data orchestration.
• Experience with workflow management, pipeline monitoring, logging, and alerting.
• Understanding of CI/CD practices for data engineering solutions.
• Ability to identify opportunities for automation and process improvements.

BI / Analytics

Experience with at least one BI or reporting platform such as:

• Power BI
• Tableau
• Qlik
• SAS Visual Analytics
• Other enterprise BI/reporting platforms

Education

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Information Technology, Data Engineering, or an equivalent discipline.
• Professional certification/degree in Data Science, Data Engineering, Cloud Computing, or related fields will be an advantage.

Required Soft Skills

• Strong analytical and problem-solving abilities.
• Excellent attention to detail and commitment to data quality.
• Strong planning and organizational skills.
• Excellent written and verbal communication skills.
• Ability to collaborate effectively with global teams and stakeholders.
• Comfortable working independently as well as in a team environment.
• Strong ownership and accountability.
• Curious mindset with an interest in learning and adopting emerging technologies.
• Ability to translate complex technical requirements into practical data engineering solutions.

#Hiring #JobOpening #CareerOpportunity #AzureDataEngineer #DataEngineer #DataEngineering #Azure #MicrosoftAzure #AzureDataFactory #ADF #AzureDatabricks #Databricks #ApacheSpark #Spark #Snowflake #SnowflakeDeveloper #SQL #TSQL #SQLServer #Oracle #ETL #ELT #DataPipelines #DataIntegration #DataMigration #DataTransformation #DataWarehouse #DataWarehousing #DataModeling #DataModelling #StarSchema #SnowflakeSchema #BigData #BigDataEngineering #BigDataAnalytics #CloudData #CloudDataEngineering #CloudComputing #CloudEngineering #DataArchitecture #DataArchitect #DataPlatform #DataPlatforms #DataOps #DataOpsEngineering #DevOps #CICD #DataGovernance #DataQuality #DataAnalytics #Analytics #BusinessIntelligence #BI #PowerBI #Tableau #Qlik #SAS #MachineLearning #ML #AIML #DataScience #DataScientist #DataTechnology #ModernDataStack #DataLake #DataLakehouse #Lakehouse #AzureCloud #AzureJobs #AzureCareers #DatabricksJobs #SnowflakeJobs #DataEngineeringJobs #DataJobs #TechJobs #ITJobs #CloudJobs #EngineeringJobs #TechnologyJobs #SoftwareJobs #HiringNow #NowHiring #OpenToWork #TechHiring #ITHiring #Recruitment #TechRecruitment #DataTalent #DataProfessionals #DataCareer #TechCareers #CareerInTech #CloudCareers #DataDriven #EnterpriseData #EnterpriseTechnology #DigitalTransformation #Technology #InformationTechnology #ITCareers #GlobalHiring #GlobalJobs