Data Engineer

Data Engineer/Developer Responsibilities: · Build and maintain scalable data pipelines on Databricks and Azure. · Develop data ingestion, transformation, and serving solutions adhering to coding standards. · Implement structured logging and metadata augmentation. · Collaborate with Data Architects to follow data processing patterns and reuse components. Skills and Experience: · Strong experience with Azure Databricks and Apache PySpark. · Familiarity with Unity Catalog and data governance principles. · Proficient in SQL and Python programming and advanced software development and DevOps concepts. · Knowledge of data pipeline orchestration tools (e.g., Azure Data Factory). · Unit testing and DevOps practices for data workloads. · Certified Databricks Data Engineer with >3 years of experience working with Databricks, IaC-based data platforms, PowerBI integrations.