Data Engineer (Databricks)

Qualifications Bachelor’s degree or M.S. in Computer Science, Computer Engineering. 5-10 years of experience working in data engineering. Proven ability to architect and implement complex, scalable PySpark pipelines on Databricks. Conceptual knowledge of data and analytics, such as dimensional modeling, ELT, reporting tools, data governance, data warehousing, structured and unstructured data.

Strong understanding of Agile methodologies. Job Summary Insight Global is seeking a Data Engineer to join a top aerospace company in Longueuil, QC. This role is hybrid - 3-5x week onsite.

His role involves contributing across the full software development lifecycle (SDLC), from early-stage planning and architecture through development, deployment, and ongoing optimization. This individual will be deployed across multiple projects, working closely with data scientists, BI teams, and other stakeholders to deliver high-impact data solutions, including exploratory analytics and emerging AI-driven initiatives. Key Responsibilities Design, build, and deploy high-volume data pipelines to ingest, transform, and store data.

Own the end-to-end lifecycle of data solutions (design, development, testing, deployment, and maintenance). Collaborate with stakeholders to translate business and analytics requirements into technical solutions. Architect and implement ETL/ELT pipelines across diverse data sources and cloud environments.

Develop pipeline components using PySpark, Python, and SQL within Databricks. Participate in early-stage activities including planning, documentation, data flow design, and validation. Deliver data products that support BI, analytics, and AI use cases (including agentic solutions).

Ensure best practices in software engineering (CI/CD, code reviews, automated testing). Contribute to data governance, architecture decisions, and team standards. #J-18808-Ljbffr