data engineer

Lead Data Engineer Lead Data Engineer at Two Circles – a sports & entertainment marketing business growing audiences and revenues by leveraging fan data. Key responsibility is to design, build, and scale data integration capabilities using Scala, Spark, and AWS technologies for Helix data platform. Responsibilities Own end-to-end delivery of Helix data engineering and integration projects from design through to deployment, monitoring, and production support.

Build and operate scalable data ingestion and processing pipelines using AWS services (S3, EMR/Spark, ECS, Lambda). Develop and maintain data workflows that support customer identity resolution, fan segmentation, and golden record creation. Work with data storage and warehouse technologies such as PostgreSQL, Redshift, and S3-based data lakes.

Design, implement, and optimize ETL/ELT pipelines for large-scale structured and semi-structured data. Define and enforce engineering best practices across code quality, testing, CI/CD, and deployment processes. Troubleshoot complex data and system issues, ensuring high reliability, performance, and scalability.

Collaborate closely with Product, Engineering, and Data teams to deliver high-impact data solutions aligned to business needs. Mentor and guide engineers through code reviews, pairing, and technical leadership, supporting their growth and delivery capability. Continuously improve the Helix platform with a focus on reusability, observability, scalability, and maintainability.

Requirements Strong experience in data engineering with focus on data ingestion, integration systems, and large‑scale data processing. Experience working with distributed data processing frameworks such as Spark. Job Details Location : Vancouver, BC (On site) Salary : $140,000 to $155,000 per year Employment type : Full time Start date : Starts as soon as possible Advertised until 2026-06-08 #J-18808-Ljbffr