Data Engineer
United Software Group Inc
Job Description
Job Title: Data Engineer Location : Halifax, Nova Scotia, Canada (Hybrid Onsite Role-3 days in NTT DATA office per week) Duration : 6-9+ Months Contract Teams Meeting Interview Job Description: Day to Day job Duties: (what this person will do on a daily/weekly basis ) Cloud Data Warehousing & Engineeri ng Design, develop, and maintain enterprise cloud data warehouse solutions supporting business, risk, finance, and regulatory reporting nee ds.Build scalable and resilient data ingestion, transformation, and orchestration pipelines using cloud-native technologi es.Develop and optimize ETL/ELT frameworks for structured, semi-structured, and streaming datase ts.Enable enterprise reporting and analytics by delivering curated, governed, and trusted datase ts. Data Pipeline Develop ment Design and implement batch and near real-time data pipel ines.Build reusable ingestion frameworks for multiple source systems inclu ding:Trading plat formsRisk sy stemsTreasury and finance applica tionsCore banking sy stemsMarket and reference data plat forms Implement metadata-driven and configurable pipeline architec tures. Data Modeling & Ware housing Design and implement dimensional models, star schemas, snowflake schemas, and curated dat a marts.Support enterprise data warehouse optimization, partitioning, clustering, and performance tuning.Build semantic and consumption-ready datasets for downstream analytics and re porting. Cloud Platform En gineering Develop solutions leveraging cloud-native platform s such as: AWS / Azure / GCPSnowflake / DatabricksCloud storage and compu te services Implement scalable processing frameworks and distributed compu te patterns. Data Quality, Governance & amp; Security Implement data quality checks, reconciliation controls, lineage, and observabili ty frameworks.Ensure compliance with banking regulatory, security, and governance requirements.Support enterprise metadata management and lin eage tracking.Apply secure access models and data masking standards for sensitive f inancial data. Performan ce Optimization Optimize warehouse performance, compute utilization, an d storage costs.Improve query performance, data refresh SLAs, and pipel ine reliability.Implement partitioning, indexing, clustering, and workload optimiza tion techniques. DevOps & Automation Build CI/CD pipelines for data engine ering deployments.Automate testing, deployment, monitoring, and operational support processes. Basic Qualifications: (what are the skills required to this job with minimum years of experience on each) · Seeking a Data Engineer to join the Cloud Data Warehousing team responsible for building scalable, secure, and high-performance enterprise data platforms in the cloud. This role will focus on designing and implementing modern cloud-native data pipelines, data warehousing solutions, and ingestion frameworks that enable analytics, regulatory reporting, risk management, finance, and business intelligence capabilities ac ross the enterprise. · 6–10+ years of overall experience in data engineering, data warehousing, or cloud data platform development. · 6+ Years of Strong h ands-on experi ence in: SQL (advanced )Python / Spark / ScalaETL/ELT frameworksData modeling a nd warehousing concepts · 6+ Years of Experience with at least one ma jor cloud data plat form: SnowflakeDatabricks · 6+ Years of Experience building enterprise-scale data pipelines and ingestion frameworks. · Strong understanding of data wareh ouse architecture patterns. · 6+ Years of Languages & Processing: SQL, Python, PySpark, Scala · 6+ Years of Cloud & Warehousing: AWS, Azure, Snowflake, Databricks, Redshift, Synapse · 6+ Years of Data Engineering Tools: Airflow, d bt, Kafka, Informatica, Talend · 6+ Years of DevOps & Automation: Git, CI/CD , Terraform, Docker, Kubernetes · 6+ Years of Data Governance: Lineage, Metadata, D ata Quality, Data Reconciliati on Nice to Have; (But not a must) · The ideal candidate will have strong expertise in cloud data platforms, ETL/ELT engineering, data modeling, and enterprise data integration, with experience working in regulated financial services environments.
The role requires close collaboration with architecture, analytics, risk, finance, operations, and application teams to modernize enterprise data ecosystem Experience in Banking / F inancial Service s / Capital Markets.Experience with:Airfl ow / Control-M / cloud orche strationKafka or streaming platformsTerraform / CloudFormationGi tHub Actions / Jenkins / CI-CD toolsExposure to lakehouse and modern data mesh architectures.