Data Engineer

Data Engineer Remote Required Skills & Experience 4+ years of professional experience with data engineering, developing data pipelines using dataflow and integrating with scheduler components Experience developing and debugging in Java Experience building and deploying services using Gradle, Maven, Jenkins, GitHubActions etc. as part of CI/CD process Knowledge of ETL products and working on Structured and Unstructured data Experience in Bulk Loads and any Streaming load integration ( Data Integration) Experience on Any Replication Technologies ( Ex- Goldengate, Shareplex, Streamsets, Striim, etc) Nice to Have Skills & Experience Cloud experience, GCP preferred Experience with any Relational Database (Spanner, Oracle, PostgreSQL etc.) Experience with Datawarehouse Databases - BigQuery Job Description An employer is seeking a Data Engineer to join a large healthcare company. Responsibilities include: Design and implement large-scale data integration workflows, including bulk data loads and real-time streaming pipelines for healthcare systems. Develop and maintain ETL processes to migrate data across diverse platforms, ensuring accuracy, consistency, and compliance with healthcare standards. Work with technologies such as Java, Python, and SQL to build and optimize data ingestion and transformation logic. Validate and reconcile data during migration, performing quality checks and troubleshooting discrepancies. Optimize data pipelines for performance and scalability, meeting non-functional requirements like reliability and throughput. Automate deployment of data integration components using CI/CD practices for seamless production rollouts. Monitor data flows and system KPIs, proactively identifying and resolving issues in production environments. Collaborate with cross-functional teams to troubleshoot complex data integration challenges and perform root cause analysis.

Ensure adherence to security and compliance standards, safeguarding sensitive healthcare data throughout integration processes.