Data Engineer (For a Product Based Company)
Crystal Peak
Job Description
Immediate Joiner Job Title: Data Engineer Location: Noida, Film City Sector 16A Experience: 3.5-7 years Budget: Upto 40LPA Role Overview : We are seeking a highly skilled Data Engineer to build and scale modern data platforms that power underwriting, claims, actuarial, finance, and AI/ML initiatives. You will design robust data pipelines, optimize large-scale data processing frameworks, and enable analytics and AI solutions through high-quality, trusted data asset s.The ideal candidate combines strong engineering fundamentals with expertise in cloud-native data platforms, distributed processing, and data governance. Experience in insurance data domains is highly preferre d. Key Responsibiliti es: Design, develop, and maintain scalable batch and real-time data pipeli nes.Build and optimize ETL/ELT workflows for structured and unstructured datas ets.Develop data models and curated data products for analytics, reporting, and AI use ca ses.Integrate data from policy administration, claims, underwriting, telematics, finance, and external data provid ers.Implement data quality, validation, monitoring, lineage, and governance framewo rks.Optimize performance, reliability, and scalability of enterprise data platfo rms.Collaborate with Data Scientists, AI Engineers, Business Analysts, and Underwriting te ams.Support cloud migration and modernization initiati ves.Build reusable frameworks for ingestion, transformation, orchestration, and observabil ity.Ensure compliance with security, privacy, and regulatory requireme nts. Required Sk ills: Data Engin eeringStrong proficiency in Python an d SQL.Experience building enterprise-grade ETL/ELT pipe lines.Expertise in Apache Spark/Py Spark.Experience with workflow orchestration tools such as Ai rflow.Strong understanding of data modeling and warehousing con cepts. Cloud & B ig DataHands-on experience with AWS, Azure, or GCP.Experience with cloud data platforms s uch as:Sn owflakeDat abricksAzure SynapseR edshiftB igQueryKnowledge of data lake and lakehouse archite ctures. Engineering P racticesCI/CD and DevOps exp erience.Git-based version control.Containerization using Docker.Exposure to Kubernetes is a plus.Strong understanding of performance tuning and optim ization. Preferred Qualif ications:Experience working with Property & Casualty (P&C) insura nce data.Familiarity with underwriting, claims, policy lifecycle, and risk a nalytics.Exposure to ML pipelines and MLOps fr ameworks.Experience with streaming technologies such as Kafka or Ev ent Hubs.Knowledge of data governance, lineage, and metadata manageme nt tools.Understanding of GenAI, vector databases, and RAG architectures i s a plus. Education:Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or rela ted field.
What You will Gain:Opportunity to work on AI-driven transformation initiatives in insurance.Exposure to global underwriting and claims operations.Hands-on experience with cutting-edge cloud and analytics te chnologies.Career growth across Data Engineering, Data Architecture, AI Engineering, and Platform E ngineering.Collaborative environment focused on innovation and measurable busi ness impact