Lead Data Engineer
Experion Technologies
Job Description
Job Purpose We are looking for an experienced Lead Data Engineer with strong expertise in SQL, Python to support Data engagements. Duties and Responsibilities 1. Designs, develops and delivers solutions that meet business line and enterprise requirements. 2.
Participates in rapid prototyping and POC development efforts. 3. Advances overall enterprise technical architecture and implementation best practices. 4. Assists in efforts to develop and refine functional and non-functional requirements. 5.
Participates in iteration and release planning. 6. Informs efforts to develop and refine functional and non-functional requirements. 7. Demonstrates knowledge of, adherence to, monitoring and responsibility for compliance with state and federal regulations and laws as they pertain to this position. 8.
Strong ability to produce high-quality, properly functioning deliverables the first time. 9. Delivers work product according to established deadlines. 10. Estimates tasks with a level of granularity and accuracy commensurate with the information provided. 11.
Works collaboratively in a small team. Excels in a rapid iteration environment with short turnaround times. 12. Deals positively with high levels of uncertainty, ambiguity, and shifting priorities. 13.
Accepts a wide variety of tasks and pitches in wherever needed. 14. Constructively presents, discusses and debates alternatives. 15. Takes shared ownership of the product. 16.
Communicates effectively both verbally and in writing. 17. Takes direction from Architect and upper management. 18. Ability to work with little to no supervision while performing duties. 19.
Proficient in SQL & Python 20. Strong in ADF 21. Hands on experience in Data Lake 22.
Hands-on experience in data mart and data warehousing including variant schemas (Star, Snowflake). 23. 6+ years of experience with advanced queries, stored procedures, views, triggers, etc. 24. 6+ years of experience of performance tuning queries. 25. 6+ years of experience of both DDL and DML. 26. 6+ years of experience designing enterprise database systems using Microsoft SQL Server/Azure SQL preferred. 27. Experience in Lakehouse architecture preferred. 28. Experience with Cloud technologies – Azure & AWS WBR is preferred. 29.
Deep understanding of one or more source/version control systems. Develops branching and merging strategies. 30. Working understanding of Web API, REST, JSON. 31.
Working understanding of unit testing creation. 32. Bachelor’s Degree is required, and/or a minimum of four (4) + related work experience. Must-Have Skills: • Strong experience with data modeling, query optimization, performance tuning. • Proficient in building and managing data pipelines and ETL/ELT workflows. • Proficient in Python • Solid SQL skills and experience working with large datasets. • Experience with version control (e.g., Git) and CI/CD for data solutions. • Ability to work in Agile environments and with remote teams., • Proficient in client engagement and proactive communication with client/team.
Good-to-Have Skills: • Exposure to Azure services beyond ADF. Soft Skills: • Excellent communication and interpersonal skills. • Proven ability to work independently in a client-facing role. • Experience in mentoring or coaching team members is a plus. To adhere to the Information Security Management policies and procedures.