Databricks Engineer (Immediate Joiners Only- 3 to 15 Years)

Databricks Engineer / Consultant

About GyanSys

GyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver innovative, scalable, and business-driven solutions across diverse industries worldwide.

Databricks Engineer / Consultant

Location: Bengaluru Pune Hyderabad

Employment Type: Full-Time

Job Summary

GyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
• Build and optimize data pipelines for structured, semi-structured, and unstructured data.
• Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.
• Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
• Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.
• Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.
• Ensure data quality, governance, security, and compliance across data platforms.
• Implement CI/CD best practices and support deployment of Databricks solutions.
• Troubleshoot production issues and continuously improve platform performance.
• Create technical documentation and support knowledge-sharing initiatives.

Required Technical Skills

• Hands-on experience with Databricks Lakehouse Platform
• Strong expertise in PySpark, Apache Spark, Spark SQL, and Python
• Experience with Delta Lake, Databricks Workflows, and Unity Catalog
• Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling
• Experience with Azure, AWS, or GCP cloud platforms
• Knowledge of Git, Azure DevOps/GitHub, and CI/CD practices
• Experience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases

Preferred Skills

• Experience with Medallion Architecture and Lakehouse concepts
• Exposure to Kafka, Event Hubs, or other streaming technologies
• Knowledge of Power BI or Tableau
• Understanding of Agile/Scrum methodologies
• Exposure to Microsoft Fabric is an added advantage

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

Experience

• Domain Experience: 3-5 Years
• Relevant Experience: 0-8+ Years

Preferred Certifications

• Databricks Certified Data Engineer (Associate/Professional)
• Microsoft Azure Data Engineer Associate
• AWS Certified Data Analytics - Specialty
• Google Professional Data Engineer

Why Join GyanSys?

At GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your professional growth.