Technology Lead - Azure and Databricks Admin

Technology Lead - Azure and Databricks Admin

Technology|Analytics - Solutions|SQL Server - Analytics

Domain

Delivery

Interest Group

Company

ITL Canada

Requisition ID

150651BR

Job Summary

Databricks Platform Administrator responsible for managing, securing, optimizing, and supporting enterprise Databricks environments across cloud platforms. The role includes workspace administration, cluster management, security governance, cloud integrations, platform monitoring, automation, and operational support. Requires strong expertise in Azure Databricks (preferred) and exposure to AWS and GCP Databricks.

Required Qualifications

• Persons authorized to work in Canada without employer-based visa sponsorship are welcome to apply. Infosys does not provide immigration sponsorship.
• Candidate must be within commuting distance of Calgary, Alberta or willing to relocate.
• Bachelor’s degree or foreign equivalent from an accredited institution, or three years of progressive experience in lieu of each year of education.
• At least 4 years of Information Technology experience.

Key Responsibilities

• Platform Administration
  • Administer and manage Databricks workspaces across dev, test, prod.
  • Configure and maintain workspaces, metastore, catalogs, clusters, pools, policies.
  • Manage Unity Catalog implementation, governance, and access controls.
  • Perform upgrades, maintenance, health checks.
  • Support multi‑workspace and multi‑region deployments.
• Cluster Management
  • Create, configure, manage all‑purpose and job clusters.
  • Implement cluster policies to control costs and ensure compliance.
  • Optimize cluster sizing and auto‑scaling.
  • Monitor utilization, performance, cost.
  • Troubleshoot cluster issues.
• Security & Governance
  • Implement RBAC and access controls.
  • Integrate with Azure AD, AWS IAM, or GCP Identity services.
  • Manage service principals, managed identities, secret scopes.
  • Implement Unity Catalog governance and data security policies.
  • Support audit logging and compliance reviews.
• Cloud Integration
  • Integrate Databricks with Azure Data Lake Storage, AWS S3, Azure Key Vault, AWS Secrets Manager, SQL Databases, Event Hub, Kafka, Snowflake, Power BI.
• Monitoring & Performance
  • Monitor platform health, resource utilization.
  • Establish alerting and monitoring.
  • Analyze Spark job performance, recommend optimizations.
  • Troubleshoot incidents and bottlenecks.
  • Support SLA‑driven production environments.
• DevOps & Automation
  • Automate administration using Terraform, Azure DevOps, GitHub Actions, Databricks CLI, REST APIs.
  • Manage CI/CD pipelines.
  • Support Infrastructure as Code initiatives.
• Operational Support
  • Participate in incident, problem, and change management.
  • Support patching, upgrades, certificate renewals, maintenance.
  • Create SOPs, runbooks, documentation.
  • Collaborate cross‑functional teams.

Required Skills

• Databricks Workspace Administration
• Unity Catalog
• Cluster Management
• Cluster Policies
• Instance Pools
• Jobs & Workflows
• SQL Warehouses
• Databricks CLI
• REST APIs
• Delta Lake

Cloud Platforms

• Azure Databricks (Preferred)
• AWS Databricks
• GCP Databricks

Preferred Experience

• Enterprise‑scale Azure Databricks environments.
• Understanding of data lake architecture and governance.
• Production environments with strict SLA requirements.
• Infosys‑scale delivery environments advantage.

Soft Skills

• Strong analytical and troubleshooting skills.
• Excellent communication and stakeholder coordination.
• Ability to work in a global delivery model.
• Documentation and knowledge‑sharing mindset.

Experience

• 8‑10 years in IT industry.
• 5+ years Databricks Administration.
• Large enterprise or managed services engagements preferred.

Physical & Travel

• Requires extended computer use; ability to communicate by phone, email, or face‑to‑face.
• Travel may be required.

EEO Infosys provides equal employment opportunities to applicants and employees without regard to race, color, sex, gender identity, sexual orientation, religious practices, national origin, pregnancy, childbirth, or related medical conditions, status as a protected veteran or spouse/family member of a protected veteran, or disability.

#J-18808-Ljbffr