Gen AI Architect Azure
Confidential
Job Description
Job Title: GENAI-Agentic AI Architect (Azure) Experience: 18+ years Location: Pune, Hyderabad We are looking for a highly skilled GenAI and Agentic AI Architect with deep hands-on expertise across Microsoft Azureβs AI/ML ecosystem, multi-agent frameworks, LLM orchestration, and cloud-native engineering. This role focuses on architecting and delivering scalable, secure, production-grade GenAI systems leveraging Azure AI Foundry, Azure OpenAI, Azure Agents, Microsoft Agent Framework, Langgraph/CrewAI, vector databases, and Python-based agentic AI solutions. You will define reference architectures, build end-to-end solutions, lead complex implementations, and drive enterprise adoption of advanced GenAI and multi-agent patterns.
Key Responsibilities: GenAI & Agentic AI Architecture β’ Architect end-to-end GenAI-first and Agentic AI solutions on Azure using: Azure OpenAI Service Azure AI Foundry Azure Agents (Agent Service + Agent Runtime) Microsoft Agent Framework SDK o Azure Machine Learning (Azure ML) for model lifecycle, fine-tuning & evaluation β’ Design multi-agent systems capable of planning, reasoning, memory management, tool invocation, and complex workflow execution. β’ Architect enterprise-grade RAG systems using: Azure Cognitive Search o Azure AI Search Vector Stores Cosmos DB + pgvector Redis Enterprise on Azure β’ Build secure prompt pipelines, embeddings workflows, tool integration layers, and model evaluation frameworks optimized for Azureβs GenAI stack. Application & Platform Engineering β’ Build Python-based microservices (FastAPI/Django) tightly integrated with Azure AI and cloud-native components. β’ Implement enterprise-grade LLMOps using: Azure ML Pipelines Azure DevOps (ADO) GitHub Actions for MLOps/LLMOps o Azure Monitor, App Insights, Log Analytics for observability β’ Establish engineering standards for: Agent governance & safety Content filters & guardrails (Azure OpenAI Safety Systems) Secure model invocation via private endpoints Latency reduction, performance tuning & cost governance Security, Reliability & Optimization β’ Optimize AI workloads using model caching, selective batching, adaptive routing, vector index optimization, and autoscaling strategies on AKS/Functions. β’ Lead architecture reviews, threat modeling, cost modeling, and performance benchmarking for large-scale GenAI workloads. Innovation & Framework Evangelism β’ Evaluate new Azure GenAI capabilities, FMs, agent frameworks, vector databases, and orchestration tools. β’ Build internal accelerators and reusable reference architectures for: Multi-agent orchestration with Azure Agents Framework, Langgraph, CrewAI RAG 2.0 and context enrichment pipelines Federated & hybrid retrieval patterns Enterprise system/tool integration β’ Drive PoCs, prototypes, and tech spikes to validate emerging Azure GenAI capabilities and accelerate enterprise adoption.
Technical Mentorship & Enablement β’ Mentor engineering teams on Azure GenAI engineering, LLMOps, cloud-native patterns, and distributed AI architectures. β’ Provide deep technical guidance, best practices, and architectural oversight across delivery projects. β’ Develop internal documentation, architecture blueprints, engineering guides, and reusable templates. Required Skills & Qualifications β’ Microsoft Certified Azure Solutions Architect Expert or equivalent Azure Architect certification. β’ Strong hands-on experience designing AI/ML or GenAI systems on Azure. Preferred Qualifications β’ Expert-level experience with: Azure OpenAI, Azure AI Foundry, Azure Agents Framework, Langgraph, CrewAI, Azure ML Cognitive Search, Cosmos DB, AKS, Functions, APIM, Event Grid, Service Bus β’ Strong Python development background (FastAPI, Django). β’ Hands-on coding experience in: RAG systems Agent orchestration frameworks (Azure Agents, LangGraph, CrewAI, etc.) Embedding models, vector indexing & vector DB architecture β’ Exposure to data engineering, analytics, and cloud-scale distributed systems. β’ Experience supporting pre-sales, architecture assessments, and solutioning for GenAI transformation programs.