Gen AI Architect Azure
Confidential
Job Description
Job Title: GENAI-Agentic AI Architect (Azure) Experience: 18+ years Location: Pune, Hyderabad We are looking for a highly skilled GenAI and Agentic AI Architect with deep hands-on expertise across Microsoft Azure’s AI/ML ecosystem, multi-agent frameworks, LLM orchestration, and cloud-native engineering. This role focuses on architecting and delivering scalable, secure, production-grade GenAI systems leveraging Azure AI Foundry, Azure OpenAI, Azure Agents, Microsoft Agent Framework, Langgraph/CrewAI, vector databases, and Python-based agentic AI solutions. You will define reference architectures, build end-to-end solutions, lead complex implementations, and drive enterprise adoption of advanced GenAI and multi-agent patterns.
Key Responsibilities: GenAI & Agentic AI Architecture • Architect end-to-end GenAI-first and Agentic AI solutions on Azure using: Azure OpenAI Service Azure AI Foundry Azure Agents (Agent Service + Agent Runtime) Microsoft Agent Framework SDK o Azure Machine Learning (Azure ML) for model lifecycle, fine-tuning & evaluation • Design multi-agent systems capable of planning, reasoning, memory management, tool invocation, and complex workflow execution. • Architect enterprise-grade RAG systems using: Azure Cognitive Search o Azure AI Search Vector Stores Cosmos DB + pgvector Redis Enterprise on Azure • Build secure prompt pipelines, embeddings workflows, tool integration layers, and model evaluation frameworks optimized for Azure’s GenAI stack. Application & Platform Engineering • Build Python-based microservices (FastAPI/Django) tightly integrated with Azure AI and cloud-native components. • Implement enterprise-grade LLMOps using: Azure ML Pipelines Azure DevOps (ADO) GitHub Actions for MLOps/LLMOps o Azure Monitor, App Insights, Log Analytics for observability • Establish engineering standards for: Agent governance & safety Content filters & guardrails (Azure OpenAI Safety Systems) Secure model invocation via private endpoints Latency reduction, performance tuning & cost governance Security, Reliability & Optimization • Optimize AI workloads using model caching, selective batching, adaptive routing, vector index optimization, and autoscaling strategies on AKS/Functions. • Lead architecture reviews, threat modeling, cost modeling, and performance benchmarking for large-scale GenAI workloads. Innovation & Framework Evangelism • Evaluate new Azure GenAI capabilities, FMs, agent frameworks, vector databases, and orchestration tools. • Build internal accelerators and reusable reference architectures for: Multi-agent orchestration with Azure Agents Framework, Langgraph, CrewAI RAG 2.0 and context enrichment pipelines Federated & hybrid retrieval patterns Enterprise system/tool integration • Drive PoCs, prototypes, and tech spikes to validate emerging Azure GenAI capabilities and accelerate enterprise adoption.
Technical Mentorship & Enablement • Mentor engineering teams on Azure GenAI engineering, LLMOps, cloud-native patterns, and distributed AI architectures. • Provide deep technical guidance, best practices, and architectural oversight across delivery projects. • Develop internal documentation, architecture blueprints, engineering guides, and reusable templates. Required Skills & Qualifications • Microsoft Certified Azure Solutions Architect Expert or equivalent Azure Architect certification. • Strong hands-on experience designing AI/ML or GenAI systems on Azure. Preferred Qualifications • Expert-level experience with: Azure OpenAI, Azure AI Foundry, Azure Agents Framework, Langgraph, CrewAI, Azure ML Cognitive Search, Cosmos DB, AKS, Functions, APIM, Event Grid, Service Bus • Strong Python development background (FastAPI, Django). • Hands-on coding experience in: RAG systems Agent orchestration frameworks (Azure Agents, LangGraph, CrewAI, etc.) Embedding models, vector indexing & vector DB architecture • Exposure to data engineering, analytics, and cloud-scale distributed systems. • Experience supporting pre-sales, architecture assessments, and solutioning for GenAI transformation programs.