Prompt Engineer (Generative AI / LLMs)
The Glove
Job Description
Prompt Engineer (Generative AI / LLMs) Location: Hyderabad (Hybrid) Experience: 2+ Years Employment Type: Full-time About the Role We are looking for a talented and detail-oriented Prompt Engineer to join our growing AI team. In this role, you will be responsible for designing, evaluating, and optimizing prompts that power LLM-based applications, AI copilots, and intelligent agent systems . You will play a critical role in translating business requirements into effective AI-driven outcomes, ensuring our systems deliver accurate, reliable, safe, and production-grade performance .
This role requires a strong understanding of prompt engineering, agentic AI systems, evaluation frameworks, and Generative AI application design . Key Responsibilities Design, test, and optimize prompts for LLM-powered applications, AI assistants, and agentic workflows . Build and refine system prompts, instruction sets, guardrails, evaluation prompts, and multi-agent interaction frameworks .
Collaborate with AI/ML engineers to integrate prompts into production APIs, AI pipelines, and agent workflows . Develop and maintain prompt evaluation datasets, scoring frameworks, and automated testing pipelines to measure quality and consistency. Experiment with and improve Retrieval-Augmented Generation (RAG), memory systems, tool-calling, model routing, and agent orchestration strategies .
Analyze LLM/agent failures, hallucinations, and performance issues, and iteratively improve prompts using structured evaluation methods. Partner with product, business, and engineering stakeholders to convert functional requirements into well-defined AI behaviors and workflows . Design reusable prompt templates, prompting playbooks, and best-practice documentation for organizational adoption.
Define and implement evaluation pipelines to assess accuracy, latency, safety, robustness, and overall model quality . Contribute to AI safety, prompt security, and hallucination mitigation strategies in production systems. Required Qualifications 2+ years of hands-on experience working with Large Language Models (LLMs) / Generative AI applications in production environments.
Strong expertise in prompt engineering techniques including reasoning, summarization, information extraction, structured generation, and agentic workflow design. Proven experience in synthetic dataset generation, evaluation frameworks, and prompt testing methodologies . Experience working with RAG pipelines, memory systems, tool-calling frameworks, and AI agents .
Strong understanding of hallucination mitigation strategies and practical implementation in production AI systems. Familiarity with Model Context Protocol (MCP), AI gateways, model routing, and orchestration strategies . Solid understanding of AI safety, prompt injection risks, jailbreak prevention, and secure agent design .
Experience with AI frameworks such as LangChain, LangGraph, LlamaIndex , or equivalent. Strong experience with structured output generation and JSON schema design for LLM responses. Ability to design and implement LLM evaluation pipelines measuring quality, safety, latency, and reliability.
Hands-on experience with AI monitoring and evaluation tools such as LangSmith, DeepEval, Ragas , or similar. Comfortable working with Python and collaborating closely with AI/ML engineers on implementation and deployment. Good understanding of local vs cloud-based LLM inferencing and production trade-offs.
Preferred Qualifications (Good to Have) Experience with OpenAI, Anthropic, Gemini, Llama, or other commercial/open-source LLM ecosystems . Exposure to vector databases such as Pinecone, Weaviate, Chroma, FAISS, or Milvus. Familiarity with evaluation benchmarks, reinforcement learning concepts, and human feedback loops .
Experience in building enterprise AI copilots, conversational AI, or autonomous agent systems . Knowledge of API integrations, microservices, and production deployment practices for AI applications. What Weβre Looking For Strong analytical and problem-solving mindset Ability to experiment, iterate, and optimize AI behavior systematically Attention to detail and focus on quality and reliability Strong communication and collaboration skills Passion for Generative AI, AI agents, and emerging LLM technologies Why Join Us?
Opportunity to work on cutting-edge Generative AI and Agentic AI systems Collaborative and innovation-driven engineering culture Exposure to real-world AI pr Interested candidates can share their updated resume at: [email protected]