Senior Lead Architect, AI

Overview: Lead the technical vision and architecture for Suffolk Global Artificial Intellignece, spanning AI infrastructure and use case development. Ensure scalable, secure, and reusable AI systems aligned with enterprise platform strategy. Key Responsibilities: Define enterprise AI architecture across: LLMOps, agent frameworks, RAG systems, and platform services Own design authority for: Observability, guardrails, evaluation frameworks Ensure delivery of reusable AI Infrastructure-as-a-Service across products Drive technical governance (security, auditability, portability) Partner with Central Dev and Product teams on system design Mentor and elevate engineering quality across pods Qualifications: Experience 1015 years in software engineering with last 5+ years in AI/ML systems (yes, since before GenAI) Proven track record building production-grade AI platforms (not just prototypes) Experience optimizing token usage across multiple systems and models Experience leading multi-team/platform architecture across geographies LLM / AI Systems Expertise Deep hands-on experience with: RAG architectures (chunking, embeddings, retrieval optimization) Agent frameworks (LangGraph, AutoGen, Semantic Kernel, or similar) Prompt engineering strategies (few-shot, tool use, structured outputs) Training and optimization of ML models - both neural and classical Experience designing evaluation frameworks: Offline evals (BLEU, ROUGE, semantic similarity, human eval loops) Online evals (A/B testing, drift detection) Platform & Infrastructure Strong experience building LLMOps platforms , including: Model routing, fallback strategies, and cost optimization Prompt/version management systems Experience with: Vector DBs (Pinecone, Milvus, Weaviate, FAISS, pgvector) Streaming / async systems (Kafka, Pub/Sub) Cloud & Systems Design Deep expertise in AWS or Azure: Compute (EKS, ECS, Lambda) Storage (S3, Blob, data lakes) Experience designing multi-tenant, secure enterprise systems Governance & Safety Experience implementing: Guardrails (prompt sanitization, tool restrictions) PII handling, audit logging, and compliance workflows Competencies Strategic thinking System design excellence Technical leadership across teams