Vice President, Machine Learning & Systems Compiler Engineering

What You Will Build

Compiler Architecture & Intermediate Representations

● Architect and evolve our client's compiler IR strategy, building on MLIR/LLVM infrastructure to lower high-

level ML graphs into hardware-aware representations for RISC-V and AI accelerator execution

● Design and own custom dialects, optimization passes, and lowering pipelines that map cleanly onto ASHAI's

vector and accelerator ISA extensions

● Set the multi-year technical roadmap for the compiler stack, balancing near-term customer performance

commitments against long-term platform scalability

Graph-Level Optimization & Performance Engineering

● Drive graph transformations, operator fusion, pattern rewriting, quantization, and memory planning strategies

that materially reduce latency and increase throughput on our client's hardware

● Own performance benchmarking of the compiler stack against GPU baselines: tokens per second, cost per

token, and memory efficiency

● Profile, debug, and tune computational kernels, including matrix multiplication, attention, and other core

inference operators, to close the gap between theoretical and achieved performance

Toolchain, SDK & Developer Platform

● Design, build, and maintain a scalable, production-grade compiler toolchain and SDK APIs that customers use

to compile and deploy models on our client's hardware

● Own RISC-V toolchain integration: compiler support, ABI compatibility, and build system tooling for ASHAI-

optimized binaries

● Establish automated testing, benchmarking, and CI/CD infrastructure that keeps the compiler stack stable as it

scalesTeam Building & Technical Leadership

● Recruit, hire, and lead a world-class compiler engineering team from the ground up, setting hiring bar, technical

direction, and career growth paths

● Guide engineers through code review, design review, and mentorship practices that keep the codebase and team

execution at a high standard

● Evaluate and integrate learning-based and agent-assisted approaches into the compilation pipeline and the

team's own development practices where they measurably improve outcomes

Hardware/Software Co-Design & Cross-Functional Collaboration

● Partner directly with the SoC Architecture team to align compiler capabilities with the constraints and

opportunities of our client's custom silicon, informing ISA extension and microarchitecture decisions

● Partner with the VP, System & Applications Engineering on the boundary between the compiler stack and the

runtime, HAL, and developer SDK, keeping API contracts and framework integration paths coherent end to end

● Represent the compiler team's perspective in architecture reviews, ensuring compiler and code-generation

requirements are first-class inputs to silicon decisions

Open-Source Engagement

● Actively participate in, contribute upstream to, and track major open-source compiler ecosystems relevant to

our client's stack, including LLVM, MLIR, OpenXLA/StableHLO, Triton, and TVM

● Represent our client in the broader ML compiler community, building the company's credibility and visibility

among framework and hardware ecosystem partners

What We Are Looking For

Required Experience

● 15+ years in compiler/systems engineering, including 5+ years leading a compiler team

● Expert in modern C/C++ and Python on Linux

● Deep expertise in compiler fundamentals, IRs, and hands-on LLVM/MLIR experience

● Familiarity with major DL frameworks: PyTorch, TensorFlow, or JAX

● Strong foundation in data structures, graph algorithms, and optimization techniques

● Proven ability to build and lead cross-disciplinary engineering teams

Strongly Preferred

● Experience mapping code to GPUs, TPUs, NPUs, or custom AI accelerators

● Background in instruction selection, register allocation, or SIMD/vectorization

● Experience with OpenXLA, StableHLO, TVM, or Triton

● RISC-V depth: privilege levels, RVV extension, LLVM/GCC toolchain, and ABI conventions; ecosystem

contributions a plus

● Track record shipping compiler software to web-scale cloud or embedded environments

● Familiarity with Bazel/CMake and CI/CD pipelines

● Experience taking a new platform's compiler from zero to production-ready

Leadership Qualities

● Operates at both strategic and implementation levels: can set compiler architecture direction and contribute

directly on critical-path components

● Track record of building high-performing compiler or systems teams from a small base, including hiring,

mentoring, and setting technical culture

● Strong communicator across technical and business audiences; able to translate compiler performance work into

customer-facing throughput, cost, and latency terms

● High tolerance for greenfield ambiguity: this role requires defining structure and priorities where none currently

exist