Senior Compiler & Agentic Framework Engineer

Job Title : Senior Compiler & Agentic Framework Engineer

Experience: 3–5 Years

Location: Mumbai (Onsite)

Job Type : Permanent

Notice Period: Immediate Joiners Preferred

We're hiring a Senior Compiler & Agentic Framework Engineer to build the execution layer that transforms raw LLM outputs into production-ready software. If you're passionate about compiler technologies, AI infrastructure, and agentic frameworks, this is an opportunity to work on cutting-edge AI systems

.

Key Responsibilities

• Build Dockerized, isolated execution environments and automated test harnesses.
• Develop grammar-constrained decoding using frameworks such as Outlines or Guidance
• Integrate local 26B LLMs with agentic developer frameworks like Aider and custom IDE extensions.
• Design and implement evaluation pipelines for multi-language repositories across Java, .NET, Python, Node.js, TypeScript, Bash, COBOL, and C
• Build secure validation and execution pipelines for AI-generated code
• Optimize high-performance model inference using vLLM, Triton Inference Server, or llama.cpp
• Collaborate with AI, platform, and engineering teams to deliver scalable developer tooling

Required Skills

• Strong experience with Compiler Technologies, ASTs, Tree-Sitter, and Runtime Sandboxing.
• Proficiency in Python and one or more of Java, .NET, TypeScript, Bash, C, or COBOL.
• Experience with Docker, containerized execution environments, and automated testing.
• Hands-on knowledge of vLLM, Triton Inference Server, or llama.cpp.
• Experience building AI-powered developer tools, code validation, or execution frameworks.

Preferred Skills

• Experience with Aider, Outlines, Guidance, or similar agentic AI frameworks
• Familiarity with LLM inference optimization and local model deployment.
• Knowledge of IDE extensions, code intelligence, or developer productivity platforms.