Lead Software Engineer – LLM Ops Platform Reliability

Preferred Qualifications, Capabilities, and Skills

• Experience developing generative AI applications, AI agents, vector search, and retrieval-augmented generation patterns
• Experience building AI agents using frameworks such as LangChain, CrewAI, LangGraph, or similar orchestration platforms
• Experience operating or integrating serving platforms such as KServe, Ray Serve, NVIDIA Triton Inference Server, Text Generation Inference (TGI), alongside vLLM/llm-d
• Familiarity with Amazon SageMaker JumpStart, SageMaker Endpoints, and Amazon Bedrock for managed model hosting
• Experience with online LLM quality monitoring (e.g., hallucination, toxicity, drift detection) and tracing via OpenTelemetry conventions
• Contributions to open-source LLM serving or inference projects (e.g., vLLM, llm-d, Ray, KServe, Triton)