Senior Software Engineer - AI

About Truveta

Role Overview

Agentic AI Responsibilities

• Design multi-agent workflows with reasoning, reflection, planning, tool use, and memory.
• Build and integrate RAG pipelines, vector databases, semantic search, and context injection.
• Design evaluation and continuous-improvement methods using ML metrics, evaluators, grader models, and LLM judges.
• Stay current with evolving AI architectures, agentic frameworks, reasoning, and retrieval paradigms.

Engineering and Leadership

• Partner with platform, application, and product engineers to deliver scalable AI solutions.
• Apply modular architecture, software design principles, testing, and code quality practices.
• Set technical direction, mentor peers, and balance innovation, performance, and reliability.
• Apply ethical AI principles to healthcare systems responsibly and at scale.

Key Qualifications

• Bachelor's or master's degree in computer science, artificial intelligence, or a related technical field.
• 5+ years of experience building and deploying scalable, production-ready ML systems.
• Strong Python and software engineering skills in modern cloud environments.
• Experience with agentic AI frameworks, vector databases, embeddings, RAG, and semantic search.
• Hands-on LLM or multimodal model fine-tuning using LoRA, PEFT, or TRL.
• Experience with CI/CD, Git, testing, debugging, experimentation, and containerized applications.
• Strong communication and teamwork skills.

Preferred Experience

• Deep experience with MCP architecture, AI systems or APIs, or large-scale codebases is preferred.
• FastAPI-based web service experience is a plus.

Why Truveta