Applied AI Systems Engineer

We’re a rare blend of mission-driven capitalists. We are on the path towards building a $200B+ business while dramatically improving the healthcare system—and patients’ lives.

Like athletes, we are constantly honing our craft to produce our best possible work.

We work with intention and humility. We support and challenge each other to be our best selves.

And as a team, we achieve goals together that would be impossible alone.

We spend one week every month offsite in beautiful places like Tahoe, Squamish, Mendocino, the Santa Cruz mountains, and Monterrey. We ship an incredible amount of product on these offsites. And we have a blast — climbing, swimming, surfing, and otherwise enjoying these beautiful places.

Rediscover the magic of coding late into the night, in the zone. Side by side with a team that—through their example of excellence—is inspiring you to reach your potential.

It’s not for everyone.

But if you long for an intense camaraderie that you can’t find elsewhere, then Neon is the place for you.

You’ll work across our AI agent platform — writing prompts, debugging runtime issues, building agent simulation tooling, creating evals, interfacing with client data, and helping us monitor system behavior at scale.

This is not a model training role — it's an applied systems position focused on behavior , infrastructure , and debugging real-world agents in production.

You will be working at the forefront of agentic AI, where you’ll be pushing the boundaries of our agents’ capabilities.

Some examples of what you might work on:

Trace and fix runtime bugs, then write regression tests.

Design evaluation datasets to simulate realistic workflows or red-team our system.

Build internal tooling for QA and agent simulation.

Normalize and transform messy client data for system integration.

Set up automatic testing and latency tracking infrastructure.

Create dashboards and observability tooling for agentic system behavior.

Expand on our existing eval & testing framework and agent simulation infrastructure.

We're looking for engineers with 2-7 years of experience who have worked closely with LLMs or AI agents in production systems . This is not a model R&D role — it’s about applying AI to real-world use cases: debugging behavior, designing evals, and building the infrastructure to scale intelligent systems.

You might be a strong fit if:

You've worked directly with LLM-based systems: writing prompts, chaining model calls, designing evals, or building agents that take actions or simulate behavior.

You've created internal tools or frameworks to support QA, evals, or agent simulation , and care about making complex systems observable and testable.

You’ve contributed to fast-paced product cycles involving AI behavior, latency, and user experience , and you’re comfortable validating behavior by inspecting outputs, not just logs.

Nice to have:

Experience with multi-agent systems , TTS/NLP pipelines , or structured output validation .

Familiarity with testing frameworks, LangChain-style agent orchestration, or in-house eval harnesses.

Neon is building the automation platform for healthcare enterprises.

We're backed by top Silicon Valley investors.

We're profitable and growing fast with 7+ figure customer contracts.

Apply today to join a rocket ship that is bringing state-of-the-art AI systems to pharma, and bringing life-saving medications to the patients who need them.

Keywords: Forward-Deployed Engineer, AI Engineer, Prompts, Evals, LLM