Staff Software Engineer, Agentic SDLC Foundations

Responsibilities

• Design and scale production developer agents, establishing patterns for trajectory planning, tool selection, and state recovery.
• Implement intelligent HITL approval gates, intent disambiguation, and graceful to ensure safe execution of actions.
• Architect evaluation pipelines that grade multi-step trajectories, tool-call fidelity, intermediate states, and reasoning paths beyond static input/output matching.
• Establish closed-loop pipelines converting execution failures and human corrections into golden datasets, prompt/tool-schema optimizations, and fine-tuning cycles.
• Curate end-to-end benchmarks replicating complex developer tasks to evaluate agent capabilities and establish standardized Key Performance Indicator (KPIs) across workflows.
• - Design and scale production developer agents, establishing patterns for trajectory planning, tool selection, and state recovery. - Implement intelligent HITL approval gates, intent disambiguation, and graceful to ensure safe execution of actions. - Architect evaluation pipelines that grade multi-step trajectories, tool-call fidelity, intermediate states, and reasoning paths beyond static input/output matching. - Establish closed-loop pipelines converting execution failures and human corrections into golden datasets, prompt/tool-schema optimizations, and fine-tuning cycles. - Curate end-to-end benchmarks replicating complex developer tasks to evaluate agent capabilities and establish standardized Key Performance Indicator (KPIs) across workflows.

Minimum qualifications:

Preferred qualifications:

Qualifications

• Minimum qualifications: - Bachelor’s degree or equivalent practical experience. - 8 years of experience in software development. - 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture. - 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning). - Experience integrating generative AI tools or LLM interfaces into workflows. Preferred qualifications: - Master’s degree or PhD in Engineering, Computer Science, or a related technical field. - 3 years of experience in a technical leadership capacity (e.g., leading technical roadmaps, designing multi-system architectures, and guiding cross-functional engineering efforts). - Experience designing and implementing AI/ML evaluations, LLM benchmarking frameworks, or agentic quality measurement pipelines. - Experience in prompt optimization, LLM fine-tuning, automated dataset generation, and trajectory-based evaluation methodologies. - Experience taking generative AI solutions or autonomous agent loops from prototype to high-reliability production systems.