gem
AI Inference Tools Engineer
Modular
USA
Full-time
Mid
Hybrid
USD 167000-242000 yearly / year
Discovered 2 weeks ago
C++RustGoPythonMojoNsight Systems
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
C++RustGo
Key Skills for This Role
C++RustGoPythonMojoNsight Systems
Full Job Posting
What you will do:
- Enhance the MAX developer experience by creating tools that can be part of traditional and agentic workflows, by surfacing data through the entire AI stack, and by supporting a widening list of heterogeneous hardware platforms.
- Design, build, and maintain key technologies that support the MAX framework, such as profiling and tracing tools, debuggers and associated tools to check correctness, and metrics and dashboards to monitor the performance and health of MAX deployments.
- Create agent-native tooling: tools that can be used by humans and agents alike, and the agentic workflows that go around them. Write agents to bring up models, to triage issues with running systems, and to profile and optimize based on real workloads.
- Connect MAX tools through the entire stack: by strengthening the tooling interfaces between MAX, Mojo, and the driver APIs they run on; and by integrating tool use cleanly with the orchestration layers above.
- Participate in design discussions and code reviews to uphold high engineering standards.
- Work directly with the kernel, model, and serving engineers who use your tools every day, and turn their recurring pain points into better tools.
What you bring to the table:
Passion for creating exceptional developer experiences and an understanding of what makes great tools feel effortless.
Experience designing, building, and shipping developer tools, developer infrastructure, or observability systems that other engineers rely on.
Fluency in one or more systems/performance languages (C++, Rust, Go) and one or more user-facing languages (Python; familiarity with Mojo is a plus).
Experience measuring software performance via profiling, tracing, or benchmarking, and the systems knowledge to analyze those results.
Clear written communication and the ability to work independently in a distributed team.
A user-focused mindset: you seek out the people who use your tools, learn their workflows, and prioritize what makes them more productive.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Modular
Developer Advocate, MAX Inference & Serving (Copy)
Los Altos, USA
MidFull-time
Discovered 3 weeks agoView →
Cloud Inference Engineer
, USA
Discovered 1 weeks agoFull-time
Inference Optimization Manager
Los Altos, USA
Discovered 3 weeks agoFull-time
Senior Community Engineer
Los Altos, USA
Discovered 3 weeks agoFull-time
Inference Optimization Engineer
Los Altos, USA
Discovered 3 weeks agoFull-time
Developer Advocate, MAX Inference & Serving
Los Altos, USA
Discovered 3 weeks agoFull-time
Developer Advocate, MAX Inference & Serving (Copy)
Los Altos, USA
Discovered 3 weeks agoFull-time
Product Manager, Cloud
, USA
Discovered 3 weeks agoFull-time