linkedin
Engineering Manager - Forward Deployed Engineering (LLM)
Baseten
Montreal, CAN
Full Time
Manager
Field
5 days ago
PythonLLMInference OptimizationvLLMTensorRTTriton
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonLLMInference Optimization
About the Role
Baseten is seeking an Engineering Manager (Player & Coach) to lead a team of Forward Deployed Engineers focused on building, scaling, and optimizing LLM inference workloads.
Key Skills for This Role
PythonLLMInference OptimizationvLLMTensorRTTriton
Responsibilities
- Lead, mentor, and grow a team of Forward Deployed Engineers, providing guidance on technical direction, project execution, and professional development.
- Set clear goals and ensure timely, high quality delivery across multiple customer facing projects involving LLM deployment and inference optimization.
- Collaborate with leadership to align team priorities with company and customer goals.
- Develop and maintain software systems and product features using Python in a production level environment.
- Drive customer impact by designing, implementing, and deploying Baseten solutions end to end.
- Deliver with velocity: turn vague objectives into clear specs and well defined PoCs.
- Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack.
- Own products and customer projects end to end, functioning as both an engineer, project manager, and product manager.
Requirements
- Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or related field.
- 4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship capacity.
- Strong programming skills in Python, with production experience in building or optimizing ML inference systems.
- Proven experience with LLMs, inference optimization, or serving frameworks (e.g., vLLM, TensorRT, Triton, Hugging Face, Ray Serve).
- Familiarity with observability, profiling, and cost/performance tradeoffs in production ML systems.
- Excellent communication and collaboration skills—able to lead cross functional efforts and drive outcomes in ambiguous, fast paced environments.
Full Job Posting
About Baseten
- Baseten powers mission critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer.
- We're growing quickly and recently raised our CAD 1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital.
THE ROLE
- As an Engineering Manager (Player & Coach), you will lead and mentor a team of Forward Deployed Engineers focused on building, scaling, and optimizing LLM inference workloads for Baseten customers.
- FDE at baseten is not a sales function – we are a mix of engineering, product, and customer architects who contribute to the core Baseten codebase, drive large portions of our feature roadmap, and execute on complicated customer engagements.
Responsibilities
- Leadership & Team Management: Lead, mentor, and grow a team of Forward Deployed Engineers.
- Set clear goals and ensure timely, high quality delivery across multiple customer facing projects involving LLM deployment and inference optimization.
- Collaborate with leadership to align team priorities with company and customer goals.
- Player coach – While much of this role will be leading the team, you will also be expected to be a key driver on strategic product initiatives and customer engagements.
- Technical Ownership: Develop and maintain software systems and product features using Python.
- Drive customer impact by designing, implementing, and deploying Baseten solutions end to end.
- Deliver with velocity: turn vague objectives into clear specs and well defined PoCs.
- Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack.
- Own products and customer projects end to end, functioning as both an engineer, project manager, and product manager.
Requirements
- Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or related field.
- 4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship capacity.
- Strong programming skills in Python, with production experience in building or optimizing ML inference systems.
- Proven experience with LLMs, inference optimization, or serving frameworks (e.g., vLLM, TensorRT, Triton, Hugging Face, Ray Serve).
- Familiarity with observability, profiling, and cost/performance tradeoffs in production ML systems.
- Excellent communication and collaboration skills—able to lead cross functional efforts and drive outcomes in ambiguous, fast paced environments.
BONUS POINTS
- Experience leading customer facing engineering teams or working directly with enterprise partners.
- Deep understanding of GPU infrastructure, distributed inference, or model compression techniques.
Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Flexible PTO policy including company wide Winter Break.
- Paid parental leave.
- Fertility and family building stipend through Carrot.
- Company facilitated 401(k).
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Compensation Range
- CAD 260K CAD 380K
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Baseten
Forward Deployed Engineer
Montreal, CAN
MidFull Time
Baseten is seeking a Forward Deployed Engineer to partner with customers in architecting, building, and deploying high-scale production AI applications. This hands-on engineering role involves coding, customer-facing imp
5 days agoView →
Solution Architect
Montreal, CAN
SeniorFull Time
Baseten seeks a Solution Architect to partner with Sales and customers, translating business needs into technical solutions. You will lead demos, technical scoping, and drive proofs of value. Requires an AI/ML background
5 days agoView →