Base Career helps you apply smarter for this job.
Key skills for this role
There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.
Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.
As a Principal Machine Learning Engineer, you are a deep technical authority responsible for designing and evolving the most critical ML systems in the company.
You operate across training, inference, evaluation, and infrastructure, solving the hardest architectural and performance problems. While Technical Leads may own execution at the team level, you set the technical standard and shape how ML systems are built across the organization.
This is a hands-on, high-impact role focused on depth.
Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment.
Design reproducible, high-performance training pipelines across GPU infrastructure.
Architect inference systems that balance latency, throughput, cost, and reliability at scale.
Design and maintain data systems for high-quality synthetic and real-world training data.
Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership.
Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
, USA
, USA
, USA
New York City, USA
, USA
New York City, USA
, USA
, USA
, USA
Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products.
Make pragmatic trade-offs and ship improvements quickly, learning from real usage.
Work under real production constraints: latency, cost, reliability, and safety
Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer.
Contributions to open-source ML or systems libraries.
Background in scientific computing, compilers, or GPU kernels.
Experience with RLHF pipelines (PPO, DPO, ORPO).
Experience training or deploying multimodal or diffusion models.
Experience with large-scale data processing (Apache Arrow, Spark, Ray).
ML systems (training, inference, evaluation) are reliable, scalable, and meet defined performance targets.
Models deployed to production achieve measurable quality improvements and meet user-impact goals.
Production issues are proactively monitored, debugged, and resolved with clear root-cause analysis.
Team and cross-functional collaborators benefit from clear guidance, best practices, and scalable ML solutions.
Research-to-production cycles are efficient, safe, and continuously improve the product experience.
The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product
If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.
Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.
We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.
Verified company details for this employer are not available yet.
Full-time
Senior
Remote
Apply faster on company sites with our extension.