Staff Machine Learning Engineer

8+ years building distributed systems and ML infrastructure with a track record delivering large, cross‑team projects to production.

Deep understanding of LLMs, inference serving patterns, vendor routing strategies, and platform design for ML workloads.

Strong system design skills: scalable architectures, service reliability engineering, capacity planning, and cost optimization.

Proficiency in Python (or comparable server-side language), Kubernetes, cloud infrastructure, and observability tooling.

Experience creating evaluation frameworks, gold‑standard datasets, and regression suites for language models.

Excellent stakeholder skills: you can synthesize product, research, and engineering constraints into pragmatic platform solutions.

Proven ability to lead technical strategy and mentor senior engineers to achieve broad adoption.

Basic Qualifications

BS in Computer Science, Engineering, or related field, or equivalent practical experience.

8+ years industry experience in backend, platform, or ML infrastructure engineering with major production responsibilities.

Demonstrable experience with cloud-native infrastructure (Kubernetes, AWS/GCP/Azure) and production ML/LLM systems.

Strong track record of building evaluation and monitoring for ML systems.

Please note that Zendesk can only hire candidates who are physically located and plan to work from Karnataka or Maharashtra. Please refer to the location posted on the requisition for where this role is based.

Hybrid: In this role, our hybrid experience is designed at the team level to give you a rich onsite experience packed with connection, collaboration, learning, and celebration - while also giving you flexibility to work remotely for part of the week. This role must attend our local office for part of the week. The specific in-office schedule is to be determined by the hiring manager.

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.

Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.

As part of our commitment to fairness and transparency, we inform all applicants that artificial intelligence (AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines and applicable law.

Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer. If you are based in the United States and would like more information about your EEO rights under the law, please click here .

Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law. If you are an individual with a disability and require a reasonable accommodation to submit this application, complete any pre-employment testing, or otherwise participate in the employee selection process, please send an e-mail to peopleandplaces@zendesk.com with your specific accommodation request.