Senior Backend Engineer: Machine Learning Infrastructure

Design, build, and operate high-load distributed backend services that power the company's ML infrastructure

Take end-to-end ownership of core ML services and related data pipelines: from design and implementation to deployment, observability, and continuous improvement

Partner with ML and product teams to understand their needs and turn them into reliable, reusable platform capabilities

Make and defend technical decisions: evaluate trade-offs, design first, and own the outcome

Be responsible for what you and your team do

Experience with Rust (or C/C++/Go) - a strong plus

Experience developing or contributing to ML platforms or ML infrastructure - a strong plus

Experience setting up and operating any vector database (Qdrant, Milvus, Weaviate, OpenSearch, pgvector, etc.) - a strong plus

Experience with model serving / inference infrastructure, including LLMs

Experience with Infrastructure as Code (Terraform or similar)

At Constructor.io we are committed to cultivating a work environment that is diverse, equitable, and inclusive. As an equal opportunity employer, we welcome individuals of all backgrounds and provide equal opportunities to all applicants regardless of their education, diversity of opinion, race, color, religion, gender, gender expression, sexual orientation, national origin, genetics, disability, age, veteran status or affiliation in any other protected group.

Studies have shown that women and people of color may be less likely to apply for jobs unless they meet every one of the qualifications listed. Our primary interest is in finding the best candidate for the job. We encourage you to apply even if you don’t meet all of our listed qualifications.