Staff Software Engineer, Cortex AI Search Infrastructure
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Key Skills for This Role
Full Job Posting
What you will do in this role:
Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search indexing, query processing, and result ranking, semantic caching, and automated metadata extraction.
Build the "Evals Engine": Develop the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and "hillclimbing" experiments.
Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.
Optimize Performance & Cost: Direct the infra strategy for model routing, prompt caching, and token optimization to ensure Snowflake’s AI features are the most efficient in the industry.
Requirements:
- Education: Bachelor’s degree in Computer Science or a related technical field.
- Experience: 9 + years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
- Technical Stack: Deep proficiency in Go or Java (for systems) and Python (for AI orchestration).
- Systems Thinking: Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, FoundationDB, etc.).
- Domain Expertise: Familiarity with the "plumbing" of AI: vector indices, agent platforms, and building scalable data pipelines.
(Bonus) Experience with:
Query optimization and SQL engine internals.
Designing multi-tenant systems that handle sensitive enterprise data at scale.
Developing search infrastructure for large-scale applications.
Direct experience with any of the subsystems outlined above.
Every Snowflake employee is expected to follow the company’s confidentiality and security standards for handling sensitive data. Snowflake employees must abide by the company’s data security plan as an essential part of their duties. It is every employee’s duty to keep customer information secure and confidential.
Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.
How do you want to make your impact?
For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com
About Snowflake
Snowflake is a cloud-based data platform that enables organizations to store, manage, and analyze data at scale. The company provides solutions for data warehousing, data lakes, data engineering, and AI/ML workloads across major cloud providers.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Snowflake
Sr. Partner Development Director
, USA
Partner Development Direct, IBM
New York City, USA
Senior Solution Engineer, Financial Services
New York City, USA
Solution Engineering
London, GBR
Solution Engineer - Emerging Enterprise FS
London, GBR
Solution Engineer - Insurance & Asset Management
London, GBR
Senior Solution Engineer
London, GBR
Sr. Product Marketing Manager, Department Solutions
Edison, USA