Principal, Software Development Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Workday is looking for a Principal Software Development Engineer to lead the AI Model Serving platform, shaping vision and technical direction. You will design and scale distributed systems serving ML models and LLMs, with 8+ years of experience in large-scale systems.
Key Skills for This Role
Responsibilities
- Help set the product vision for the AI Model Serving platform in partnership with the engineering manager
- Lead the team technically by making critical design decisions for performance, reliability, and scalability
- Design, implement, and maintain large scale systems for moving ML models to production
- Write design documents to build consensus for new system components and enhancements
- Evaluate and uptake new technologies
- Troubleshoot, improve, and scale continuous integration software pipelines
- Develop relationships with software engineers, ML engineers, and data scientists on partner teams
- Respond to alerts and debug production issues
- Review pull requests and enforce consistency, performance, readability, and security
- Develop documentation to share knowledge with other engineers
Requirements
- 8+ years of related work experience in software development, building and operating large scale distributed systems
- Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent practical experience)
- Deep proficiency in Python with production level code experience
- Experience with Ray and Ray Serve for distributed model serving at scale
- Experience with Prometheus for monitoring and observability
- Familiarity with both large language models and traditional ML models in production
- Excellent written and verbal communication skills
- Experience mentoring other engineers and fostering inclusive team environment
Full Job Posting
About The Team
- The AI Model Serving team powers all production Workday agents and ML use cases.
- Owns services for vendor hosted LLMs on GCP and AWS Bedrock and operates the model deployment platform.
- Hosts thousands of traditional ML models across sharded Ray Serve clusters, handling ~2,000 requests per second.
- Provides uniform interface for models on Bedrock and Gemini, evaluation platform for generative AI, and production model registry.
Key Responsibilities
- Help set the product vision for the AI Model Serving platform in partnership with the engineering manager.
- Lead the team technically by making critical design decisions that drive performance, reliability, and scalability.
- Design, implement, and maintain large scale systems for moving ML models to production.
- Write design documents to build consensus for new system components and enhancements.
- Evaluate and uptake new technologies.
- Troubleshoot, improve, and scale continuous integration software pipelines.
- Develop relationships with software engineers, ML engineers, and data scientists on partner teams.
- Respond to alerts and debug production issues.
- Review pull requests and enforce consistency, performance, readability, and security.
- Develop documentation to share knowledge with other engineers.
About You
- 8+ years of related work experience in software development, with focus on large scale distributed systems.
- Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent practical experience).
- Deep proficiency in Python with production level code experience.
- Experience with Ray and Ray Serve for distributed model serving at scale.
- Experience with Prometheus for monitoring and observability.
- Familiarity with both large language models and traditional ML models in production.
- Excellent written and verbal communication skills.
- Collaborative approach with experience mentoring other engineers.
Our Approach to Flexible Work
- Spend at least half (50%) of time each quarter in the office or in the field with customers, prospects, and partners.
- Flexible schedule to cater to business, team, and personal needs.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Workday
Principal Product Manager - Activation & Deployment, Evisort AI
Greater Toronto Area, CAN
Workday seeks a Principal Product Manager for Evisort AI to bridge AI capabilities with customer environments, defining strategy for AI agent activation and deployment. You will shape demos, POCs, and technical narrative
Principal, Software Development Engineer
Calgary, CAN
Workday seeks a Principal Software Development Engineer for the AI Model Serving team, which powers all production AI workloads. You will lead technical direction, design large-scale distributed systems, and shape the pl
Senior Product Manager - Data Analytics Platform
Vancouver, CAN
Workday seeks a Senior Product Manager for its Analytics Platform team to build capabilities for Data Cloud and Prism in Built-on-Workday. You will define vision and roadmap, partner with engineering and design, and dive
Manager, Software Development Engineering - AI Platform
Vancouver, CAN
Workday is looking for an Engineering Manager to lead a team building the Agent Platform—the core infrastructure for developing, deploying, and operating AI agents in production. You will drive execution, shape technical
Director, Solution Consulting - MENA
Dubai, UAE
Workday is seeking a Director of Solution Consulting for the MENA region to lead solution consulting operations, support revenue targets, and maintain high customer satisfaction. The role involves setting vision, plannin
Director, Solution Consulting - MENA
, UAE
Workday seeks a Director of Solution Consulting for the MENA region to lead solution consulting operations, support revenue targets, and manage a team. The role requires 10+ years in solution consulting and 5+ years in m
Principal Product Manager - Workday AI - Agent Factory
Vancouver, CAN
Workday seeks a Principal Product Manager to join the Agent Factory team, building autonomous AI agents for enterprise domains like finance and HCM. You will own an AI agent end-to-end from concept through GA, prototypin
AI Engineer/Senior AI Engineer - Evisort
Vancouver, CAN
Workday's Evisort AI team is seeking an AI Engineer to develop tailored user experiences using advanced LLMs, Knowledge Graphs, and predictive analysis. You will collaborate to deliver AI solutions across Workday's produ
Principal Product Manager - Activation & Deployment, Evisort AI
Greater Toronto Area, CAN
Principal, Software Development Engineer
Calgary, CAN
Senior Product Manager - Data Analytics Platform
Vancouver, CAN
Manager, Software Development Engineering - AI Platform
Vancouver, CAN
Director, Solution Consulting - MENA
Dubai, UAE
Director, Solution Consulting - MENA
, UAE
Principal Product Manager - Workday AI - Agent Factory
Vancouver, CAN
AI Engineer/Senior AI Engineer - Evisort
Vancouver, CAN