Base Career helps you apply smarter for this job.
Key skills for this role
In this role, you will join the Agent Access Policies sub-team within Okta Secures AI as a Staff Machine Learning (ML) Engineer to advance Okta's authorization capabilities. By replacing static, rule-based systems with dynamic AI security mechanisms, you will deliver real-time threat inspection, agent intent evaluation, and behavioral analysis—ensuring autonomous AI agents operate safely within specified bounds.
Your core mission will be architecting and driving features for our unified control plane to establish the premier Identity Security Fabric for the agentic era. In doing so, you will help execute our guiding principle: "To get AI right, you have to get identity right."
What you’ll be doing
Implement intent-based enforcement to verify agent runtime requests match their intended purpose, requiring key capabilities.
Apply LLM reasoning and prompt parsing to interpret prompts, tool payloads, and intent in real time.
Integrate low-latency inference or semantic evaluation engines directly into the API gateway request path.
Use embeddings, vector search, or zero-shot classification to score alignment between agent intent and executed actions.
Design confidence-scored decision engines that feed semantic verification results into policy frameworks (e.g., Cedar).
Establish evaluation benchmarks, prompt injection defenses, and guardrails to prevent bypasses or false positives.
Architect scalable ML and Generative AI systems integrating retrieval, inference, and evaluation pipelines.
Optimize prompting, context retrieval, and RAG workflows for accuracy, safety, and efficiency in Claude-based systems.
Build automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
Implement schema validation, structured output enforcement, and guardrails to ensure reliable, compliant AI outputs.
What you’ll bring to the role
8+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
Melbourne, AUS
Toronto, CAN
Toronto, CAN
Toronto, CAN
San Francisco, USA
West, USA
San Francisco, USA
Bellevue, CAN
Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.
Education:Bachelor’s or Master's degree in Computer Science or related field
Extra credit
Experience integrating AI-driven systems with identity, authentication, or security products.
Exposure to ethical AI, model risk, or compliance frameworks.
Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
(P25833_3552618)
#LI-Hybrid
#LI-BB1
Below is the annual salary range for candidates located in Canada. Your actual salary will depend on factors such as your skills, qualifications, and experience. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental, and vision insurance, RRSP with a match, healthcare spending, telemedicine, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program, please visit: https://rewards.okta.com/can.
The Okta Experience
Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community
We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one. Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation. Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.
In this role, you will join the Agent Access Policies sub-team within Okta Secures AI as a Staff Machine Learning (ML) Engineer to advance Okta's authorization capabilities. By replacing static, rule-based systems with dynamic AI security mechanisms, you will deliver real-time threat inspection, agent intent evaluation, and behavioral analysis—ensuring autonomous AI agents operate safely within specified bounds.
Your core mission will be architecting and driving features for our unified control plane to establish the premier Identity Security Fabric for the agentic era. In doing so, you will help execute our guiding principle: "To get AI right, you have to get identity right."
What you’ll be doing
Implement intent-based enforcement to verify agent runtime requests match their intended purpose, requiring key capabilities.
Apply LLM reasoning and prompt parsing to interpret prompts, tool payloads, and intent in real time.
Integrate low-latency inference or semantic evaluation engines directly into the API gateway request path.
Use embeddings, vector search, or zero-shot classification to score alignment between agent intent and executed actions.
Design confidence-scored decision engines that feed semantic verification results into policy frameworks (e.g., Cedar).
Establish evaluation benchmarks, prompt injection defenses, and guardrails to prevent bypasses or false positives.
Architect scalable ML and Generative AI systems integrating retrieval, inference, and evaluation pipelines.
Optimize prompting, context retrieval, and RAG workflows for accuracy, safety, and efficiency in Claude-based systems.
Build automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
Implement schema validation, structured output enforcement, and guardrails to ensure reliable, compliant AI outputs.
What you’ll bring to the role
8+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks.
Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.
Education:Bachelor’s or Master's degree in Computer Science or related field
Extra credit
Experience integrating AI-driven systems with identity, authentication, or security products.
Exposure to ethical AI, model risk, or compliance frameworks.
Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
(P25833_3552618)
#LI-Hybrid
#LI-BB1
Below is the annual salary range for candidates located in Canada. Your actual salary will depend on factors such as your skills, qualifications, and experience. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental, and vision insurance, RRSP with a match, healthcare spending, telemedicine, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program, please visit: https://rewards.okta.com/can.
The Okta Experience
Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community
We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one. Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation. Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.
Identity and access management platform providing secure authentication, single sign-on, and zero-trust security for enterprises and developers.
Visit company websiteJobs and hiring trendsSenior · 8+ years experience
Apply faster on company sites with our extension.