Product Manager, Agent Harness & Modelling
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Cohere is seeking a Product Manager to own the execution layer for North's agent harness, including agent loop, context engineering, and model-scaffolding co-evolution. You will define the roadmap, engage enterprise customers, and bridge engineering and modeling teams.
Key Skills for This Role
Responsibilities
- Define and own the roadmap for North's agent harness including agent loop, context engineering layer, tool orchestration, sandbox execution, and sub agent delegation
- Serve as the primary interface between North engineering and Cohere's Modeling team
- Own North's agentic evaluation framework ensuring evals are compatible with both the North harness and Modeling's training infrastructure
- Engage enterprise customers to surface real world agentic failures and translate findings into product and model requirements
- Stay current with the open source and commercial agent ecosystem and drive adoption decisions
Requirements
- 5+ years of product management experience in agentic AI systems, developer infrastructure, or applied ML products
- Deep understanding of modern LLM agent architectures including multi agent systems, tool augmented reasoning, memory and retrieval, RAG, and long horizon execution
- Strong grasp of agentic evaluation design
- Technically deep enough to contribute to architecture decisions at the implementation level
- Ability to flex between ML research conversations and engineering architecture discussions
- Track record of shipping platform layer products with demonstrated impact on reliability, performance, or capability
Full Job Posting
Role Overview
- We are seeking an Agent Harness Product Manager to own the execution layer that makes North agents reliable, capable, and production ready.
Responsibilities
- Define and own the roadmap for North's agent harness, including the agent loop, context engineering layer, tool orchestration, sandbox execution, and sub agent delegation
- Serve as the primary interface between North engineering and Cohere's Modeling team, ensuring new harness capabilities are validated before being built
- Own North's agentic evaluation framework, ensuring evals are compatible with both the North harness and Modeling's training infrastructure
- Engage enterprise customers to surface real world agentic failures and translate findings into concrete product and model requirements
- Stay current with the open source and commercial agent ecosystem and drive adoption decisions that keep North's architecture aligned with emerging standards
Requirements
- 5+ years of product management experience in agentic AI systems, developer infrastructure, or applied ML products
- Deep understanding of modern LLM agent architectures, including multi agent systems, tool augmented reasoning, memory and retrieval, programmatic orchestration, RAG, and long horizon execution
- Strong grasp of agentic evaluation design, including how to measure task completion, failure recovery, and long horizon reliability
- Technically deep enough to contribute to architecture decisions at the implementation level
- Ability to flex between ML research conversations and engineering architecture discussions with equal fluency
- Track record of shipping platform layer products with demonstrated impact on reliability, performance, or capability
Nice to Haves
- An active practitioner of agent frameworks who regularly builds with and follows the latest developments in open source harnesses, coding agents, and orchestration tools
- Hands on experience with enterprise agentic deployments: multi tenant orchestration, tool permissioning, audit trails, and compliance requirements
- Familiarity with infrastructure constraints relevant to enterprise deployments: on premises environments, scalability challenges, and operational tradeoffs
- Prior work at the intersection of research and product, translating nascent model capabilities into shipped product features
- Background working within or closely alongside an ML research or post training team
Perks
- Weekly lunch stipend of $75/£75 or equivalent
- Full health and dental benefits including mental health budget
- RRSP matching, 401K, Pension Scheme
- 100% Parental Leave top up for up to 6 months
- Annual enrichment benefits for arts & culture, fitness/wellness, quality time, and workspace improvement
- Education & learning stipend for conferences, courses, and coaching
- 6 weeks of paid vacation
- Budget for traveling to other offices if remote, plus annual company offsite
How and Where We Work
- Cohere is remote friendly with offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more
- For those in the office: daily lunch program, snacks, and regular community and social events
- For those not near an office: a co working benefit
- Everyone receives a $500 home office stipend
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Cohere
Technical Program Manager, Product Engineering
Montreal, CAN
Cohere is seeking a Technical Program Manager to be the operating backbone of a high-visibility program expanding their AI platform into a portfolio of new products. This role involves building program infrastructure, dr
Product & Technology Communications Manager
Toronto, CAN
Cohere seeks a Product & Technology Communications Manager to craft narratives that explain its AI technology to enterprise, developer, and media audiences. You will develop communications strategies, lead product launch
Forward Deployed Engineer, Agentic Platform
Ottawa, CAN
Cohere is seeking a Forward Deployed Engineer to design, build, and deploy agentic workflows powered by LLMs for enterprise customers. You will work closely with clients to translate business problems into AI solutions,
Forward Deployed Engineer, Agentic Platform (West Coast)
Vancouver, CAN
Cohere is seeking a Forward Deployed Engineer to design, build, and deploy agentic workflows powered by LLMs for enterprise customers. You will work closely with clients to translate business problems into production-gra
Head of Sales Enablement
Montreal, CAN
Cohere is seeking a Head of Sales Enablement to design and launch a sales enablement function, develop strategies, and lead a team. The role requires 10+ years of experience in sales enablement, enterprise sales methodol
Director of Product, North
Montreal, CAN
Cohere is seeking a Director of Product for North, its agentic AI platform, to own the product vision, strategy, and execution. This senior leadership role involves setting the direction for the platform, building and le
Product Manager, Integrations
Montreal, CAN
Cohere is seeking a Product Manager to own the integration ecosystem for North, its agentic AI platform. You will define strategy, prioritize integrations, and build platform capabilities to drive customer adoption and r
Product Manager, Integrations
Toronto, CAN
Cohere is seeking a Product Manager for Integrations on the North platform, responsible for owning the integrations surface end-to-end and building platform capabilities. The role involves defining the integration ecosys
Technical Program Manager, Product Engineering
Montreal, CAN
Product & Technology Communications Manager
Toronto, CAN
Forward Deployed Engineer, Agentic Platform
Ottawa, CAN
Forward Deployed Engineer, Agentic Platform (West Coast)
Vancouver, CAN
Head of Sales Enablement
Montreal, CAN
Director of Product, North
Montreal, CAN
Product Manager, Integrations
Montreal, CAN
Product Manager, Integrations
Toronto, CAN