Ai Platform Engineer (Agentic)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Design and implement multi-agent orchestration frameworks, build model-serving layers, and ensure AI security controls with strong backend engineering skills in Python.
Key Skills for This Role
Full Job Posting
Key Responsibilities
- Design and implement the multi-agent orchestration framework using frameworks such as LangGraph, CrewAI, AutoGen, or custom Python.
- Build the model-serving and routing layer supporting multiple LLM backends (self-hosted open-weights models and approved API providers), with caching, fallback and cost tracking.
- Implement tool integrations: SIEM APIs, Tenable, ExtraHop, GitLab, Fortify, sandbox detonation, shell/code execution sandboxes, MITRE ATT&CK/D3FEND knowledge bases.
- Build vector stores, RAG pipelines and long-term memory for agents; maintain curated security knowledge corpora.
- Engineer the evaluation harness: golden datasets, regression tests, red-team prompts, quality and safety metrics per agent.
- Implement guardrails and AI security controls per PLOT4AI, OWASP LLM Top 10, MITRE ATLAS and NIST AI RMF: prompt-injection defence, output filtering, tool-use authorization, data exfiltration controls, model supply-chain verification.
- Package and deploy the platform on private cloud with full observability (traces, token usage, cost, latency, safety events).
- Partner with the Principal AI Security Architect on threat modelling of the platform itself.
Goals
- Deliver a production-grade agentic AI platform that the three agent lines (SOC, Pentest, Code Review) can build on without reimplementing common primitives.
- Ensure every deployed agent runs under enforced guardrails, authorization boundaries, and full audit logging.
- Achieve reproducible agent quality through a rigorous evaluation and regression framework no silent regressions between model or prompt updates.
- Keep infrastructure and model costs transparent and under budget through routing, caching and quota controls.
Specific Objectives (Smart)
- Within 30 days: publish architecture, select orchestration framework, stand up dev environment, and deliver a hello agent end-to-end trace.
- Within 60 days: deliver v0.1 of the platform with tool-use, RAG, guardrails and evaluation harness; onboard the AI SOC agent as the first tenant.
- Within 90 days: deliver v0.2 supporting the AI Pentest and AI Secure Code Review agents; publish threat model and AI RMF mapping.
- Within 6 months: production-grade v1.0 with SLOs, on-call runbooks, and red-team validation.
Timeline & Engagement Model
- 12-month contract.
- Design + MVP: Months 1-3.
- Multi-agent support: Months 3-6.
- Production hardening: Months 6-12.
Required Skills & Experience
- 5+ years backend engineering in Python (FastAPI, async, typing); strong systems design.
- Hands-on experience building LLM agent systems with LangGraph / LangChain / CrewAI / AutoGen or equivalent.
- Production experience with vector DBs (pgvector, Qdrant, Weaviate), embedding pipelines, and RAG.
- Strong MLOps / LLMOps: model serving (vLLM, TGI, Ollama), evaluation frameworks, tracing (OpenTelemetry, LangSmith, Langfuse).
- Cloud-native delivery: Docker, Kubernetes, Helm, CI/CD via GitLab.
- Working knowledge of OWASP LLM Top 10, NIST AI RMF, MITRE ATLAS, PLOT4AI.
- Security mindset: secrets handling via Vault, least-privilege tool access, auditability.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Client of Salt
Oracle Fusion Finance Solution Architect
Riyadh, KSA
We are looking for an experienced Oracle Fusion Finance Solution Architect to join a major ERP transformation programme in Riyadh. This role is suited to a senior Oracle Finance...
Senior Studio Production Manager
Dubai, UAE
We are hiring a Senior Studio Production Manager to oversee end-to-end studio operations for a large-scale, multi category retailer. The role is responsible for managing a team ...
GCP Cloud Architect
Riyadh, KSA
Seeking experienced Cloud Architects to design secure, scalable cloud solutions on Azure and GCP, ensuring compliance and governance for enterprise clients.
IT Disaster Recovery (ITDR) Consultant
Riyadh, KSA
The role involves leading IT Disaster Recovery assessments, designing recovery plans, and developing governance frameworks while engaging stakeholders and ensuring compliance.
AI Engineer
, UAE
Design and implement LangGraph agent graphs, build LLM extraction pipelines, and integrate AI tools while ensuring model evaluation and testing.
SAP S/4HANA SCM Consultant (MM/WM)
Riyadh, KSA
Seeking an experienced SAP S/4HANA SCM Consultant to implement Materials Management and Warehouse Management solutions, ensuring business process optimization and integration.
Senior Consultant SAP BW Migration Expert
United Arab Emirates, UAE
Lead assessment and migration planning for SAP BW, requiring expertise in SAP technologies, stakeholder management, and cloud data platforms.
SAP Basis Lead
Saudi Arabia, KSA
Lead technical delivery of SAP S/4HANA Greenfield implementation, ensuring installation, upgrades, and administration of SAP landscape with strong expertise in architecture and ...
Oracle Fusion Finance Solution Architect
Riyadh, KSA
Senior Studio Production Manager
Dubai, UAE
GCP Cloud Architect
Riyadh, KSA
IT Disaster Recovery (ITDR) Consultant
Riyadh, KSA
AI Engineer
, UAE
SAP S/4HANA SCM Consultant (MM/WM)
Riyadh, KSA
Senior Consultant SAP BW Migration Expert
United Arab Emirates, UAE
SAP Basis Lead
Saudi Arabia, KSA