{bc}
zoho_recruit

Forward Deployed AI Engineer

Crayon Data
Riyadh, KSA
Full-time
Senior · 4+ years experience
Onsite
Discovered Today
NVIDIA NIMLLMsDataRobotGraph DatabasesRed Hat OpenShiftKubernetes
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

NVIDIA NIMLLMsDataRobot
Smart Apply

Full Job Posting

Role Overview

We are looking for a Forward Deployed AI Engineer to deploy, integrate, optimize, and operationalize enterprise Generative AI platforms within secure, on-premise and air-gapped banking environments.

You will work closely with client IT, infrastructure, security, engineering, and AI teams to turn AI platform architectures into reliable, production-ready deployments.

What You'll Do

Deploy and configure NVIDIA NIMs, LLMs, DataRobot, Graph Databases, and related AI platforms.

Install and manage AI workloads on Red Hat OpenShift and Kubernetes environments.

Package and deploy container images, dependencies, and LLM model weights in air-gapped environments.

Configure and optimize NVIDIA GPU Operator, GPU time-slicing and MIG for AI workloads.

Optimize LLM inference performance, including TTFT, throughput, latency and GPU utilization.

Build and manage CI/CD and GitOps pipelines using tools such as ArgoCD and OpenShift Pipelines.

Develop and maintain Helm charts, Kustomize manifests and Kubernetes configurations.

Troubleshoot deployment, infrastructure, networking and performance issues in secure client environments.

Work directly with client IT, Security and Infrastructure teams to resolve technical blockers and ensure successful deployments.

What We're Looking For

4+ years of experience in Software Engineering, DevOps, Platform Engineering or a related field.

2+ years of hands-on experience in MLOps / LLMOps.

Strong experience with Red Hat OpenShift and Kubernetes.

Hands-on experience with NVIDIA GPUs and NVIDIA GPU Operator.

Experience deploying LLMs, NVIDIA NIM, Triton or enterprise AI platforms.

Strong understanding of containerization, Docker/OCI images and Kubernetes workloads.

Experience with Helm, Kustomize, Kubernetes Operators and GitOps.

Experience with ArgoCD, OpenShift Pipelines or similar CI/CD tools.

Understanding of air-gapped / disconnected environments and offline software deployment.

Good understanding of enterprise authentication and security frameworks such as Active Directory, LDAP, Kerberos and OAuth.

Experience with secure secrets management using HashiCorp Vault, OpenShift Secrets or similar technologies.

Strong troubleshooting, communication and client-facing skills.

Brownie Points

Experience deploying AI platforms in Banking / BFSI or highly regulated environments.

Experience working in air-gapped or disconnected data centers.

CKA / CKAD certification.

Experience with NVIDIA NIM, Triton Inference Server or DataRobot.

Experience with Graph Databases such as Neo4j or ArangoDB.

Experience with GPU performance tuning, MIG and GPU time-slicing.

Experience with large-scale LLM inference and RAG deployments.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Crayon Data