AI / LLM Deployment Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Walker Lovell is seeking an AI/LLM Deployment Engineer to lead deployment of large language models into sovereign, air-gapped environments.
Key Skills for This Role
Responsibilities
- Architect and deploy LLMs including DeepSeek, Kimi, Qwen and LLaMA into secure, air gapped production environments
- Configure and optimise NVIDIA H100/H200 GPU clusters, NVLink and InfiniBand infrastructure for high performance inference
- Apply GPTQ, AWQ and GGUF quantisation techniques to maximise deployment efficiency without compromising model performance
- Deploy and optimise inference runtimes including vLLM, TGI and Ollama within Kubernetes environments, delivering target throughput and latency SLAs
Requirements
- Proven commercial experience deploying production LLMs using vLLM, TGI, Ollama or equivalent inference platforms
- Expert knowledge of Kubernetes, NVIDIA GPU infrastructure, GPU memory optimisation and high performance computing
- Hands on experience with model quantisation techniques including GPTQ, AWQ or GGUF
- Experience delivering on premise or air gapped AI deployments; experience within government, defence, cyber security or other highly regulated environments would be advantageous
Full Job Posting
What's in it for you?
- This isn't another AI application role. You'll lead the deployment of large language models including DeepSeek, Kimi and Qwen into sovereign, air gapped environments where GPU performance, inference optimisation and security are business critical.
- If you're passionate about high performance AI infrastructure, this is an opportunity to solve problems that very few engineers get to tackle.
Package / Benefits
- Exceptional package reflecting seniority and specialist expertise
- Fully remote initially with flexibility for future relocation if desired
- Visa sponsorship available where applicable
- Work with cutting edge open weight LLMs and enterprise GPU infrastructure
- Influence deployment architecture from the ground up
Why this business
- Join a globally focused technology business developing sovereign AI and intelligence platforms for highly regulated environments across multiple international markets.
- Working at the forefront of secure AI deployment, the organisation is investing heavily in advanced infrastructure and offers the opportunity to solve technically demanding challenges alongside a highly experienced engineering team.
What you'll be doing
- Architect and deploy LLMs including DeepSeek, Kimi, Qwen and LLaMA into secure, air gapped production environments
- Configure and optimise NVIDIA H100/H200 GPU clusters, NVLink and InfiniBand infrastructure for high performance inference
- Apply GPTQ, AWQ and GGUF quantisation techniques to maximise deployment efficiency without compromising model performance
- Deploy and optimise inference runtimes including vLLM, TGI and Ollama within Kubernetes environments, delivering target throughput and latency SLAs
What you'll bring
- Proven commercial experience deploying production LLMs using vLLM, TGI, Ollama or equivalent inference platforms
- Expert knowledge of Kubernetes, NVIDIA GPU infrastructure, GPU memory optimisation and high performance computing
- Hands on experience with model quantisation techniques including GPTQ, AWQ or GGUF
- Experience delivering on premise or air gapped AI deployments. Experience within government, defence, cyber security or other highly regulated environments would be advantageous.
Who this suits
- You're an infrastructure engineer who thrives on solving complex deployment challenges rather than building AI applications.
- You understand what it takes to run large language models reliably at scale, enjoy optimising GPU performance and want to work on technically demanding projects where security, performance and engineering excellence are non negotiable.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Walker Lovell
Head of Finance
Abu Dhabi Emirate, UAE
Walker Lovell is seeking a Head of Finance for a founder-led technology business in Abu Dhabi. This executive role partners directly with the CEO to shape commercial strategy, lead global finance functions, and build sca
Principal Backend Engineer - AI
Abu Dhabi Emirate, UAE
Walker Lovell is seeking a Principal Backend Engineer to shape the technical direction of a rapidly growing AI platform. This role involves owning backend architecture, defining AI agent frameworks, and mentoring enginee
Senior Executive Assistant & Office Manager
Abu Dhabi, UAE
Walker Lovell seeks a Senior Executive Assistant & Office Manager for a fast-growing technology business in Abu Dhabi. The role provides executive support to the CEO, manages office operations, coordinates HR administrat
Business Development Executive
Abu Dhabi Emirate, UAE
Walker Lovell seeks a Business Development Manager for AI and sovereign intelligence solutions. The role involves generating new business opportunities in government, defence, and critical infrastructure across GCC and i
Business Development Manager - Banking Learning Solutions
Dubai, UAE
Walker Lovell is seeking a Business Development Manager to sell strategic learning solutions to financial institutions in Dubai. You will drive new business and account growth, working with senior decision-makers to deli
Client Relationship Manager - Learning Solutions
Dubai, UAE
Client Relationship Manager – Learning Solutions Location: Dubai Compensation: Solid base + commissions + hybrid flexibility Drive Growth with a Global Learning Leader – Be the First Contact for World-Class Clients Step
Client Relationship Manager - Learning Solutions
Dubai, UAE
Client Relationship Manager – Learning Solutions Location: London (Hybrid) Compensation: Solid base + commissions + hybrid flexibility Drive Growth with a Global Learning Leader – Be the First Contact for World-Class Cli
Product Manager
, UAE
A pioneering AI business developing mission-critical intelligence platforms seeks a Product Manager to define product strategy and drive investment priorities. The role involves transforming complex customer challenges i
Head of Finance
Abu Dhabi Emirate, UAE
Principal Backend Engineer - AI
Abu Dhabi Emirate, UAE
Senior Executive Assistant & Office Manager
Abu Dhabi, UAE
Business Development Executive
Abu Dhabi Emirate, UAE
Business Development Manager - Banking Learning Solutions
Dubai, UAE
Client Relationship Manager - Learning Solutions
Dubai, UAE
Client Relationship Manager - Learning Solutions
Dubai, UAE
Product Manager
, UAE