AI Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Looking for a Lead Data Engineer – AI / LLM Platforms We’re looking for a Lead Data Engineer to design and build scalable, cloud-native data platforms powering next-generation AI systems, including LLMs and RAG-based applications.
Key Skills for This Role
Full Job Posting
Overview
- Looking for a Lead Data Engineer – AI / LLM Platforms
- We’re looking for a Lead Data Engineer to design and build scalable, cloud-native data platforms powering next-generation AI systems, including LLMs and RAG-based applications.
- What you’ll be doing
- Build and optimize data pipelines for AI/LLM workloads (including embeddings and vector processing)
- Develop ETL/ELT workflows for structured, unstructured, and streaming data
- Design and manage vector search pipelines (FAISS, Pinecone, Weaviate, etc.)
- Develop retrieval systems for RAG and enterprise search use cases
- Implement orchestration pipelines using Airflow, Spark, or similar tools
- Work across cloud environments (Azure primarily, plus AWS/GCP)
- Collaborate closely with AI/ML teams on model integration and data pipelines
- Ensure data quality, monitoring, and reliability across systems
- What we’re looking for
Core Skills
- Strong Python and SQL skills
- Experience with NoSQL databases (MongoDB, DynamoDB, etc.)
- Solid experience with data pipelines and ETL/ELT frameworks
Ai And Llm Exposure
- Understanding of embeddings, vector search, and similarity techniques
- Experience with RAG pipelines or LLM-based systems
- Familiarity with tools like OpenAI, Hugging Face, etc.
Cloud & Engineering
- Strong experience with Azure (AWS/GCP a plus)
- Docker and containerized environments
- Exposure to Kubernetes is beneficial
Data & Orchestration
- Apache Airflow (or similar orchestration tools)
- Apache Spark or distributed data processing
- Please apply on the posting or message directly for more info
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Quantum Talent Group
AI Delivery Manager / Pod Captain
Abu Dhabi Emirate, UAE
We are seeking an AI Delivery Manager / Pod Captain to lead cross-functional teams in delivering AI-powered solutions. The role involves driving agile delivery, client engagement, team enablement, and technical governanc
Digital Marketing & Campaign Lead
Jeddah, KSA
Quantum Talent Group is seeking an experienced Digital Marketing & Campaign Lead with 7-10 years of experience to drive customer acquisition and product growth through data-driven digital marketing campaigns in the banki
AI QA Engineer
Abu Dhabi Emirate, UAE
We are looking for a Senior QA Automation Engineer to validate LLMs, RAG pipelines, AI agents, and predictive ML systems. You will build automated frameworks using Python, PyTest, Playwright, and integrate testing into C
ServiceNow Integration Engineer
Abu Dhabi Emirate, UAE
Quantum Talent Group is seeking an experienced ServiceNow Integration Engineer for a 12-month contract in Abu Dhabi. The role involves designing and delivering enterprise integrations between ServiceNow Employee Center,
Partnership Manager (Merchant Partnerships & Loyalty)
Doha, QAT
A leading payment solutions company in Doha, Qatar seeks a Partnership Manager for an 18-month contract to drive merchant acquisition, offer design, and loyalty program management. The role requires 5-8 years of experien
Head of Operations & Service Delivery
Abu Dhabi Emirate, UAE
We are partnering with a leading organization to hire a Head of Operations & Service Delivery to lead enterprise IT operations, infrastructure, cybersecurity, and IT service delivery in Abu Dhabi. The role requires 10+ y
Senior SAP Systems Engineer
Abu Dhabi Emirate, UAE
Quantum Talent Group is seeking a Senior SAP Systems Engineer for a leading AI organization in Abu Dhabi. The role involves architecting how AI agents interact with SAP, transforming enterprise systems into AI-ready plat
UI/UX Designer (Enterprise SaaS Products)
Dubai, UAE
Quantum Talent Group is seeking a UI/UX Designer to shape the user experience of a sophisticated enterprise SaaS platform in Dubai. The role involves designing intuitive interfaces, creating wireframes and prototypes, an
AI Delivery Manager / Pod Captain
Abu Dhabi Emirate, UAE
Digital Marketing & Campaign Lead
Jeddah, KSA
AI QA Engineer
Abu Dhabi Emirate, UAE
ServiceNow Integration Engineer
Abu Dhabi Emirate, UAE
Partnership Manager (Merchant Partnerships & Loyalty)
Doha, QAT
Head of Operations & Service Delivery
Abu Dhabi Emirate, UAE
Senior SAP Systems Engineer
Abu Dhabi Emirate, UAE
UI/UX Designer (Enterprise SaaS Products)
Dubai, UAE