Data Engineer (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Halian is seeking a Data Engineer with a software engineering mindset to join their Data & AI team in Abu Dhabi. You will build robust, scalable data infrastructure on AWS using Dagster, dbt, and Clickhouse, and integrate GenAI capabilities into engineering workflows.
Key Skills for This Role
Responsibilities
- Integrate GenAI capabilities (LLMs, LangChain) into engineering workflows
- Develop and maintain reliable ETL/ELT pipelines using SQL and Python
- Use dbt to model raw data into clean, business ready datasets (Star Schema)
- Own the quality of data by implementing tests (dbt tests, unit tests)
- Work with AWS services (S3, DMS, Glue) and containerized environments (Docker/Kubernetes) to deploy code
- Partner with Data Scientists and Product Managers to understand data needs and deliver solutions
Requirements
- 3+ years of hands on experience in Data Engineering
- Familiarity with LLMs, AWS Bedrock, or LangChain
- Experience or exposure to Retrieval Augmented Generation (RAG)
- Experience automating workflows using AI and integrating LLM capabilities into engineering or data pipelines
- Comfortable with Version Control (Git), code reviews, and testing
- Ability to write complex, efficient SQL queries and understand data modeling concepts
- Ability to write clean Python scripts for data manipulation and automation
Full Job Posting
Role Overview
- We are looking for a Data Engineer with a software engineering mindset to join our Data & AI team.
- This is an opportunity to build robust, scalable, and observable data infrastructure on the cloud.
- You will work with a modern tech stack (Dagster, dbt, Clickhouse, AWS) to build pipelines powering analytics, ML, and GenAI products.
Tech Stack
- Languages: SQL, Python
- Orchestration: Dagster (migrating from Airflow)
- Data Stores: Redshift, Clickhouse, S3
- Transformation: dbt, Fivetran
- Cloud & Infra: AWS (ECS/EKS, Glue, Lambda, Athena)
- IaC: Terraform with Terragrunt
- AI/GenAI: AWS Bedrock, LangChain, LLMs
Key Responsibilities
- Integrate GenAI capabilities (LLMs, LangChain) into our engineering workflows.
- Develop and maintain reliable ETL/ELT pipelines using SQL and Python.
- Use dbt to model raw data into clean, business ready datasets (Star Schema) that enable stakeholders to self serve.
- Own the quality of your data. Implement tests (dbt tests, unit tests).
- Work with AWS services (S3, DMS, Glue) and containerized environments (Docker/Kubernetes) to deploy your code.
- Partner with Data Scientists and Product Managers to understand their data needs and deliver high quality solutions.
Essential Experience
- 3+ years of hands on experience in Data Engineering.
- Familiarity with LLMs, AWS Bedrock, or LangChain.
- Experience or exposure to Retrieval Augmented Generation (RAG).
- Experience automating workflows using AI and integrating LLM capabilities into engineering or data pipelines.
- You treat data pipelines like software products. Comfortable with Version Control (Git), code reviews, and testing.
- You can write complex, efficient queries and understand data modeling concepts.
- You can write clean Python scripts for data manipulation and automation (beyond just 'notebook scripting').
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
A six-month, full-time project assignment for a hands-on Finance Data Analytics & Automation Consultant in Dubai. You will partner with the Group Finance Director to build an automated, data-led, AI-enabled reporting env
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
A leading organization is seeking a Technical Business Systems Analyst to bridge business and technology. The role involves translating stakeholder requirements into technical deliverables, working with development and Q
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
We are seeking a Senior Frontend Designer to design, build, and maintain modern, responsive web applications. The role combines deep frontend expertise with backend contributions using Node.js and Python. Requires 6+ yea
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Halian is hiring a Conversational AI Engineer for a 1-year extendable contract in Abu Dhabi. The role requires 5+ years of Python experience, expertise in Prompt Engineering and RAG, and experience with Azure OpenAI Serv
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs). The role involves designing planning and control algorithms, mathematical modeling, and integrati
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Document Controller for a sustainable urban development project in Abu Dhabi. The role involves managing document control systems, ensuring compliance with standards, and supporting project teams. Can
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Our client is seeking a Finance Manager to lead the finance function of the UAE entity, ensuring accurate financial reporting, statutory compliance, and effective treasury management. The role requires 8-12 years of expe
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs) in Abu Dhabi. The role involves designing planning and control algorithms, mathematical modeling,
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE