Senior Data Engineer (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Halian is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure in Abu Dhabi. The role requires 5+ years of experience, strong programming skills in Python/Java/Scala, and expertise in big data technologies and cloud platforms.
Key Skills for This Role
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL/ELT processes
- Develop and manage data architectures, including data lakes, warehouses, and data marts
- Ensure data quality, integrity, and consistency across systems
- Collaborate with data scientists, AI engineers, analysts, and business stakeholders
- Optimize data pipelines and workflows for performance and cost efficiency
- Implement data governance, security, and compliance best practices
- Monitor data systems, troubleshoot issues, and ensure high availability
- Integrate data from multiple sources including APIs, databases, and streaming platforms
- Maintain documentation for data pipelines, systems, and processes
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field
- 5+ years of experience in data engineering or related role
- Strong programming skills in Python, Java, or Scala
- Proficiency in SQL and working with relational and non relational databases
- Experience with big data technologies such as Apache Spark, Hadoop, or similar
- Hands on experience with ETL/ELT tools and orchestration frameworks (e.g., Airflow)
- Familiarity with cloud platforms such as Azure, AWS, or Google Cloud
- Strong understanding of data modeling and database design principles
- Basic knowledge of AI engineering concepts and ML workflows
- Experience working with Databricks (highly preferred)
- Experience with data warehousing solutions (e.g., Snowflake, BigQuery, Redshift, Azure Synapse)
- Knowledge of streaming technologies (e.g., Kafka, Kinesis)
Full Job Posting
Role Overview
- We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure.
- This role focuses on enabling reliable data access, improving data quality, and supporting analytics, reporting, and AI/ML initiatives.
- The ideal candidate is passionate about working with large datasets and modern data platforms.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL/ELT processes.
- Develop and manage data architectures, including data lakes, warehouses, and data marts.
- Ensure data quality, integrity, and consistency across systems.
- Collaborate with data scientists, AI engineers, analysts, and business stakeholders.
- Optimize data pipelines and workflows for performance and cost efficiency.
- Implement data governance, security, and compliance best practices.
- Monitor data systems, troubleshoot issues, and ensure high availability.
- Integrate data from multiple sources including APIs, databases, and streaming platforms.
- Maintain documentation for data pipelines, systems, and processes.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
- 5+ years of experience in data engineering or a related role.
- Strong programming skills in Python, Java, or Scala.
- Proficiency in SQL and working with relational and non relational databases.
- Experience with big data technologies such as Apache Spark, Hadoop, or similar.
- Hands on experience with ETL/ELT tools and orchestration frameworks (e.g., Airflow).
- Familiarity with cloud platforms such as Azure, AWS, or Google Cloud.
- Strong understanding of data modeling and database design principles.
- Basic knowledge of AI engineering concepts and ML workflows.
Preferred Qualifications
- Highly preferred: Experience working with Databricks.
- Experience with data warehousing solutions (e.g., Snowflake, BigQuery, Redshift, Azure Synapse).
- Knowledge of streaming technologies (e.g., Kafka, Kinesis).
- Experience with containerization and orchestration tools (Docker, Kubernetes).
- Exposure to CI/CD pipelines and DevOps practices.
- Familiarity with supporting ML/AI use cases (feature engineering, data pipelines for models).
Key Skills
- Strong problem solving and analytical thinking
- Attention to detail and data accuracy
- Effective communication and collaboration skills
- Ability to work in a fast paced, data driven environment
- Continuous learning mindset
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
A six-month, full-time project assignment for a hands-on Finance Data Analytics & Automation Consultant in Dubai. You will partner with the Group Finance Director to build an automated, data-led, AI-enabled reporting env
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
A leading organization is seeking a Technical Business Systems Analyst to bridge business and technology. The role involves translating stakeholder requirements into technical deliverables, working with development and Q
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
We are seeking a Senior Frontend Designer to design, build, and maintain modern, responsive web applications. The role combines deep frontend expertise with backend contributions using Node.js and Python. Requires 6+ yea
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Halian is hiring a Conversational AI Engineer for a 1-year extendable contract in Abu Dhabi. The role requires 5+ years of Python experience, expertise in Prompt Engineering and RAG, and experience with Azure OpenAI Serv
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs). The role involves designing planning and control algorithms, mathematical modeling, and integrati
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Document Controller for a sustainable urban development project in Abu Dhabi. The role involves managing document control systems, ensuring compliance with standards, and supporting project teams. Can
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Our client is seeking a Finance Manager to lead the finance function of the UAE entity, ensuring accurate financial reporting, statutory compliance, and effective treasury management. The role requires 8-12 years of expe
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs) in Abu Dhabi. The role involves designing planning and control algorithms, mathematical modeling,
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE