Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Synopsis This individual will work with cross‑functional product teams to design, implement, and support modern data platforms leveraging Databricks and related technologies.
Key Skills for This Role
Full Job Posting
Synopsis
This individual will work with cross‑functional product teams to design, implement, and support modern data platforms leveraging Databricks and related technologies.
The role requires expertise in Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Lakeflow, combined with strong skills in PySpark, Structured Streaming, Autoloader, and DQX.
A solid background in CI/CD, Terraform, DevOps, and DataOps practices is essential.
The engineer will drive platform reliability, scalability, and automation across cloud environments, ensuring robust analytics and data science capabilities.
Accountabilities
- Treat the data platform as a core product, ensuring scalability, reliability, and innovation.
- Collaborate with Architecture on the development and prioritization of the Databricks‑based platform roadmap.
- Integrate new services such as Delta Lake, Unity Catalog, and DLT into the platform ecosystem.
- Prepare and maintain documentation for Databricks workflows, CI/CD pipelines, and infrastructure automation.
- Partner with stakeholders to resolve platform‑related technical issues and identify areas for improvement.
- Implement internal process improvements: automate ingestion with Autoloader, optimize streaming with Structured Streaming, and enforce data quality with DQX.
- Adopt Agile and DevOps practices, ensuring CI/CD pipelines and Terraform‑based infrastructure are production‑ready.
- Provide operational support for Databricks clusters, jobs, and pipelines.
- Perform fallout & impact analysis, ensure recovery of impacted transactions, and provide business impact reports for production incidents.
- Propose new ideas and technologies to foster continuous improvement and enhance user experience.
- Define, share, and drive adoption of best practices for DataOps and cloud‑native data engineering.
Education & Experience
- 6+ years of experience as a Data/Platform Engineer, with proven expertise in Databricks and modern data lakehouse architectures.
- Graduate degree in Computer Science, Information Systems, or a related quantitative field.
- Hands‑on knowledge of PySpark, Structured Streaming, Autoloader, DQX, and Databricks workflows.
- Strong experience with CI/CD pipelines, Terraform, DevOps, and DataOps practices.
- Ability to troubleshoot and solve complex problems across distributed data systems.
- Experience working with Linux, shell scripting, public cloud platforms, and big data technologies.
- Strong communication skills and experience collaborating with cross‑functional teams in Agile environments.
- Ability to work independently with minimal supervision and eagerness to learn new technologies.
Additional Information
Etihad Airways is more than the UAE’s national airline - we’re shaping the future of global aviation.
From our hub in Abu Dhabi, we connect people across continents and cultures, while driving our “Journey 2030” ambition to double our fleet, expand our network and grow our people for a new era of excellence.
Join us and become part of a vision where the world is your workplace and extraordinary experiences take flight.
To learn more visit www.etihad.com
Recruitment Fraud Alert
Beware of fraudulent job offers from individuals or organizations claiming to represent the Etihad group.
We will never ask for personal information, bank details, or payment during the recruitment process.
Interviews are conducted face-to-face or via video/telephone before any formal offer.
If you are asked for money, please treat it as fraudulent.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Etihad
Premium Guest Recovery Supervisor
Abu Dhabi, UAE
Etihad Airways seeks a Premium Guest Recovery Supervisor to lead a team providing bespoke recovery solutions for premium guests. The role requires 5+ years in high-touch customer service and supervisory experience in avi
Command Center Administrator
Abu Dhabi, UAE
Etihad Airways seeks a Performance & Reporting Analyst to monitor, analyze, and report on outsourced contact center performance. The role provides actionable insights through data analysis, dashboard management, and repo
Service Recovery Supervisor
Abu Dhabi, UAE
Etihad Airways seeks a Service Recovery Supervisor to lead the 24/7 Service Recovery Desk, handling customer escalations and managing service recovery cases. Requires 5+ years in airline customer service and 2+ years sup
Certifying Aircraft Technician (IFE)
Abu Dhabi, UAE
Etihad Airways seeks a Certifying Aircraft Technician specializing in In-Flight Entertainment (IFE) to perform and certify aircraft maintenance tasks in Abu Dhabi. Requires a valid Aircraft Maintenance License and hands-
Guest Transport Planner
Abu Dhabi, UAE
Etihad Airways is looking for a Guest Transport Planner to plan, control, and optimize guest transportation operations in Abu Dhabi. The role involves demand forecasting, real-time operations control, vendor management,
Guest Service Delivery Officer
Abu Dhabi, UAE
Etihad Airways seeks a Guest Service Delivery Officer to support the Hospitality Excellence program, conduct audits, manage NPS data, and coordinate cross-functional working groups. The role requires a diploma, 3+ years
Guest Transportation Manager
Abu Dhabi, UAE
Etihad Airways seeks a Guest Transportation Manager to lead chauffeur and shuttle operations across UAE and globally, ensuring a premium guest experience. The role requires 7-10 years of transportation or aviation ground
Guest Transport Administrator
Abu Dhabi, UAE
Etihad Airways is seeking a Guest Transport Administrator to support Guest Transportation operations by managing vendor administration, invoice processing, and operational documentation. The role ensures accurate financi
Premium Guest Recovery Supervisor
Abu Dhabi, UAE
Command Center Administrator
Abu Dhabi, UAE
Service Recovery Supervisor
Abu Dhabi, UAE
Certifying Aircraft Technician (IFE)
Abu Dhabi, UAE
Guest Transport Planner
Abu Dhabi, UAE
Guest Service Delivery Officer
Abu Dhabi, UAE
Guest Transportation Manager
Abu Dhabi, UAE
Guest Transport Administrator
Abu Dhabi, UAE