Senior Data Engineer – PySpark, Python
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Location: Dubai Experience: 8+ Years Work Mode: Hybrid (3 Days Onsite) ### Role Overview: We are seeking a highly experienced Senior Data Engineer with expertise in PySpark, Python, Hadoop, and large-scale data engineering pipelines.
Key Skills for This Role
Full Job Posting
Role Overview
We are seeking a highly experienced **Senior Data Engineer** with expertise in **PySpark, Python, Hadoop, and large-scale data engineering pipelines**.
The role involves building secure and scalable data platforms, enabling advanced analytics, and supporting machine learning workflows.
Key Responsibilities
- Acquire business requirements and perform exploratory data analysis (EDA).
- Build scalable and high-performance data pipelines using **Python, Spark, and Hadoop**.
- Perform feature engineering and support machine learning data workflows.
- Collaborate with Data Scientists, Analytics teams, and stakeholders in Agile environments.
- Optimize distributed data processing and ensure data quality and governance.
Required Skills
- Strong expertise in **Python, PySpark, Spark optimization, Hadoop, and SQL**
- Experience in enterprise data engineering and ML pipelines
- Familiarity with Git, Agile methodologies, and cloud-native data environments
- Strong analytical and communication skills
- **Apply Now:** **[email protected]**
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at D4 Insight
Senior Performance Tester
Dubai, UAE
D4 Insight is seeking a Senior Performance Tester to design, execute, and optimize enterprise application performance testing strategies in Dubai. The role focuses on ensuring scalability, reliability, and performance ac
Senior Solution Architect (Wealth Platforms)
Abu Dhabi, UAE
D4 Insight seeks a Senior Solution Architect to define enterprise architecture for wealth management and private banking platforms in Abu Dhabi. The role focuses on designing secure, scalable, API-driven banking ecosyste
Senior Oracle FLEXCUBE Techno-Functional Consultant
Abu Dhabi, UAE
D4 Insight seeks an experienced Senior Oracle FLEXCUBE Techno-Functional Consultant to lead large-scale Oracle FLEXCUBE implementation and transformation initiatives in Abu Dhabi. The role combines deep functional bankin
Junior Oracle FLEXCUBE Techno-Functional Consultant (Banking Solutions)
Abu Dhabi, UAE
D4 Insight seeks a Junior Oracle FLEXCUBE Techno-Functional Consultant for banking transformation projects in Abu Dhabi. You will configure FLEXCUBE modules, support PL/SQL development and API integrations, and assist wi
Technical Product Owner / Implementation Tech Lead
Abu Dhabi, UAE
D4 Insight seeks a Technical Product Owner / Implementation Tech Lead to lead enterprise Wealth Management platform implementation and stabilization in Abu Dhabi. The role combines product ownership, implementation leade
Solution Architect (Cloud Platform)
Abu Dhabi, UAE
Seeking a Cloud Solution Architect to design and govern cloud-native banking platforms on AWS or Azure. The role involves defining cloud architecture, Kubernetes platforms, Infrastructure as Code, observability, resilien
Software Engineer – Backend Development
Abu Dhabi, UAE
Looking for a Software Engineer – Backend Development with expertise in Java, Spring Boot, and cloud-native technologies to build secure, scalable backend services for enterprise banking applications. The role focuses on
QA Automation Engineer (Web & API Automation)
Dubai, UAE
D4 Insight is seeking a QA Automation Engineer with 5+ years of experience to design automation frameworks for digital banking applications in Dubai. You will work on Web and API automation, AI-assisted testing, performa
Senior Performance Tester
Dubai, UAE
Senior Solution Architect (Wealth Platforms)
Abu Dhabi, UAE
Senior Oracle FLEXCUBE Techno-Functional Consultant
Abu Dhabi, UAE
Junior Oracle FLEXCUBE Techno-Functional Consultant (Banking Solutions)
Abu Dhabi, UAE
Technical Product Owner / Implementation Tech Lead
Abu Dhabi, UAE
Solution Architect (Cloud Platform)
Abu Dhabi, UAE
Software Engineer – Backend Development
Abu Dhabi, UAE
QA Automation Engineer (Web & API Automation)
Dubai, UAE