Senior Data Engineer (Pyspark)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
The role involves building scalable data pipelines, transforming datasets using Big-data technologies, and requires proficiency in Python, Spark, and machine learning.
Key Skills for This Role
Full Job Posting
Overview
- Role & responsibilities:
- The Data Engineer role involves acquiring requirements, conducting EDA, ingesting required datasets, and transforming data using Big-data technologies & Feature Engineering techniques for machine learning models.
- Key tasks include building high-performance, secure, and scalable data pipelines, collaborating with Analytics Delivery Leads, Data scientists and other teams in an Agile environment, and communicating stakeholders effectively.
- The position requires a degree in a relevant field.
- At least 8-10 years of experience in data engineering and ML pipelines, and proficiency in technologies like Python, Spark (including expertise in optimization techniques), Hadoop, SQL, and Git.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Valuelabs
Python Data Engineer
Dubai, UAE
Valuelabs seeks a skilled Python Engineer to develop robust web frameworks, build backend code to serve datasets, and perform data transformations. The role requires deep understanding of Python, web frameworks like Flas
Oracle Fusion Cloud HCM Consultant
Dubai, UAE
Seeking a Techno-Functional Consultant with implementation experience in Core HR modules, proficient in Java and SQL, ideally with AI agentic studio knowledge.
Advent Dotnet Developer
Dubai, UAE
We are seeking a dynamic, forward-thinking Software Engineer. You will optimize our Advent APX platform and drive operational efficiency. You will bridge traditional financial t...
Oracle HCM Techno-Functional Consultant
Dubai, UAE
Key responsibilities to source relevant profiles: (Please check the attached JD for detailed Description. Techno-Functional Consultant (70% technical + 8+ years of experience). ...
Senior Finacle Testing Engineer
Dubai, UAE
Role & responsibilities : Experience: 7+ years Primary Skill: Finacle Automation Engineer + Selenium/Playwright automation experience. Location - Dubai (WFO) Experience: 7-10 Ye...
Product Owner
Dubai, UAE
Seeking a Product Owner with Agile experience, strong analytical skills, and knowledge in retail banking or fintech, focusing on user-centric design.
Senior Product Engineer
Dubai, UAE
Responsible for supporting Cards Platform projects, requirement analysis, system integration, testing, and maintaining platform stability in payment solutions.
Fullstack Developer
Dubai, UAE
Develop and maintain high-performance end-to-end testing suites using Playwright, focusing on full stack feature development and AI-driven testing.
Python Data Engineer
Dubai, UAE
Oracle Fusion Cloud HCM Consultant
Dubai, UAE
Advent Dotnet Developer
Dubai, UAE
Oracle HCM Techno-Functional Consultant
Dubai, UAE
Senior Finacle Testing Engineer
Dubai, UAE
Product Owner
Dubai, UAE
Senior Product Engineer
Dubai, UAE
Fullstack Developer
Dubai, UAE