Pyspark Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Expert in Data Architecture and Strategy, transforming Data Warehousing to Big Data, with skills in Python, SQL, and cloud platforms.
Key Skills for This Role
Responsibilities
- Implement large scale end to end Data Management & Analytics solutions
- Define workload migration strategies using appropriate tools
- Drive delivery in a matrixed environment working with various internal IT partners
- Manage risks and data security
Requirements
- Expertise in Data Architecture, Data Strategy and Roadmap for large and complex organization and systems
- Experience in transforming traditional Data Warehousing approaches to Big Data based approaches
- Expertise with DW Dimensional modeling techniques, Star & Snowflake schemas
- Experiences in cloud native principals, designs and deployments
- Extensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments
- Hands on experience in work with bigdata platforms and related programming languages (e.g. Linux, Python, PySpark, GIT, Jenkins)
- Experience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.)
Full Job Posting
Qualifications
- Expertise in Data Architecture, Data Strategy and Roadmap for large and complex organization and systems and implemented large scale end to end Data Management & Analytics solutions
- Experience in transforming traditional Data Warehousing approaches to Big Data based approaches and proven track record of managing risks and data security
- Expertise with DW Dimensional modeling techniques, Star & Snowflake schemas, modeling slowly changing dimensions and role playing dimensions, dimensional hierarchies, and data classification
- Experiences in cloud native principals, designs and deployments.
- Extensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments
- Expertise in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival
- Define workload migration strategies using appropriate tools
- Drive delivery in a matrixed environment working with various internal IT partners
- Demonstrated ability to work in a fast paced and changing environment with short deadlines, interruptions, and multiple tasks/projects occurring simultaneously
- Must be able to work independently and have skills in planning, strategy, estimation, scheduling
- Strong problem solving, influencing, communication, and presentation skills, self starter
- Experience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.)
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Virtusa Middle East FZ-LLC
Oracle Fusion Cloud HCM
Dubai, UAE
Configure and manage core HR modules including Global HR, Absence Management, and Talent Management to align with business needs. Lead system implementations, upgrades, and ongo...
Senior Fraud Data Scientist
Dubai, UAE
Card Fraud Model Development & Optimization Design, develop, and optimize card fraud detection models for issuing and acquiring portfolios. Implement advanced statistical, machi...
Data Governance
Dubai, UAE
Virtusa Middle East seeks a Data Governance professional to bridge business and IT, translating data governance policies into technical specifications. The role involves data lineage, cataloging, tooling oversight, and d
Treasury Testing
Dubai, UAE
Design and execute comprehensive test plans for treasury systems, ensuring accuracy in cash management, liquidity, and investment operations. Develop automated test scripts for ...
Senior Product Designer
Dubai, UAE
Technical Knowledge & Skills Design Thinking, Creative outputs and experience of industry standard software and prototyping tools Creating wireframes based as per requirements F...
GTB - Technology Delivery Manager
Dubai, UAE
GTB Technology Delivery Ownership Own end to end technology delivery for GTB applications (Payments, Cash Management, Trade Finance, Supply Chain Finance, Collections) as part o...
Business Analyst - LOS
Dubai, UAE
Business Requirements Analysis Engage with retail lending, credit risk, operations, and product teams to gather origination requirements Analyze current-state loan origination p...
Python Engineer
Dubai, UAE
We are seeking a skilled Python Engineer to join our dynamic team. The ideal candidate will be responsible for developing robust web frameworks, building backend code to efficie...