Lead Data Engineer - Azure Databricks/Kafka
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Virtusa Middle East is seeking a Lead Data Engineer to architect and implement scalable data pipelines on Azure using Databricks and Kafka. The role involves leading data model development and overseeing data infrastructure deployment and optimization.
Key Skills for This Role
Responsibilities
- Architect and implement robust, scalable data pipelines on Azure using Databricks, ensuring efficient data ingestion, transformation, and loading
- Design and manage real time data streaming solutions with Kafka, enabling low latency data processing and event driven architectures
- Lead the development of data models and schemas optimized for performance and analytical querying within the Azure ecosystem
- Oversee the deployment, monitoring, and optimization of data infrastructure, ensuring high availability and cost effectiveness
Requirements
- Experience architecting and implementing data pipelines on Azure using Databricks
- Experience with real time data streaming using Kafka
- Experience leading data model development and schema design
- Experience overseeing deployment, monitoring, and optimization of data infrastructure
Full Job Posting
Responsibilities
- Architect and implement robust, scalable data pipelines on Azure using Databricks, ensuring efficient data ingestion, transformation, and loading.
- Design and manage real time data streaming solutions with Kafka, enabling low latency data processing and event driven architectures.
- Lead the development of data models and schemas optimized for performance and analytical querying within the Azure ecosystem.
- Oversee the deployment, monitoring, and optimization of data infrastructure, ensuring high availability and cost effectiveness.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Virtusa Middle East FZ-LLC
Oracle Fusion Cloud HCM
Dubai, UAE
Configure and manage core HR modules including Global HR, Absence Management, and Talent Management to align with business needs. Lead system implementations, upgrades, and ongo...
Senior Fraud Data Scientist
Dubai, UAE
Card Fraud Model Development & Optimization Design, develop, and optimize card fraud detection models for issuing and acquiring portfolios. Implement advanced statistical, machi...
Data Governance
Dubai, UAE
Virtusa Middle East seeks a Data Governance professional to bridge business and IT, translating data governance policies into technical specifications. The role involves data lineage, cataloging, tooling oversight, and d
Treasury Testing
Dubai, UAE
Design and execute comprehensive test plans for treasury systems, ensuring accuracy in cash management, liquidity, and investment operations. Develop automated test scripts for ...
Senior Product Designer
Dubai, UAE
Technical Knowledge & Skills Design Thinking, Creative outputs and experience of industry standard software and prototyping tools Creating wireframes based as per requirements F...
GTB - Technology Delivery Manager
Dubai, UAE
GTB Technology Delivery Ownership Own end to end technology delivery for GTB applications (Payments, Cash Management, Trade Finance, Supply Chain Finance, Collections) as part o...
Business Analyst - LOS
Dubai, UAE
Business Requirements Analysis Engage with retail lending, credit risk, operations, and product teams to gather origination requirements Analyze current-state loan origination p...
Python Engineer
Dubai, UAE
We are seeking a skilled Python Engineer to join our dynamic team. The ideal candidate will be responsible for developing robust web frameworks, building backend code to efficie...