taleo
Kafka Data Engineer
Virtusa
IND
Full-time
Senior · 5+ years experience
Onsite
Discovered 3 weeks ago
ClouderaAzure DatabricksDatabricksConfluentApache KafkaSpark
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
ClouderaAzure DatabricksDatabricks
Role Overview
Kafka Data Engineer Data Engineer to build and manage data pipelines that support batch and streaming data solutions.
The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines etc.
Key Skills for This Role
ClouderaAzure DatabricksDatabricksConfluentApache KafkaSpark
Full Job Posting
Job Description
Kafka Data Engineer Data Engineer to build and manage data pipelines that support batch and streaming data solutions.
The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines etc.
Responsibilities
Strong experience in develop, test, and maintain data pipelines (batch & stream) using Cloudera, Spark, Kafka and Azure services like ADF, Cosmos DB, Databricks, NoSQL DB/ Mongo DB etc.
Strong programming skills in spark, python or scala & SQL.
Optimize data pipelines to improve speed, performance, and reliability, ensuring that data is available for data consumers as required.
Create ETL pipelines for downstream consumers by transform data as per business logic.
Work closely with Data Architects and Data Analysts to align data solutions with business needs and ensure the accuracy and accessibility of data.
Implement data validation checks and error handling processes to maintain high data quality and consistency across data pipelines.
Strong analytical and problem solving skills, with a focus on optimizing data flows and addressing impacts in the data pipeline.
Qualifications
8+ years of IT experience with at least 5+ years in data engineering and cloud-based data platforms.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Virtusa
Business Analyst
Toronto, CAN
SeniorFull-time
Virtusa is seeking a senior Business Analyst specializing in Wealth Management to translate client, regulatory, and operational needs into system enhancements and process improvements. The role requires strong requiremen
Discovered 1 weeks agoView →
Java fullstack
Dubai, UAE
SeniorFull-time
Virtusa is seeking a Java full-stack architect to design and govern scalable banking application solutions across cloud and on-premises environments. The role requires strong solution design, architecture documentation,
Discovered 1 weeks agoView →
Architect
Dubai, UAE
SeniorFull-time
The employer is seeking a senior project delivery professional to manage complex cross-functional initiatives from business case through implementation and closure. The role requires 7–10 years of project experience, str
Discovered 1 weeks agoView →
Lead Software Engineer
Dubai, UAE
LeadFull-time
Virtusa is seeking a Lead Software Engineer focused on Finacle testing for core banking technology. The role covers functional and automation testing across banking modules, using Selenium with Java or Playwright with No
Discovered 1 weeks agoView →
Lead Software Engineer
Dubai, UAE
LeadFull-time
Virtusa is seeking a Lead Software Engineer to deliver production-grade BPM solutions using Flowable, Java, and Spring Boot. The role requires deep Flowable or comparable BPM experience, end-to-end process-engine ownersh
Discovered 1 weeks agoView →
Associate Consulting Manager
Mississauga, CAN
ManagerFull-time
Virtusa recherche un profil d’analyste d’affaires ou d’analyste de données pour la région LATAM. Le poste requiert l’analyse de données, la rédaction de requêtes SQL et l’utilisation d’Agile et de Jira. La maîtrise de l’
Discovered 1 weeks agoView →
Senior Solution Architect
Dubai, UAE
SeniorFull-time
Virtusa is seeking a Senior Solution Architect to define, implement, and govern resilient customer-centric solutions across software, integration, cloud, and data architectures. Candidates should have more than 10 years
Discovered 1 weeks agoView →
Lead Software Engineer
Dubai, UAE
LeadFull-time
Seeking a senior retail customer value management leader to own lifecycle strategy across acquisition, cross-sell, retention, and win-back. The role requires 8–10+ years in CVM, growth strategy, retail banking, or lifecy
Discovered 1 weeks agoView →
Business Analyst
Toronto, CAN
Discovered 1 weeks agoFull-time
Java fullstack
Dubai, UAE
Discovered 1 weeks agoFull-time
Architect
Dubai, UAE
Discovered 1 weeks agoFull-time
Lead Software Engineer
Dubai, UAE
Discovered 1 weeks agoFull-time
Lead Software Engineer
Dubai, UAE
Discovered 1 weeks agoFull-time
Associate Consulting Manager
Mississauga, CAN
Discovered 1 weeks agoFull-time
Senior Solution Architect
Dubai, UAE
Discovered 1 weeks agoFull-time
Lead Software Engineer
Dubai, UAE
Discovered 1 weeks agoFull-time