Kafka Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Design and implement Kafka solutions, manage data pipelines, and provide production support while ensuring scalability and reliability of streaming data.
Key Skills for This Role
Responsibilities
- Design, develop, and implement Kafka based solutions to meet business requirements
- Write and maintain high quality code for Kafka producers, consumers, and stream processing applications
- Develop and manage Kafka connectors for seamless integration with external systems
- Utilize Kafka Streams for real time processing of streaming data
- Employ KSQLDB for stream processing tasks, including real time analytics and transformations
- Collaborate with data engineers, software developers, and DevOps teams to integrate Kafka solutions
- Develop and execute UAT plans to validate Kafka solutions
- Monitor and maintain Kafka clusters to ensure high availability and reliability
- Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity
- Provide 24/7 support for production systems, including participation in on call rotation
Requirements
- Experience in designing, developing, and implementing Kafka based solutions
- Proficiency with Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect
- Experience in writing high quality code for Kafka producers, consumers, and stream processing applications
- Knowledge of UAT processes and production support
- Ability to work in 24/7 on call rotation
Full Job Posting
Development
- Design, develop, and implement Kafka based solutions to meet business requirements, utilizing Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
- Write and maintain high quality code for Kafka producers, consumers, and stream processing applications.
- Develop and manage Kafka connectors for seamless integration with external systems, ensuring data consistency and reliability.
- Utilize Kafka Streams for real time processing of streaming data, transforming and enriching data as it flows through the pipeline.
- Employ KSQLDB for stream processing tasks, including real time analytics and transformations.
- Collaborate with data engineers, software developers, and DevOps teams to integrate Kafka solutions with existing systems.
- Ensure all Kafka based solutions are scalable, secure, and optimized for performance.
User Acceptance Testing (UAT)
- Develop and execute UAT plans to validate Kafka solutions, including components such as Kafka Streams, KSQLDB, and Kafka Connect, before deployment to production.
- Work closely with QA teams to identify and resolve defects during the UAT phase.
- Ensure all UAT activities comply with the organization’s standards and best practices.
- Provide detailed reports on UAT outcomes and work with developers to implement necessary fixes.
Production Support
- Monitor and maintain Kafka clusters, including components like Confluent Control Center, to ensure high availability and reliability of data streaming services.
- Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity, including issues specific to Kafka Streams, KSQLDB, and Kafka Connect.
- Perform routine maintenance tasks such as patching, upgrades, and backups for Kafka clusters and associated components.
- Implement monitoring solutions to proactively identify and mitigate potential production issues, leveraging Confluent Control Center for comprehensive cluster visibility.
- Provide 24/7 support for production systems, including participation in on call rotation.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Dicetek LLC
QA Automation Tester-Arabic Speakers
Sharjah, UAE
Design, develop, and maintain automated test scripts for web, mobile, and API applications. Create and execute test plans, test cases, and test scenarios based on business requi...
Senior PLSQL Developer
Abu Dhabi, UAE
Design, develop, and optimize complex PL/SQL code, including stored procedures, functions, triggers, and packages, to enhance database performance and functionality. Lead the ar...
System Analyst-AML
Abu Dhabi, UAE
Design and implement robust Anti-Money Laundering (AML) systems, ensuring compliance with global regulations like BSA/USA PATRIOT Act and FATF. Analyze complex financial transac...
Data Governance Specialist
Abu Dhabi, UAE
Dicetek LLC is looking for a Data Governance Specialist with 8-11 years of experience in data governance, data management, or data quality. The role requires expert-level hands-on experience with Axon, data lineage, and
Data Governance-GDO Strategy
Abu Dhabi, UAE
Dicetek LLC seeks a Data Governance Analyst for GDO Strategy in Abu Dhabi. The role focuses on risk and financial reporting, data lineage, data quality management, and stakeholder engagement within banking. Requires stro
System Analyst
Abu Dhabi, UAE
Dicetek LLC is seeking a System Analyst with AML domain knowledge for a contract role in Abu Dhabi. The role involves requirements gathering, data analysis, SQL, and testing including SIT and UAT. Strong analytical and c
Senior PLSQL Developer
Abu Dhabi, UAE
Dicetek LLC is seeking a Senior PLSQL Developer with strong Oracle Database and PL/SQL expertise for a contract role in Abu Dhabi. The role involves advanced SQL optimization, ETL development, and data migration, with ex
QA Automation Tester-Arabic Speakers
Sharjah, UAE
Dicetek LLC is seeking an experienced Automation Tester with 4-8 years of experience to design, develop, and execute automated test scripts for web, mobile, and API applications. The role requires expertise in Selenium,
QA Automation Tester-Arabic Speakers
Sharjah, UAE
Senior PLSQL Developer
Abu Dhabi, UAE
System Analyst-AML
Abu Dhabi, UAE
Data Governance Specialist
Abu Dhabi, UAE
Data Governance-GDO Strategy
Abu Dhabi, UAE
System Analyst
Abu Dhabi, UAE
Senior PLSQL Developer
Abu Dhabi, UAE
QA Automation Tester-Arabic Speakers
Sharjah, UAE