Kafka Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Salt is hiring a Kafka Engineer for a 12-month contract in Dubai. The role involves designing and implementing Kafka-based solutions using Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
Key Skills for This Role
Responsibilities
- Design, develop, and implement Kafka based solutions to meet business requirements, utilizing Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect
- Write and maintain high quality code for Kafka producers, consumers, and stream processing applications
- Develop and manage Kafka connectors for seamless integration with external systems
- Utilize Kafka Streams for real time processing of streaming data
- Employ KSQLDB for stream processing tasks, including real time analytics and transformations
- Develop and execute UAT plans to validate Kafka solutions
- Monitor and maintain Kafka clusters to ensure high availability and reliability
- Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity
- Provide 24/7 support for production systems, including participation in on call rotation
Requirements
- 3+ years of hands on experience with Apache Kafka and Confluent Kafka in a production environment
- Proven experience in Kafka development, including producer and consumer API, stream processing, and connector development
- Experience with Kafka cluster management, including setup, configuration, monitoring, and troubleshooting
- Proficiency in programming languages such as Java, Python, or Scala
- Strong knowledge of Kafka internals, including brokers, zookeepers, topics, partitions, and offsets
- Experience with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks (e.g., Log4j, ELK Stack)
- Familiarity with CI/CD pipelines and automation tools (e.g., Jenkins, GitLab CI)
- Experience with cloud platforms (e.g., AWS, Azure) and containerization (Kubernetes) is a plus
Full Job Posting
Job Summary
- The client is seeking a highly skilled Confluent Kafka Engineer to join the team. The ideal candidate will be responsible for the development, User Acceptance Testing (UAT), and production support of our Confluent Kafka based systems.
Key Responsibilities
- Design, develop, and implement Kafka based solutions to meet business requirements, utilizing Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
- Write and maintain high quality code for Kafka producers, consumers, and stream processing applications.
- Develop and manage Kafka connectors for seamless integration with external systems, ensuring data consistency and reliability.
- Utilize Kafka Streams for real time processing of streaming data, transforming and enriching data as it flows through the pipeline.
- Employ KSQLDB for stream processing tasks, including real time analytics and transformations.
- Collaborate with data engineers, software developers, and DevOps teams to integrate Kafka solutions with existing systems.
- Ensure all Kafka based solutions are scalable, secure, and optimized for performance.
- Develop and execute UAT plans to validate Kafka solutions, including components such as Kafka Streams, KSQLDB, and Kafka Connect, before deployment to production.
- Work closely with QA teams to identify and resolve defects during the UAT phase.
- Ensure all UAT activities comply with the organization’s standards and best practices.
- Provide detailed reports on UAT outcomes and work with developers to implement necessary fixes.
- Monitor and maintain Kafka clusters, including components like Confluent Control Center, to ensure high availability and reliability of data streaming services.
Experience
- 3+ years of hands on experience with Apache Kafka and Confluent Kafka in a production environment, including experience with Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
- Proven experience in Kafka development, including producer and consumer API, stream processing, and connector development.
- Experience with Kafka cluster management, including setup, configuration, monitoring, and troubleshooting.
- Familiarity with distributed systems, microservices architecture, and event driven design patterns.
- Experience with cloud platforms (e.g., AWS, Azure) and containerization (Kubernetes) is a plus.
Technical Skills
- Proficiency in programming languages such as Java, Python, or Scala.
- Strong knowledge of Kafka internals, including brokers, zookeepers, topics, partitions, and offsets.
- Experience with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks (e.g., Log4j, ELK Stack).
- Proficiency in using Confluent Control Center for monitoring, managing, and optimizing Kafka clusters.
- Expertise in Kafka Streams for building scalable, fault tolerant stream processing applications.
- Experience with KSQLDB for real time processing and analytics on Kafka topics.
- Strong understanding of Kafka Connect for integrating Kafka with external data sources and sinks.
- Understanding of networking, security, and compliance aspects related to Kafka.
- Familiarity with CI/CD pipelines and automation tools (e.g., Jenkins, GitLab CI).
Soft Skills
- Strong analytical and problem solving abilities.
- Excellent communication and teamwork skills.
- Ability to work independently and manage multiple tasks effectively.
- A proactive approach to learning new technologies and improving existing processes.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Salt
Design System Designer (Banking)
Dubai, UAE
Salt is hiring a Design Systems Designer for a 2-month contract (extendable) in Dubai with occasional travel to Abu Dhabi. The role involves supporting the growth of an enterprise Design System, creating reusable compone
Finance Consultant - Tax
Jeddah, KSA
A leading multinational business seeks an immediate Finance Consultant specializing in VAT in the Kingdom. The role requires extensive banking domain experience, strong understanding of VAT and withholding tax rules, and
Delegates Sales Executive
Dubai, UAE
Salt is hiring a Delegate Sales Executive to drive paid delegate attendance and revenue for conferences and exhibitions. The role involves outbound sales, building relationships with senior professionals, and converting
Strategy Consultant
Dubai, UAE
Join a government strategy programme in Dubai to assess free zones, define priority growth sectors, and develop strategic recommendations for economic competitiveness. Requires 5+ years of strategy consulting experience
Videographer / Content Creator
Dubai, UAE
A creative agency in Dubai is seeking a talented Video Content Creator to produce engaging digital content. The role involves concept development, filming, editing, and delivering video across multiple platforms. Ideal c
Marketing AI & Analytics Lead
Dubai, UAE
A Dubai-based PropTech company is seeking a Marketing AI & Analytics Lead to lead marketing analytics, attribution, reporting, and AI-driven transformation. The role involves building a single source of truth for marketi
Brand Portfolio Manager
Dubai, UAE
Salt is seeking a commercially driven Brand Portfolio Manager to grow and strengthen a brand portfolio in Dubai. The role involves using market insights and performance data to identify new opportunities, onboard brand p
Director of Enterprise Risk Management
Dubai, UAE
Salt is hiring a Director of Enterprise Risk Management for a fast-growing, technology-driven financial services organisation in Dubai. You will own the ERM function end-to-end, redesign frameworks, assess risk, and driv
Design System Designer (Banking)
Dubai, UAE
Finance Consultant - Tax
Jeddah, KSA
Delegates Sales Executive
Dubai, UAE
Strategy Consultant
Dubai, UAE
Videographer / Content Creator
Dubai, UAE
Marketing AI & Analytics Lead
Dubai, UAE
Brand Portfolio Manager
Dubai, UAE
Director of Enterprise Risk Management
Dubai, UAE