Kafka Architect / Streaming Data Architect
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Tata Consultancy Services is seeking a Kafka Architect / Streaming Data Architect for a full-time role in Jeddah, KSA. The role involves designing enterprise-scale Kafka architecture for a Bank Lakehouse, implementing event-driven patterns, and ensuring high throughput and low latency.
Key Skills for This Role
Responsibilities
- Design enterprise scale Kafka architecture aligned with Bank Lakehouse (Medallion Bronze/Silver/Gold).
- Define event driven architecture patterns for real time ingestion and processing.
- Establish topic strategy, partitioning, replication, retention policies.
- Architect multi cluster Kafka setup (dev/test/prod, DR strategy).
- Lead setup and configuration of Kafka brokers, Zookeeper/Kraft mode, Kafka Connect, Schema Registry, stream processing.
- Design pipelines for event streaming ingestion and near real time batch ingestion.
- Build CDC pipelines using Kafka Connect (Debezium).
- Ensure high throughput and low latency, optimize partition strategy and consumer group scaling.
- Implement failover strategies, data replication, and durability (≥99.9% uptime).
- Enforce RBAC, encryption, data masking/tokenization, and integrate with metadata and lineage tools.
Requirements
- Deep experience in BFSI domain (banking, financial services, insurance).
- Expertise in Cloudera Kafka (mandatory).
- Proficiency in Kafka Connect, Kafka Streams, Schema Registry.
- Experience with Apache Spark/Spark Streaming and Apache Flink (preferred).
- Knowledge of CDC tools (Debezium preferred).
- Understanding of regulatory reporting, data reconciliation, AML, Payments, Trade finance systems.
Full Job Posting
Job Title & Company
- Job Title: Kafka Architect / Streaming Data Architect
- Company: TCS (MEA)
- Location: Jeddah, KSA
- Job type: Full time
Key Responsibilities
- Architecture & Design: Design enterprise scale Kafka architecture aligned with Bank Lakehouse (Medallion Bronze/Silver/Gold). Define event driven architecture patterns for real time ingestion and processing. Establish topic strategy, partitioning, replication, retention policies. Architect multi c
- Platform Implementation: Lead setup and configuration of Kafka brokers, Zookeeper / Kraft mode, Kafka Connect framework, Schema Registry, Stream processing (Kafka Streams / Spark Streaming / Flink). Integrate Kafka with Cloudera Data Platform (CDP), Informatica, Teradata, Denodo.
- Real Time Data Engineering: Design pipelines for event streaming ingestion and near real time batch ingestion. Build CDC pipelines using Kafka Connect (Debezium). Enable ingestion from source systems. Support incremental and historical loads integration.
- Performance & Scalability: Ensure high throughput and low latency. Support for concurrent consumers without degradation. Optimize partition strategy, consumer group scaling, producer configurations (acks, batching, compression).
- Resilience & Reliability: Implement failover strategies, data replication and durability (≥99.9% uptime requirement). Handle hardware failures and data corruption scenarios. Design retry, dead letter queues (DLQ), error handling frameworks.
- Data Governance & Security: Enforce Role Based Access Control (RBAC), encryption (in transit & at rest), data masking/tokenization support. Integrate with metadata and lineage tools, governance frameworks (NDMO/NDI compliance).
- Monitoring & Operations: Implement monitoring using Cloudera Manager, Kafka metrics (JMX, Prometheus, Grafana). Define alerting thresholds, SLA monitoring for ingestion pipelines. Ensure observability for lag monitoring, throughput and error rates.
- Phase 1 Remediation Support: Assess existing Kafka pipelines and components. Identify defective pipelines and missing ingestion flows. Redesign/rebuild where required. Ensure alignment with target architecture and data models (FSLDM/FSAS).
- Reporting Enablement Support: Ensure real time data availability for downstream reporting. Support query performance optimization and data consistency across Bronze/Silver/Gold. Resolve issues impacting reporting (data mismatches, delays).
- Documentation & Governance: Deliver high level architecture design, low level design (LLD) for Kafka pipelines, topic catalog and schema definitions. Maintain data lineage documentation and source to target mappings. Participate in architecture governance boards and change management processes.
Key Technical Skills
- Core Technologies: Cloudera Kafka (mandatory), Kafka Connect, Kafka Streams, Schema Registry (Avro/Protobuf/JSON).
- Ecosystem Tools: Cloudera (CDP), Apache Spark / Spark Streaming, Apache Flink (preferred), Informatica (integration awareness), Teradata, Denodo.
- Data & Integration: CDC tools (Debezium preferred), REST APIs, Microservices integration, ETL/ELT Design patterns.
- DevOps & Infra: Kubernetes / Docker (optional but preferred), CI/CD for pipeline deployment, Linux environments.
- Banking Domain Experience (Mandatory): Experience in BFSI domain, understanding of regulatory reporting, data reconciliation (≥99% accuracy), AML, Payments, Trade finance systems.
- Soft Skills: Strong stakeholder management (business + IT), ability to work in multi vendor environment, experience in large scale transformation programs, strong problem solving and RCA skills.
Additional Information
- Application Deadline: 30 July 2026
- Privacy Note: https://www.tcs.com/connect with tcs/privacy policy
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Tata Consultancy Services
Senior Infrastructure Analyst
Calgary, CAN
Tata Consultancy Services is seeking a Senior Infrastructure Analyst to drive vulnerability remediation, improve patch compliance, and optimize monitoring and observability platforms. The role requires expertise in SCCM,
Enterprise / Data Architect
Jeddah, KSA
Tata Consultancy Services is seeking an Enterprise/Data Architect for a role in Jeddah, KSA. The position involves owning end-to-end Data Lakehouse architecture, ensuring alignment with Medallion Architecture, and govern
AWS Technical Project Manager
Toronto, CAN
Tata Consultancy Services is seeking an AWS Technical Project Manager to work directly with the engineering team supporting Data Products, Data Fabric, Data Portal, metadata, and AI enablement. The role requires strong J
Data Analyst – Risk & Business Analytics
Montreal, CAN
TCS is looking for a Data Analyst to perform fast, accurate, and independent data analysis supporting business and risk management decisions. You will work with large datasets, develop dashboards, and deliver actionable
Tax compliance
Jeddah, KSA
Tata Consultancy Services (TCS) in Jeddah is hiring a Tax Compliance professional to ensure compliance with tax laws, prepare returns, manage VAT and corporate tax obligations, and liaise with tax authorities. The role r
Business Analyst
Mississauga, CAN
Tata Consultancy Services seeks a Payments Business Analyst with deep domain expertise in payments processing, clearing & settlement, and digital payments. The role requires strong experience in payments and knowledge of
Teradata Developer - Application Support
Jeddah, KSA
Tata Consultancy Services is seeking a skilled Teradata Developer & Data Lakehouse Application Support Engineer for a full-time role in Jeddah, Saudi Arabia. The role involves developing and optimizing Teradata SQL scrip
Denodo Developer - Application Support
Jeddah, KSA
Tata Consultancy Services is seeking a Denodo Developer for application support in Jeddah. The role involves Denodo development, data virtualization, L1/L2 support, incident management, and integration with data lakehous
Senior Infrastructure Analyst
Calgary, CAN
Enterprise / Data Architect
Jeddah, KSA
AWS Technical Project Manager
Toronto, CAN
Data Analyst – Risk & Business Analytics
Montreal, CAN
Tax compliance
Jeddah, KSA
Business Analyst
Mississauga, CAN
Teradata Developer - Application Support
Jeddah, KSA
Denodo Developer - Application Support
Jeddah, KSA