Data Solution Architect
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Lead the architecture of on-prem Data Lakehouse using Cloudera, focusing on Medallion and Lambda architectures, data governance, and security frameworks.
Key Skills for This Role
Responsibilities
- Lead the HLD/LLD for the Lakehouse, size clusters, define storage/compute topologies, and select table formats/engines
- Define data contracts, schema evolution rules, folder/table naming conventions, and DQ checkpoints across Bronze, Silver, and Gold layers
- Design batch pipelines using Informatica BDM (DEI) and Spark/Hive for bulk ingestion and SCD Type 1/2 processing
- Design real time streaming paths using NiFi/Kafka, Hudi, and Kudu/HBase for sub second access
- Architect a JSON/YAML or DB driven rules engine to manage validations, survivorship, and PII handling
- Harden perimeter security via Knox, Kerberos, TLS, and AD/LDAP; implement Ranger RBAC, tag based policies, and row/column masking
- Stand up Apache Atlas for end to end lineage capture and data classifications
- Establish CI/CD pipelines for cluster configs and rules packs; build SLA/SLO dashboards in Cloudera Manager
- Architect a resilient Disaster Recovery plan using BDR/Replication Manager and lead semi annual DR drills
- Act as the technical authority at Architecture Review Boards (ARB); collaborate with Domain SMEs, Security, and Platform Teams
- Mentor and guide engineering teams on SQL optimization and pipeline best practices
Requirements
- 10+ years of dedicated data architecture/engineering experience
- At least 3 5+ years specifically architecting production grade environments on Cloudera (CDH/CDP)
- Proven track record of designing and delivering on prem Lakehouses leveraging Medallion and Lambda architectures
- Deep understanding of Informatica DEI (BDM) suite for framework design, parameterization, and pushdown execution to Spark/Hive
- Practical, deep technical exposure to Apache Iceberg, Apache Hudi, Apache Kudu, HBase + Phoenix, Hive 3, and Impala
- Expert level knowledge of Kerberos, TLS, AD/LDAP, Ranger policies, and Atlas lineage tracking within the Cloudera SDX ecosystem
- Experience designing metadata driven rules engines and DQ frameworks for both streaming and batch data
- Strong Linux fundamentals, Git, and CI/CD automation
Full Job Posting
Role Summary
- As the Data Solution Architect, you will lead the end to end architecture of a production grade, on prem Data Lakehouse utilizing Cloudera CDP 7.3.1.
- You will define the Target State Architecture (TSA) across platform, data, integration, and security layers.
- Your core mission will be establishing a structured Medallion model (Bronze/Silver/Gold) and a robust Lambda Architecture that converges high throughput batch processes with low latency streaming paths.
- Additionally, you will architect a custom, metadata driven Declarative Rules Engine for enterprise wide business validations and design a highly secure, audit ready Data Governance framework utilizing Cloudera Shared Data Experience (SDX).
Core Responsibilities
- Architecture & Platform Topology (CDP 7.3.1): Lead the HLD/LLD for the Lakehouse. Size clusters, define storage/compute topologies (HDFS/Ozone, YARN), and strategically select table formats/engines based on workload fits (Iceberg, Hudi, Kudu, HBase, and Phoenix). Establish performance guardrails aga
- Medallion & Data Modeling: Define data contracts, schema evolution rules, folder/table naming conventions, and DQ checkpoints across Bronze, Silver, and Gold layers. Unify serving models for OLAP (Impala) and low latency lookups (Phoenix).
- Lambda Architecture (Batch + Speed): Design batch pipelines using Informatica BDM (DEI) and Spark/Hive for bulk ingestion and SCD Type 1/2 processing. Concurrently, design real time streaming paths using NiFi/Kafka, Hudi (for incremental upserts), and Kudu/HBase for sub second access.
- Declarative Rules Engine: Architect a JSON/YAML or DB driven rules engine to manage validations, survivorship, and PII handling. Ensure the runtime engine is seamlessly callable via Informatica maplets, Spark, and streaming processors.
- Enterprise Governance & Security: Harden perimeter security via Knox, Kerberos, TLS, and AD/LDAP. Implement Ranger RBAC, tag based policies, and row/column masking. Stand up Apache Atlas for end to end lineage capture and data classifications.
- DevOps, Observability & DR: Establish CI/CD pipelines for cluster configs and rules packs. Build comprehensive SLA/SLO dashboards in Cloudera Manager. Architect a resilient Disaster Recovery plan using BDR/Replication Manager and lead semi annual DR drills.
- Stakeholder Leadership: Act as the technical authority at Architecture Review Boards (ARB). Collaborate with Domain SMEs, Security, and Platform Teams. Mentor and guide engineering teams on SQL optimization and pipeline best practices.
Required Qualifications (Must Haves)
- Experience: 10+ years of dedicated data architecture/engineering experience, with at least 3 5+ years specifically architecting production grade environments on Cloudera (CDH/CDP).
- Lakehouse Delivery: Proven track record of designing and delivering on prem Lakehouses leveraging Medallion and Lambda architectures.
- Informatica Expertise: Deep understanding of Informatica DEI (BDM) suite for framework design, parameterization, and pushdown execution to Spark/Hive.
- Storage & Query Engines: Practical, deep technical exposure to Apache Iceberg, Apache Hudi, Apache Kudu, HBase + Phoenix, Hive 3, and Impala (including partitioning, compaction, and cost based tuning).
- Security & SDX: Expert level knowledge of Kerberos, TLS, AD/LDAP, Ranger policies, and Atlas lineage tracking within the Cloudera SDX ecosystem.
- Rules & Frameworks: Experience designing metadata driven rules engines and DQ frameworks for both streaming and batch data.
- Operations: Strong Linux fundamentals, Git, and CI/CD automation.
Preferred Qualifications
- Advanced Kafka patterns (exactly once processing, schema registry, compaction) and CDC from relational databases.
- Familiarity with Apache Ozone, KMS/Key Trustee, and security compliance in air gapped deployments.
- Site Reliability Engineering (SRE) mindset: managed SLOs, error budgets, and chaos/drill exercises.
- Relevant certifications: Cloudera CDP Certified Architect, Informatica Certifications, or Security certifications (e.g., CISSP/CCSP).
- Experience operating within strictly regulated environments (PII, PCI, SOX).
Salary
- Salary: up to 40,000 SAR pm dependent on experience
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Silver Edge Arabia
Sales Engineer HVAC Project Sales
Riyadh, KSA
Develop new HVAC project opportunities and generate leads. Build relationships with consultants, contractors, and clients. Prepare technical and commercial proposals and negotia...
Sales Executive Dealer Sales (Air Conditioners)
Riyadh, KSA
Develop and expand the dealer and distributor network. Achieve monthly and annual sales targets. Manage dealer relationships and provide sales support. Identify new business opp...
Sales Engineer - Direct Sales
Riyadh, KSA
Responsibilities Generate new business in institutional, government, and real estate sectors. Handle tenders, quotations, technical submissions, and negotiations. Promote HVAC s...
Sales Engineer - Direct Sales
Jeddah, KSA
Responsibilities Generate new business in institutional, government, and real estate sectors. Handle tenders, quotations, technical submissions, and negotiations. Promote HVAC s...
Senior Estimator
Dubai, UAE
Silver Edge Arabia is hiring a Senior Estimator to lead tender accuracy, cost competitiveness, and commercial clarity. The role involves mentoring a team, managing quantity take-offs, cost estimation, and post-tender neg
Project Manager
, UAE
Position: Project Manager Employment Type: Full-time Location: UAE Reports To: Managing Director / Operations Manager The Project Manager takes full commercial, technical, and o...
Senior Accountant
Dubai, UAE
Silver Edge Arabia seeks a Senior Accountant to manage financial accounting, project cost control, vendor payments, client billing, treasury, VAT, payroll oversight, and financial reporting. The role requires strong know
SAP Solution Architect
Riyadh, KSA
Design and optimize SAP solutions for retail planning using SAP Datasphere and SAP IBP, while providing leadership and technical guidance.
Sales Engineer HVAC Project Sales
Riyadh, KSA
Sales Executive Dealer Sales (Air Conditioners)
Riyadh, KSA
Sales Engineer - Direct Sales
Riyadh, KSA
Sales Engineer - Direct Sales
Jeddah, KSA
Senior Estimator
Dubai, UAE
Project Manager
, UAE
Senior Accountant
Dubai, UAE
SAP Solution Architect
Riyadh, KSA