Architect
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Cognizant seeks a Senior Data Engineer / Tech Lead to design and optimize cloud-native data platforms on Azure. You will build scalable ETL/ELT pipelines, implement Medallion architecture with Databricks, and enforce data governance.
Key Skills for This Role
Responsibilities
- Design, build, and maintain complex ETL/ELT pipelines using Azure Data Factory
- Develop high performance batch and real time streaming pipelines using Azure Databricks, PySpark, Spark SQL, or Scala
- Implement Medallion Architecture (Bronze, Silver, Gold) and maintain Lakehouse architectures with Delta Lake
- Design and refine data models including dimensional modeling, star schemas, and SCDs
- Enforce data governance, lineage, and access controls using Unity Catalog
- Implement CI/CD pipelines using Git and Azure DevOps
- Provide technical mentorship to junior developers and QA teams
Requirements
- Minimum 8+ years of professional experience in Data Engineering or Data Warehousing
- 4+ years of hands on experience with Microsoft Azure data platforms
- Proficient in Python/PySpark and SQL
- Extensive knowledge of Azure Data Factory, ADLS Gen2, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics
- Strong understanding of Apache Spark architecture and distributed computing
- Experience with CDC mechanisms, API integrations, and event driven data streaming
- Excellent analytical and documentation skills
Full Job Posting
Role Overview
- Design, develop, and optimize scalable, enterprise grade cloud native data platforms and pipelines on Microsoft Azure.
- Implement modern data architectures such as Lakehouse and Medallion architecture.
- Collaborate with architects, analysts, and downstream data consumers to translate business requirements into data solutions.
Key Responsibilities
- Design, build, and maintain complex ETL/ELT pipelines using Azure Data Factory.
- Implement parameter driven dynamic pipelines, custom activities, and scheduling triggers.
- Configure and manage Integration Runtimes for secure on premise to cloud data movement.
- Develop batch and real time streaming pipelines using Azure Databricks, PySpark, Spark SQL, or Scala.
- Implement Medallion Architecture and maintain Lakehouse architectures with Delta Lake.
- Optimize Spark compute usage through parameter driven jobs and cluster scaling.
- Perform deep performance tuning and memory management of Spark workloads.
- Design and refine data models including dimensional modeling, star schemas, and SCDs.
- Optimize databases with complex T SQL queries, stored procedures, and schemas on Azure SQL or Synapse.
- Enforce data governance, lineage, and access controls using Unity Catalog.
- Secure data architectures with Azure Key Vault, Managed Identities, and VNET integration.
- Implement CI/CD pipelines using Git and Azure DevOps.
Required Skills & Qualifications
- Minimum 8+ years of professional experience in Data Engineering or Data Warehousing.
- 4+ years of hands on experience designing and operating modern data platforms on Microsoft Azure.
- Proficient in Python/PySpark, SQL, and optionally Scala.
- Extensive knowledge of Azure Data Factory, ADLS Gen2, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics.
- Robust understanding of Apache Spark architecture, distributed computing, and Hadoop ecosystem.
- Strong background in CDC mechanisms, API integrations, and event driven data streaming.
- Excellent analytical capabilities, documentation skills, and ability to articulate technical strategies.
Preferred Qualifications
- Microsoft Certified: Azure Data Engineer Associate (DP 203), Azure Solutions Architect Expert, or Databricks Certified.
- Exposure to multi cloud environments (GCP or AWS).
- Experience with Infrastructure as Code tools like Terraform or ARM Templates.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Cognizant
Business Analyst / Product Owner (Airline)
Abu Dhabi, UAE
Cognizant is seeking a Business Analyst / Product Owner for an airline client in Abu Dhabi. The role involves defining and prioritizing user stories, working with agile scrum teams, and ensuring features meet acceptance
Mobile App - Business Analyst (Airline)
Abu Dhabi, UAE
Cognizant is looking for a Mobile App Business Analyst to support the development of an airline mobile app. The role requires 5+ years of product development experience, SAFe Agile knowledge, and experience with Adobe Ex
Cloud & Infrastructure Services - Services Sales Specialist - UAE
Dubai, UAE
Cognizant is hiring a Service Line Specialist for Cloud & Infrastructure Services in Dubai to grow the Middle East business. You will drive sales, manage client relationships, and collaborate with hyperscaler partners. R
Data Architect (Aviation)
Abu Dhabi, UAE
Cognizant seeks an experienced Data Architect to lead data architecture design and integration across Adobe Experience Cloud ecosystem. Requires 7+ years in data architecture, strong SQL, and cloud platform experience.
Data - Business Analyst (Aviation)
Abu Dhabi, UAE
Cognizant seeks an experienced Customer 360 Business Analyst for an aviation client in Abu Dhabi. The role involves eliciting requirements, analyzing customer data flows, and supporting data migration and integration ini
Data - Product Owner (Aviation)
Abu Dhabi, UAE
Cognizant seeks a Data Product Owner for an aviation client in Abu Dhabi. The role involves defining and prioritizing user stories, working with agile scrum teams, and ensuring product delivery aligns with acceptance cri
Organizational Change Manager - Airlines
Abu Dhabi, UAE
Cognizant seeks an Organizational Change Manager to lead change management for a new catering system implementation in the airline's operations division. The role requires creating strategies to maximize employee adoptio
Salesforce BSA
Toronto, CAN
Cognizant seeks a Salesforce BSA to work with business and technical teams to gather requirements, design solutions, and support delivery on Salesforce projects. The role requires 5+ years as a BA/BSA with 4+ years of Sa
Business Analyst / Product Owner (Airline)
Abu Dhabi, UAE
Mobile App - Business Analyst (Airline)
Abu Dhabi, UAE
Cloud & Infrastructure Services - Services Sales Specialist - UAE
Dubai, UAE
Data Architect (Aviation)
Abu Dhabi, UAE
Data - Business Analyst (Aviation)
Abu Dhabi, UAE
Data - Product Owner (Aviation)
Abu Dhabi, UAE
Organizational Change Manager - Airlines
Abu Dhabi, UAE
Salesforce BSA
Toronto, CAN