Sr. Databricks Platform Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Hiredge Solutions seeks a hands-on Senior Databricks Platform Engineer for a global strategy-led tech consultancy client. You will lead the design and operationalisation of a governed, multi-tenant data platform on Azure Databricks, implementing Unity Catalog and Delta Sharing at scale.
Key Skills for This Role
Responsibilities
- Design and implement Unity Catalog governance including catalog/schema structure, privilege model, and lineage
- Architect Delta Sharing provider/recipient model for external data onboarding
- Integrate Microsoft Entra ID with Unity Catalog and design service principals and RBAC
- Refactor existing Python pipelines into a Databricks medallion architecture (bronze/silver/gold)
- Contribute to platform engineering including workspace structure, CI/CD, cost optimisation, and capacity planning
Requirements
- 7+ years data platform engineering experience
- 3+ years hands on Azure Databricks experience
- Hands on Unity Catalog implementation in production
- Real Delta Sharing experience with provider/recipient architecture
- Strong Python and PySpark with production pipeline migration experience
- Microsoft Entra ID integration experience
Full Job Posting
The Role
- Lead the design and operationalisation of a governed, multi tenant data platform on Azure Databricks.
- Implement Unity Catalog and Delta Sharing at scale in production.
What You'll Be Doing
- Unity Catalog governance design and implementation.
- Delta Sharing provider/recipient architecture.
- Identity & access integration with Microsoft Entra ID.
- Pipeline modernisation to medallion architecture.
- Platform engineering including CI/CD and cost optimisation.
- Architecture contribution and improvement.
Must Have
- Hands on Unity Catalog implementation in production.
- Real Delta Sharing experience.
- Strong Python and PySpark.
- Microsoft Entra ID integration experience.
- 7+ years data platform engineering, 3+ years Azure Databricks.
Nice to Have
- Databricks Genie evaluation/implementation.
- Azure Data Factory orchestration.
- CI/CD and DataOps (Azure DevOps, Databricks Asset Bundles).
- FinOps / platform cost optimisation.
- Regulated industry or enterprise governance experience.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hiredge Solutions
AI Engineer
Riyadh, KSA
AI Engineer — GenAI / LLM Applications We are engaging senior AI Engineer to build GenAI-powered applications as part of a data and AI delivery engagement for one of our clients - a global leading strategy-led Tech consu
Data Engineer
Riyadh, KSA
Backend / Data Engineer — Pipeline & Data Architecture We are engaging senior Data Engineer to be designing and building the data pipelines and structures that underpin an AI delivery engagement for one of our clients -
AI Engineer
Riyadh, KSA
AI Engineer — GenAI / LLM Applications We are engaging senior AI Engineer to build GenAI-powered applications as part of a data and AI delivery engagement for one of our clients - a global leading strategy-led Tech consu
Cloud Security Engineers (Azure + DevSecOps + Agentic Systems)
Dubai, UAE
Sr. Azure Cloud Security Consultant Enterprise AI Platform Security | MS Entra ID We're engaging a senior Azure Security consultant to implement cloud security architecture across multiple Azure tenants / identity, netwo
Sr. Cloud Security Engineer
Dubai, UAE
Sr. Azure Cloud Security Engineer Enterprise AI Platform Security | MS Entra ID We're engaging a senior Azure Cloud Security Engineer to validate and implement cloud security architecture across multiple Azure tenants /