linkedin
Senior Data Engineer
DigyCorp
Dubai, UAE
Contract
Mid-Senior
Onsite
Discovered 4 days ago
Azure DatabricksApache Spark and PySparkDelta Lake and Medallion architectureUnity CatalogAzure Data FactoryAzure Event Hubs
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
Azure DatabricksApache Spark and PySparkDelta Lake and Medallion architecture
Role Overview
Senior Data Engineer role leading data engineering for a petabyte-scale industrial digital twin.
The work supports a national coral restoration programme using imagery, geospatial data, sensor telemetry, and production AI and MLOps pipelines.
The role is hands-on and delivery-focused, with advisory responsibility for data architecture and governance.
Key Skills for This Role
Azure DatabricksApache Spark and PySparkDelta Lake and Medallion architectureUnity CatalogAzure Data FactoryAzure Event Hubs
Full Job Posting
Role Overview
Senior Data Engineer role leading data engineering for a petabyte-scale industrial digital twin.
The work supports a national coral restoration programme using imagery, geospatial data, sensor telemetry, and production AI and MLOps pipelines.
The role is hands-on and delivery-focused, with advisory responsibility for data architecture and governance.
Databricks and Data Pipelines
- Build and maintain Databricks bronze, silver, and gold pipelines that convert source data into curated, analysis-ready datasets.
- Develop Databricks notebooks and jobs using PySpark and SQL, schedule recurring and incremental loads, and tune performance.
- Register curated datasets in Unity Catalog with correct metadata, ownership, and access tags.
- Apply dimensional modeling, star schemas, and slowly changing dimensions to curated Lakehouse layers.
- Use Databricks Lakebase for workloads requiring transactional or OLTP-style access.
Orchestration and Ingestion
- Build and maintain Azure Data Factory pipelines and triggers that move source-system data into Databricks.
- Consume streaming data from Azure Event Hubs across concurrent sources and configure trigger-based processing.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at DigyCorp
Senior Data Engineer
Thuwal, KSA
SeniorContract
The employer is seeking a senior data engineer to build and govern a petabyte-scale industrial digital twin data platform. The role covers Databricks and Azure pipeline engineering, data architecture, migrations, AI/ML a
Discovered 4 days agoView →
Senior Product Owner
, UAE
SeniorContract
The employer is seeking a Senior Product Owner to own the backlog and roadmap for a large Digital Twin Platform supporting a coral restoration programme. The role combines product leadership, continuous discovery, stakeh
Discovered 6 days agoView →
Senior Delivery Manager
, UAE
ManagerContract
DigyCorp is seeking a Senior Delivery Manager to lead a large technology programme supporting a national coral reef restoration initiative. The role owns roadmap, governance, budget, risk, quality, dependencies, and clie
Discovered 6 days agoView →