{bc}
indeed

Data Engineer

Datamatics Global Services Ltd
Dubai, UAE
Full-time
Onsite
Discovered Today
SQLPythonPySpark and SparkAzure Data FactoryMicrosoft FabricDatabricks

Full Job Posting

Location and travel

  • The role is UAE-based and requires travel.

Assignment duration

  • The assignment duration is 6 months.

Role overview

Build and operate reliable data pipelines that move source data into a lakehouse for analytics and AI consumers.

Deliver automated, performant, secure, governed production pipelines on Azure or Microsoft Fabric, capturing metadata and lineage in Microsoft Purview.

Work with data architects, data quality engineers, business analysts, and AI engineers.

Responsibilities

  • Build batch, incremental, CDC, and streaming Bronze-layer ingestion pipelines using Azure Data Factory and Fabric pipelines.
  • Develop Silver- and Gold-layer transformations using SQL, PySpark, and Spark notebooks, including cleansing, conformance, enrichment, and business rules.
  • Implement dimensional models, SCDs, surrogate keys, and data marts to architect designs.
  • Integrate data quality checks, validation, quarantine, and reconciliation; publish pipeline metadata and lineage to Microsoft Purview.
  • Implement scheduling, dependencies, parameterization, error handling, and alerting.
  • Optimize pipeline performance and cost through partitioning, file formats, and compute usage.
  • Apply access controls, masking, encryption, and secure credential management to meet UAE data regulations.
  • Maintain source-controlled code and deploy through CI/CD with automated tests and environment promotion.
  • Support production operations, resolve incidents, maintain runbooks, and coach counterparts for handover.

Must-have qualifications

  • 4+ years of data engineering experience; UAE government or regulated-sector experience is preferred.
  • Advanced SQL, Python, and PySpark/Spark skills.
  • Hands-on experience with Azure Data Factory and Microsoft Fabric, Databricks, or Synapse.
  • Strong knowledge of Lakehouse/Medallion architecture, Delta/Parquet, and dimensional modeling, including SCDs and surrogate keys.
  • Experience with CI/CD (Azure DevOps or GitHub), source control, and DataOps.
  • Familiarity with Microsoft Purview metadata and lineage and data quality tooling.
  • Awareness of UAE PDPL, the Dubai Data Law, and DESC ISR.
  • Excellent English communication and documentation skills.

Preferred qualification

  • Arabic proficiency is advantageous.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Datamatics Global Services Ltd