Senior Data Architect

Spectrum Solution W.L.L.

Baladiyat ad Dawhah, QAT

Full-time

Mid-Senior

Onsite

Discovered 1 weeks ago

Azure DatabricksApache Spark and PySparkDelta LakeEnterprise data architectureETL/ELT data pipelinesMedallion Architecture

Free

Job Fit Check

Base Career helps you apply smarter for this job.

Ready to Scan

Key skills for this role

Azure DatabricksApache Spark and PySparkDelta Lake

Design, implement, optimize, and govern enterprise-scale data platforms using Microsoft Azure Databricks.

Integrate the Databricks platform with Dynamics 365 CRM, Dataverse, and other enterprise systems.

Define Databricks data architecture and platform standards.
Design ingestion and integration pipelines from multiple source systems.
Develop scalable ETL/ELT pipelines using Databricks, Apache Spark, and PySpark.
Implement Medallion Architecture and work with Delta Lake.
Design data models and transformations for analytical and operational reporting.

Integrate Databricks with Dynamics 365, Dataverse, APIs, CRM systems, and other enterprise applications.
Develop and optimize batch and near-real-time data processing pipelines.
Support Power BI and other reporting platforms through optimized data models and data services.

Implement data quality, validation, monitoring, lineage, and governance processes.
Use Unity Catalog for cataloging, governance, access control, and lineage.

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Trusted by over 500,000 job seekers on Base Career