{bc}
indeed

Senior Databricks Specialist (Data Architect)

Unknown
Baladiyat ad Dawhah, QAT
Full-time
Onsite
Discovered 3 days ago
Azure DatabricksApache SparkPySparkDelta LakeDatabricks Medallion ArchitectureUnity Catalog
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

Azure DatabricksApache SparkPySpark
Smart Apply

Full Job Posting

Role Responsibilities

  • Design and implement enterprise-scale data solutions using Azure Databricks.
  • Define Databricks architecture and platform standards.
  • Build ingestion, integration, ETL, and ELT pipelines from multiple source systems.
  • Implement Medallion Architecture, Delta Lake solutions, and analytical data models.
  • Integrate Databricks with Dynamics 365, Dataverse, APIs, CRM systems, and other applications.
  • Implement data quality, monitoring, lineage, governance, security, and access controls.
  • Optimize Spark jobs, clusters, SQL, Delta tables, pipelines, and Databricks costs.
  • Support Power BI and other reporting platforms with optimized data models and services.
  • Establish development, testing, production, CI/CD, and DevOps standards.
  • Troubleshoot complex issues, conduct technical reviews, and mentor data engineers.
  • Ensure platform solutions meet security, availability, scalability, and disaster recovery requirements.

Mandatory Technical Requirements

  • At least 8 years of data engineering or data architecture experience.
  • At least 4 years of strong hands-on Azure Databricks experience.
  • Strong hands-on Apache Spark and PySpark experience.
  • Strong Delta Lake, enterprise data platform, and data pipeline experience.
  • Strong knowledge of Databricks Medallion Architecture.
  • Strong Unity Catalog, data governance, access control, and lineage experience.
  • Strong SQL and large-scale data processing skills.
  • Experience with Azure data services, Azure Data Factory, or Azure Data Lake Storage Gen2.
  • Experience with data modeling, dimensional modeling, and enterprise integrations.
  • Experience with CI/CD, Git, Azure DevOps, and deployment automation.
  • Ability to troubleshoot complex production data issues.

Preferred Certifications and Language

  • Databricks Certified Data Engineer Professional is preferred.
  • Databricks Certified Data Engineer Associate is preferred.
  • Microsoft Certified: Azure Data Engineer Associate is preferred.
  • Other relevant Databricks or Azure certifications are preferred.
  • English language ability is listed as preferred.

Work Location

  • Work location is in person.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Unknown