We are seeking an experienced Databricks Developer / Data Architect to design, implement, and optimize modern data platforms and ETL pipelines using Databricks and cloud-native technologies. The ideal candidate will have strong expertise in data architecture, Lakehouse implementation, Medallion Architecture, and scalable ETL development across Azure and AWS environments. The role involves setting up Databricks workspaces, configuring data integrations and Lakehouse Federation, building enterprise-grade ETL workflows, and enabling high-performance analytics solutions.
We are seeking an experienced Databricks Developer / Data Architect to design, implement, and optimize modern data platforms and ETL pipelines using Databricks and cloud-native technologies. The ideal candidate will have strong expertise in data architecture, Lakehouse implementation, Medallion Architecture, and scalable ETL development across Azure and AWS environments.
The role involves setting up Databricks workspaces, configuring data integrations and Lakehouse Federation, building enterprise-grade ETL workflows, and enabling high-performance analytics solutions.
Key Responsibilities
Data Architecture & Modeling
Design and implement scalable enterprise data architectures using Databricks Lakehouse platform
Configure and manage Databricks workspaces, clusters, access controls, and governance
Implement Medallion Architecture (Bronze, Silver, Gold layers) for data processing and analytics
Set up and manage Lakehouse Federation and data connectors for multi-source integration
Develop logical and physical data models for structured and semi-structured datasets
Ensure data quality, security, scalability, and performance optimization
ETL Development
Develop and maintain scalable ETL/ELT pipelines using PySpark, Spark SQL, and Databricks workflows
Build reusable data ingestion frameworks for batch and streaming workloads
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
Senior MDM Developer – IBM InfoSphere Location: Cleveland, OH Experience: 7+ years A hands-on MDM developer who has actually built and supported IBM InfoSphere MDM implementations — not just heard of the tool. Someone wh
The DRG Auditor is responsible for performing an in-depth review of select inpatient medical records to ensure that the assigned codes and DRG are supported by clinical documentation and all diagnoses and procedures are
We are seeking a Subject Matter Expert (SME) in Neo4j and Amazon Web Services (AWS) to lead our critical graph database migration journey. In this role, you will not just design the architecture, you will be the hands-on
Assistant Manager – Surgery Coding is responsible for APC & Professional Surgery Audit review. This includes leveraging advanced medical coding analysis, enforcing policy adherence, and driving overpayment recovery progr
Java Kafka Developer: Strong hands-on 8+ years of experience as Java Developer with strong Kafka expertise to design, develop, and support high-performance, event driven applications
We are looking for an AI Architect with deep hands-on expertise in building and modernizing enterprise-grade GenAI/RAG platforms on the Microsoft Azure ecosystem. The role involves architecting agentic AI solutions and e
We are looking for an experienced MDM Architect to design and lead the architecture of a Security Master and Entity Master platform for a leading global credit ratings organization. You will define the end-to-end MDM arc
Optimize Spark jobs for performance, cost efficiency, and reliability
Integrate data from relational and NoSQL databases, cloud platforms, and external systems
Automate deployment and monitoring of ETL workflows
Cloud & Platform Engineering
Work with Azure and AWS cloud services to deploy and manage data solutions
Configure integrations with Snowflake, Postgres, MongoDB, DynamoDB, Cloudera, and Domino Server
Support CI/CD, infrastructure automation, and environment management
Collaborate with cross-functional teams including Data Scientists, Analysts, and Business stakeholders
Required Skills & Qualifications
5+ years of experience in Data Engineering / Data Architecture
Strong hands-on experience with Databricks platform
Expertise in:
Python
Apache Spark
PySpark
SQL
Strong understanding of:
Lakehouse Architecture
Medallion Architecture
Data Modeling
ETL/ELT Design Patterns
Experience with cloud platforms:
Microsoft Azure
AWS
Experience integrating with:
PostgreSQL
DynamoDB
MongoDB
Snowflake
Cloudera
Domino Server
Knowledge of performance tuning and optimization in Spark/Databricks
Experience with version control and DevOps practices
Preferred Qualifications
Databricks Certification(s)
Experience with Delta Lake and Unity Catalog
Familiarity with streaming frameworks and real-time data processing
Knowledge of data governance and security best practices
Experience in Agile/Scrum delivery models
Technical Stack
Databricks
Spark / PySpark
Azure
Soft Skills
Strong analytical and problem-solving abilities
Excellent communication and stakeholder management skills
Ability to work independently and collaboratively in fast-paced environments
Strong documentation and solution design capabilities
Nice-to-Have
Experience with Terraform or Infrastructure as Code
Exposure to ML/data science platforms
Experience with orchestration tools such as Airflow or Azure Data Factory
Qualifications
Preferred Qualifications - Databricks Certification(s) - Experience with Delta Lake and Unity Catalog - Familiarity with streaming frameworks and real-time data processing - Knowledge of data governance and security best practices - Experience in Agile/Scrum delivery models Technical Stack - Databricks - Python - Spark / PySpark - SQL - Azure - AWS - Snowflake - PostgreSQL - MongoDB - DynamoDB - Cloudera - Domino Server Soft Skills - Strong analytical and problem-solving abilities - Excellent communication and stakeholder management skills - Ability to work independently and collaboratively in fast-paced environments - Strong documentation and solution design capabilities Nice-to-Have - Experience with Terraform or Infrastructure as Code - Exposure to ML/data science platforms - Experience with orchestration tools such as Airflow or Azure Data Factory
Responsibilities
Job Description: Databricks Developer / Data Architect Position Title Databricks Developer / Data Architect Location Hybrid/ Remote Employment Type Full-Time / Contract Job Summary We are seeking an experienced Databricks Developer / Data Architect to design, implement, and optimize modern data platforms and ETL pipelines using Databricks and cloud-native technologies. The ideal candidate will have strong expertise in data architecture, Lakehouse implementation, Medallion Architecture, and scalable ETL development across Azure and AWS environments. The role involves setting up Databricks workspaces, configuring data integrations and Lakehouse Federation, building enterprise-grade ETL workflows, and enabling high-performance analytics solutions. Key Responsibilities Data Architecture & Modeling - Design and implement scalable enterprise data architectures using Databricks Lakehouse platform - Configure and manage Databricks workspaces, clusters, access controls, and governance - Implement Medallion Architecture (Bronze, Silver, Gold layers) for data processing and analytics - Set up and manage Lakehouse Federation and data connectors for multi-source integration - Develop logical and physical data models for structured and semi-structured datasets - Ensure data quality, security, scalability, and performance optimization ETL Development - Develop and maintain scalable ETL/ELT pipelines using PySpark, Spark SQL, and Databricks workflows - Build reusable data ingestion frameworks for batch and streaming workloads - Optimize Spark jobs for performance, cost efficiency, and reliability - Integrate data from relational and NoSQL databases, cloud platforms, and external systems - Automate deployment and monitoring of ETL workflows Cloud & Platform Engineering - Work with Azure and AWS cloud services to deploy and manage data solutions - Configure integrations with Snowflake, Postgres, MongoDB, DynamoDB, Cloudera, and Domino Server - Support CI/CD, infrastructure automation, and environment management - Collaborate with cross-functional teams including Data Scientists, Analysts, and Business stakeholders Required Skills & Qualifications - 5+ years of experience in Data Engineering / Data Architecture - Strong hands-on experience with Databricks platform - Expertise in: - Python - Apache Spark - PySpark - SQL - Strong understanding of: - Lakehouse Architecture - Medallion Architecture - Data Modeling - ETL/ELT Design Patterns - Experience with cloud platforms: - Microsoft Azure - AWS - Experience integrating with: - PostgreSQL - DynamoDB - MongoDB - Snowflake - Cloudera - Domino Server - Knowledge of performance tuning and optimization in Spark/Databricks - Experience with version control and DevOps practices Preferred Qualifications - Databricks Certification(s) - Experience with Delta Lake and Unity Catalog - Familiarity with streaming frameworks and real-time data processing - Knowledge of data governance and security best pr
About EXL
Professional Services10,001+Founded 1999
EXL is a global data and AI company that provides analytics, digital operations, and industry-specific services to enterprises in insurance, healthcare, banking, retail, media, and energy.