oracle
Databricks Developer
EXL
Gurugram, IND
Mid · 3+ years experience
Hybrid
Discovered 2 weeks ago
databricksdelta-lakegitsparksql
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
databricksdelta-lakegit
Key Skills for This Role
databricksdelta-lakegitsparksql
Full Job Posting
Responsibilities
- Key Responsibilities
- Design, build, and maintain ETL/ELT pipelines on Databricks using PySpark, Spark SQL, and Delta Lake.
- Develop and optimize data ingestion frameworks, data transformations, and end‐to‐end workflows for batch and streaming use cases.
- Implement Delta Lake‐based architectures, including versioning, schema evolution, and ACID‐compliant pipelines.
- Work with stakeholders to understand data requirements and translate them into scalable data engineering solutions.
- Manage and optimize Databricks clusters, jobs, and notebooks for performance and cost efficiency.
- Ensure data quality, reliability, and observability through validation frameworks and monitoring.
- Contribute to data modeling, metadata management, and best practices within the data platform.
- Key Responsibilities - Design, build, and maintain ETL/ELT pipelines on Databricks using PySpark, Spark SQL, and Delta Lake. - Develop and optimize data ingestion frameworks, data transformations, and end‐to‐end workflows for batch and streaming use cases. - Implement Delta Lake‐based architectures, including versioning, schema evolution, and ACID‐compliant pipelines. - Work with stakeholders to understand data requirements and translate them into scalable data engineering solutions. - Manage and optimize Databricks clusters, jobs, and notebooks for performance and cost efficiency. - Ensure data quality, reliability, and observability through validation frameworks and monitoring. - Contribute to data modeling, metadata management, and best practices within the data platform.
Qualifications
- 3+ years of experience in data engineering with 2+ years of hands on expertise in Databricks.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at EXL
Senior MDM Developer – IBM InfoSphere
Cleveland, USA
Senior
Senior MDM Developer – IBM InfoSphere Location: Cleveland, OH Experience: 7+ years A hands-on MDM developer who has actually built and supported IBM InfoSphere MDM implementations — not just heard of the tool. Someone wh
Discovered TodayView →
Senior Executive - Coding Auditor
Chennai, IND
Senior
The DRG Auditor is responsible for performing an in-depth review of select inpatient medical records to ensure that the assigned codes and DRG are supported by clinical documentation and all diagnoses and procedures are
Discovered TodayView →
AWS Neo4j Engineer
, USA
Senior
We are seeking a Subject Matter Expert (SME) in Neo4j and Amazon Web Services (AWS) to lead our critical graph database migration journey. In this role, you will not just design the architecture, you will be the hands-on
Discovered TodayView →
Assistant Manager - Coding Auditor
Chennai, IND
Manager
Assistant Manager – Surgery Coding is responsible for APC & Professional Surgery Audit review. This includes leveraging advanced medical coding analysis, enforcing policy adherence, and driving overpayment recovery progr
Discovered TodayView →
Java Kafka Developer
Pittsburgh, USA
Senior
Java Kafka Developer: Strong hands-on 8+ years of experience as Java Developer with strong Kafka expertise to design, develop, and support high-performance, event driven applications
Discovered TodayView →
AI Architect
Pittsburgh, USA
Senior
We are looking for an AI Architect with deep hands-on expertise in building and modernizing enterprise-grade GenAI/RAG platforms on the Microsoft Azure ecosystem. The role involves architecting agentic AI solutions and e
Discovered TodayView →
MDM Platform Architect
, USA
Senior
We are looking for an experienced MDM Architect to design and lead the architecture of a Security Master and Entity Master platform for a leading global credit ratings organization. You will define the end-to-end MDM arc
Discovered TodayView →
Senior MDM Developer – IBM InfoSphere
Cleveland, USA
Discovered Today
Senior Executive - Coding Auditor
Chennai, IND
Discovered Today
AWS Neo4j Engineer
, USA
Discovered Today
Assistant Manager - Coding Auditor
Chennai, IND
Discovered Today
Java Kafka Developer
Pittsburgh, USA
Discovered Today
AI Architect Lead
Gurugram, IND
Discovered Today
AI Architect
Pittsburgh, USA
Discovered Today
MDM Platform Architect
, USA
Discovered Today