oracle
Senior Databricks Data Engineer
EXL Talent Acquisition Team
Noida, IND
Full-time
Senior · 6+ years experience
Hybrid
Discovered 3 weeks ago
DatabricksDelta LakePySparkSQLUnity CatalogDatabricks Workflows
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
DatabricksDelta LakePySpark
Key Skills for This Role
DatabricksDelta LakePySparkSQLUnity CatalogDatabricks Workflows
Full Job Posting
Responsibilities
- Design and lead Databricks Lakehouse architecture for large-scale healthcare data platforms.
- Define scalable data architectures for batch and real-time healthcare data processing.
- Design data ingestion, transformation, storage, and consumption patterns using Databricks.
- Develop architecture using Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables/Lakeflow .
- Integrate data from multiple healthcare sources, including clinical, claims, eligibility, provider, and patient systems.
- Design robust ETL/ELT pipelines using PySpark, SQL, and Databricks.
- Establish data quality, validation, reconciliation, lineage, and governance frameworks.
- Design secure healthcare data solutions while considering HIPAA and PHI/PII protection requirements.
- Work with cloud platforms such as Azure, AWS, or GCP to build scalable data solutions.
- Collaborate with data engineers, data scientists, analysts, product owners, and business stakeholders.
- Define technical standards, architectural patterns, and best practices for Databricks development.
- Lead performance optimization and cost-management initiatives across the Databricks platform.
- Provide technical leadership and mentoring to data engineering teams.
- Participate in Agile ceremonies and contribute to technical planning and roadmap discussions.
Qualifications
- Strong hands-on experience with Databricks .
- Expertise in Lakehouse architecture and Delta Lake.
- Strong PySpark and SQL skills.
- Experience with Unity Catalog and data governance.
- Experience designing enterprise-scale data platforms.
- Strong knowledge of ETL/ELT and data modeling.
- Experience with cloud platforms such as Azure, AWS, or GCP .
- Experience with data integration and orchestration tools.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at EXL Talent Acquisition Team
Senior Associate
Gurugram, IND
Discovered TodayFull-time
Senior Executive
Noida, IND
Discovered TodayFull-time
Lead Assistant Manager
Noida, IND
Discovered TodayFull-time
Senior Executive - Coding Auditor
Chennai, IND
Discovered TodayFull-time
Senior Executive
Noida, IND
Discovered TodayFull-time
Consultant I
Noida, IND
Discovered TodayFull-time
BI Developer
Gurugram, IND
Discovered TodayFull-time
Data Analyst Banking
Gurugram, IND
Discovered TodayFull-time