zoho_recruit
Databricks Engineer
DATAECONOMY
Hyderabad, IND
Full-time
Senior · 5+ years experience
Hybrid
Discovered 2 weeks ago
DatabricksApache SparkPySparkScalaETLELT
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
DatabricksApache SparkPySpark
Key Skills for This Role
DatabricksApache SparkPySparkScalaETLELT
Full Job Posting
Qualification: BTech/MTech/MCA
- Mode of Work: Hybrid
- Design, develop, and maintain scalable data engineering solutions using Databricks and Apache Spark.
- Create and deploy custom ETL/ELT pipelines to ingest, transform, and process large volumes of structured and unstructured data.
- Configure, manage, and optimize Databricks clusters for performance, scalability, and cost efficiency.
- Implement and manage Lakehouse architectures using Databricks best practices.
- Develop and maintain data workflows utilizing Delta Lake and Delta Live Tables (DLT).
- Design and implement Medallion Architecture (Bronze, Silver, Gold layers) for reliable and scalable data processing.
- Configure and govern data assets using Unity Catalog, ensuring data security, access control, and compliance.
- Collaborate with data architects, analysts, and business stakeholders to translate business requirements into technical solutions.
- Monitor data pipelines and troubleshoot performance or data quality issues.
- Optimize Spark jobs and workflows to improve processing efficiency and reduce execution time.
- Follow DevOps and CI/CD best practices for deployment and release management.
Requirements
- 5-10 years of experience in Data Engineering or Big Data technologies.
- Strong understanding of Databricks architecture and core platform capabilities.
- Hands-on experience in setting up and managing Databricks clusters.
- Strong expertise in Apache Spark (PySpark/Scala Spark).
- Experience developing and deploying custom ETL pipelines in Databricks.
- Experience implementing Medallion Architecture within Databricks.
- Hands-on experience with Delta Live Tables (DLT).
- Strong understanding and implementation experience with Unity Catalog.
- Experience working with Delta Lake and Lakehouse architecture principles.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at DATAECONOMY
AI/ML MLOps Engineer
Hyderabad, IND
MidFull-time
DATAECONOMY is seeking an AI/ML MLOps Engineer to fine-tune, deploy, evaluate, and monitor self-hosted large language models across the full machine learning lifecycle. The role requires 5–8 years of experience, strong P
Discovered 1 weeks agoView →
Java Full Stack Developer
Hyderabad, IND
SeniorFull-time
DATAECONOMY is seeking an experienced Java Full Stack Developer to build and maintain enterprise applications across backend, frontend, cloud, and deployment layers. The role requires strong Java, Spring Boot, Spring Sec
Discovered 1 weeks agoView →
Data Engineer — ML Training Data Pipeline
Hyderabad, IND
Discovered 1 weeks agoFull-time
ML / Fine-Tuning Engineer
Hyderabad, IND
Discovered 1 weeks agoFull-time
AI/ML MLOps Engineer
Hyderabad, IND
Discovered 1 weeks agoFull-time
Java Full Stack Developer
Hyderabad, IND
Discovered 1 weeks agoFull-time
Java Full Stack Developer
Hyderabad, IND
Discovered 2 weeks agoFull-time
AI/ML MLOps Engineer
Hyderabad, IND
Discovered 2 weeks agoFull-time