zoho_recruit
Databricks Developer
Kumaran Systems
Hyderabad, IND
Full-time
Mid · 4+ years experience
Onsite
Discovered 3 weeks ago
DatabricksApache SparkPython (PySpark)PySparkSQLSpark SQL
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
DatabricksApache SparkPython (PySpark)
Key Skills for This Role
DatabricksApache SparkPython (PySpark)PySparkSQLSpark SQL
Full Job Posting
Pipeline Development
Design, develop, and maintain ETL/ELT data pipelines using PySpark and SQL in Databricks notebooks.
Process large-scale datasets and ensure reliable and efficient data transformations.
Architecture Design
Implement data lake and data warehouse architectures using Databricks Delta Lake and Delta Live Tables .
Build and manage Medallion Architecture (Bronze, Silver, Gold layers) for structured data processing.
Performance Optimization
Optimize Spark jobs and queries for performance, scalability, and cost-efficiency.
Manage cluster configurations, partitioning strategies, and caching mechanisms .
Cloud Integration
Integrate Databricks solutions with cloud services such as: Azure Data Factory (ADF) Azure Data Lake Storage (ADLS) Gen2 AWS S3 or other cloud storage platforms
Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS) Gen2
AWS S3 or other cloud storage platforms
Data Governance & Quality
Implement data quality checks, validation frameworks, and monitoring processes .
Ensure data security, encryption, masking, and lineage tracking .
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Kumaran Systems
Business Systems Analyst
Toronto, CAN
SeniorFull-time
Kumaran Systems is seeking a Senior Business Systems Analyst to lead complex analysis for a Credit Risk and ECL rewrite program. The role covers requirements, process and data analysis, stakeholder alignment, governance,
Discovered 3 days agoView →
Automation Engineer (AI)
Toronto, CAN
Discovered 3 days agoFull-time
Data Masking specialist
Toronto, CAN
Discovered 3 days agoFull-time
Data Engineer
Toronto, CAN
Discovered 3 days agoFull-time
Business Systems Analyst
Toronto, CAN
Discovered 3 days agoFull-time
Automation Architect
Chennai, IND
Discovered 3 days agoFull-time
Azure Devops Engineer
Chennai, IND
Discovered 3 days agoFull-time
Dot Net-Fullstack
Chennai, IND
Discovered 3 days agoFull-time
Business Systems Analyst
Toronto, CAN
Discovered 3 days agoFull-time