Base Career helps you apply smarter for this job.
Key skills for this role
We are looking for a Senior Data Engineer with strong hands-on experience in Databricks to build and scale modern, cloud-native data platforms.
You will work on high-impact data engineering initiatives, collaborating with analytics, AI/ML, and business teams to deliver reliable and performant data solutions.
This role will also be involved in migrating enterprise data workloads from AWS-based platforms to Databricks, contributing to our broader data modernization journey.
Location: Pune (Hybrid)
Experience: 8+ Years
Skills: Databricks | Spark | Azure or AWS | Delta Lake
About the Role
We are looking for a Senior Data Engineer with strong hands-on experience in Databricks to build and scale modern, cloud-native data platforms. You will work on high-impact data engineering initiatives, collaborating with analytics, AI/ML, and business teams to deliver reliable and performant data solutions.
This role will also be involved in migrating enterprise data workloads from AWS-based platforms to Databricks, contributing to our broader data modernization journey.
Key Responsibilities
Must have experience in requirement gathering, design, develop, and optimize data pipelines using Databricks and Apache Spark (PySpark).
Build and manage Delta Lake Medallion architectures.
Develop batch and streaming pipelines using Structured Streaming.
Optimize Spark workloads for performance and cost efficiency.
Implement Databricks Jobs, Workflows, and SQL.
Ingest data from various relation databases, SAP, API’s, etc into databricks.
Contribute to AWS (Glue/Redshift) → Databricks data migration initiatives.
Implement data quality, security, and governance best practices.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
Allentown, USA
At Air Products, we reimagine what’s possible. By tapping into the motivation of our people and our collective experience, we create the ideas and innovations that drive us forward. When we come together – where every vo
, USA
At Air Products, we reimagine what’s possible. By tapping into the motivation of our people and our collective experience, we create the ideas and innovations that drive us forward. When we come together – where every vo
, USA
At Air Products, we reimagine what’s possible. By tapping into the motivation of our people and our collective experience, we create the ideas and innovations that drive us forward. When we come together – where every vo
Bethlehem, USA
At Air Products, we reimagine what’s possible. By tapping into the motivation of our people and our collective experience, we create the ideas and innovations that drive us forward. When we come together – where every vo
, USA
At Air Products, we reimagine what’s possible. By tapping into the motivation of our people and our collective experience, we create the ideas and innovations that drive us forward. When we come together – where every vo
Chertsey, GBR
At Air Products, we reimagine what’s possible. By tapping into the motivation of our people and our collective experience, we create the ideas and innovations that drive us forward. When we come together – where every vo
Edmonton, CAN
Edmonton, CAN
Allentown, USA
, USA
, USA
Bethlehem, USA
, USA
Chertsey, GBR
Collaborate with cross-functional teams and mentor junior engineers.
Required Skills & Experience
8+ years of experience in Data Engineering
Strong hands-on experience with Databricks.
Knowledge and experience on security and governance topics is a plus.
Advanced knowledge of Apache Spark (PySpark preferred)
Experience with Terraform (IAC), Delta Lake, SQL, and Python
Solid understanding of cloud-native data architectures on Databricks.
Experience building scalable, production-grade data pipelines
Strong problem-solving and communication skills.
Nice to Have
Experience with Unity Catalog and data governance
Familiarity with CI/CD pipelines and DevOps best practices for data solutions.
Familiarity with Terraform, dbt, or Airflow
Databricks certification (preferred, not mandatory)
Founded in 1940, Air Products is a world-leading industrial gases company and has a proud history of innovation, operational excellence, with an unwavering commitment to safety and environmental stewardship. Working together, we are taking our passion and diverse backgrounds forward to reimagine what’s possible and generate a cleaner future for our customers, our communities, and the world.
World-leading industrial gases company committed to safety and innovation.
Visit company websiteJobs and hiring trendsFull-time
Senior · 8+ years experience
Hybrid
Apply faster on company sites with our extension.