Serve as a senior technical contributor within the Data Engineering team, providing hands-on development support, code review, troubleshooting, and mentorship to other engineers.
Contribute to the design and implementation of Databricks-based data solutions, including Lakehouse patterns, Delta Lake tables, medallion data models, ETL/ELT pipelines, workflow orchestration, and reusable data engineering components.
Build, optimize, and maintain production-grade data pipelines using Databricks, Python, PySpark, SQL, and related cloud data platform services.
Apply and help improve data engineering best practices, including coding standards, source control, CI/CD, automated testing, documentation, observability, data quality checks, and performance optimization.
Partner with business, analytics, product, and technology teams to load, curate, and operationalize large-scale datasets that support reporting, analytics, machine learning, and platform capabilities.
Support data platform initiatives via engineering expertise, solution delivery, reusable data assets, integration patterns, and practical implementation recommendations.
Participate in technical discovery and solution design for data initiatives, translating business requirements into effective Databricks implementation plans.
Share knowledge across the team by introducing relevant Databricks capabilities, engineering methods, and platform patterns that improve delivery speed, reliability, and scalability.
Bachelor’s degree or relevant work experience
8+ years software development experience
Experience developing production software using Python
Experience working with REST API's
SQL database design experience
Hands-on experience designing, building, and operating production data pipelines in Databricks is required
Experience with PySpark, Delta Lake, Lakehouse architecture, data modeling, workflow orchestration, and performance tuning within Databricks
Experience with a Distributed Version Control System (e.g., git)
Experience writing and maintaining test suites (including unit tests)
A passion for thoroughness, execution and completion
Ability to communicate in a clear, articulate, team-friendly manner to all levels of an organization to present findings and recommendations to team members and senior management
Experience in summarizing analysis results using PowerPoint and explaining analysis results to senior management levels
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career