company_site
Databricks Python Developer
Tata Consultancy Services
Jersey City, USA
Full-time
Senior · 10+ years experience
Onsite
USD 100000-115000 yearly / year
Discovered 1 weeks ago
DatabricksPythonPySparkSpark SQLDelta LakeAirflow
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
DatabricksPythonPySpark
Key Skills for This Role
DatabricksPythonPySparkSpark SQLDelta LakeAirflow
Full Job Posting
Must Have Technical And Functional Skills
- 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development.
- 5+ years of hands-on experience with Databricks, Python, and PySpark.
- Strong hands-on experience in Databricks, Python, and PySpark development.
- Experience building and supporting large-scale ETL/ELT data pipelines.
- Strong knowledge of Spark SQL, Delta Lake, and Data Lakehouse architecture.
- Experience working with structured and unstructured data from multiple sources.
- Strong SQL skills and experience with relational databases.
- Experience with data modeling, data transformation, and data quality processes.
- Knowledge of orchestration tools such as Airflow, ADF, or similar.
- Experience with Git, CI/CD, and Agile development methodologies.
- Strong analytical, debugging, and performance tuning skills.
- Excellent verbal and written communication skills.
Roles Responsibilities
- Design, develop, and maintain data pipelines using Databricks, Python, and PySpark.
- Build scalable data ingestion, transformation, and integration solutions.
- Collaborate with Data Architects, Analysts, and business teams to deliver data solutions.
- Develop and optimize batch and real-time data processing workflows.
- Ensure data quality, integrity, security, and governance standards are met.
- Monitor, troubleshoot, and resolve production data pipeline issues.
- Optimize Spark jobs, SQL queries, and Databricks workloads for performance.
- Participate in data modeling, code reviews, and platform enhancement activities.
- Create technical documentation and support production deployments.
- Participate in Agile ceremonies and contribute to continuous improvement initiatives.
Salary
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Tata Consultancy Services
Salesforce Communication Cloud Industries Architect
Sydney, AUS
Discovered TodayFull-time
Salesforce Sr Developer
Sydney, AUS
Discovered TodayFull-time
Infrastructure Migration Test Lead
Sydney, AUS
Discovered TodayFull-time
Senior DevOps Engineer
London, GBR
Discovered TodayFull-time
Business Analyst
Mumbai, IND
Discovered TodayFull-time
AWS DevOps and CFT Automation Engineer
Bengaluru, IND
Discovered TodayFull-time
Google Data Engineer Developer/ Lead
Bengaluru, IND
Discovered TodayFull-time
FP&A Specialist
Bengaluru, IND
Discovered TodayFull-time