Live Jobs · Updated Daily
"PySpark Developer / Lead" Jobs in India
Get matched with opportunities that fit your skills, experience, and career goals.
Jobs found — scroll to load more
Clear filters
PySpark Developer / Lead
Tata Consultancy Services ·
MidFull-timeOnsite
Role - Pyspark Developer / Lead Experience - 4 to 15 years Location - PAN INDIA Job description Technical/Functional Skills •PySpark: In-depth knowledge of PySpark, Apache Spark, and Python. •Data Processing: Stron
Skills
PySparkApache SparkPythonAWS
Discovered 3 weeks ago
ApplyLead Pyspark Developer
Luxoft · Hyderabad
LeadFull-time
Project description Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market a
Skills
• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application
Discovered 5 days ago
ApplyLead Pyspark Developer
Luxoft · Bengaluru
LeadFull-time
Project description Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market a
Skills
• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application
Discovered 2 weeks ago
ApplyLead Pyspark Developer
Luxoft · Chennai
LeadFull-time
Project description Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market a
Skills
• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application
Discovered 2 weeks ago
ApplyLead Data Engineer (Databricks, PySpark & GCP)
Egen · Hyderabad
LeadFull-timeHybrid
Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming, PySpark, Databricks and Google Cloud Platform (GCP) to join our data engineering team. The ideal c
Discovered Today
ApplyMachine Learning-AI and Data Science Engineer III
Deloitte ·
SeniorFull-time
Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, da
Skills
Data scienceMachine learningStatistical modelingPython
Discovered 5 days ago
ApplySenior Software Engineer (Java ,PySpark and AWS )
Unisys · Hyderabad
SeniorFull-timeOnsite
What success looks like in this role: An ideal candidate should have strong experience in Java, Python, AWS Cloud, Microservices, and Data Engineering. The candidate will be responsible for developing and supporting clo
Skills
JavaPythonAWSSpring Boot
Discovered 1 weeks ago
ApplyMachine Learning-AI and Data Science Engineer III
Deloitte · Hyderabad
SeniorFull-time
Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, da
Skills
Data scienceMachine learningStatistical modelingPython
Discovered 1 weeks ago
ApplyBusiness Analyst III
Thermo Fisher Scientific ·
MidFull-time
Work Schedule Standard (Mon-Fri)Environmental Conditions OfficeJob Description Job Title –Product Owner Job Location: Bangalore, India About Company: ThermoFisher Scientific Inc. is the world leader in serving scie
Skills
SQLData engineeringETL/ELTData pipelines
Discovered 1 weeks ago
ApplyPython Developer
InfoBeans ·
SeniorFull-time
Job Title: Python Developer Experience Level: 7 - 15 years Plus Job Overview: We are seeking an experienced Python Developer to join our team. The ideal candidate will have a strong background in backend de
Skills
PythonDjangoBackend developmentAzure Cloud
Discovered 1 weeks ago
ApplyS&C Global Network -AI -CG&S -Manager Data Science
Accenture in India · Hyderabad
ManagerFull-time
Job Description Job Title: Industry & Function AI Decision Science Manager + S&C GN Management Level: 07 - Manager Location: Primary – Bengaluru, Secondary – Gurugram Must-Have Skills:
Skills
Consumer Goods & ServicesAI and machine learningPythonR
Discovered 1 weeks ago
ApplyLead Assistant Manager
EXL · Bengaluru
LeadHybrid
Location: Bangalore/Ahmedabad/Pune We are seeking a dynamic and experienced Data Engineers in our Banking and Capital Markets practice. The specific skill requirement for concerned data engineer Profile: ETL – Using Alte
Skills
alteryxazureazure-data-factorygit
Discovered 2 weeks ago
ApplyLead Assistant Manager
EXL · Bengaluru
LeadHybrid
Role & Experience: Data Analyst (4 to 6 YoE) Location - Bangalore Job Description Summary: Key Skills: Strong SQL, Python, Pyspark, Jupyter Notebook, Agile / Jira / Confluence, Microsoft Excel, Banking Domain knowledge,
Skills
awsazureconfluenceexcel
Discovered 2 weeks ago
ApplyManager- Data Aggregation
beghouconsulting · Pune
ManagerFull-timeOnsite
Beghou brings over three decades of experience helping life sciences companies optimize their commercialization through strategic insight, advanced analytics, and technology. From developing go-to-market strategies and b
Skills
Patient data aggregationData managementData modelingData analytics
Discovered 2 weeks ago
ApplyBig Data / PySpark Engineering Lead - Vice President
Citi · Pune
SeniorFull-timeOnsite
The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The
Skills
SparkFlinkKafkaStarburst
Discovered 3 weeks ago
ApplyShowing 15 jobs
Your Career Platform
Launch Your Career Today
Browse thousands of jobs, tailor your resume in 60 seconds, and start applying with confidence.
Start Free NowFree plan available · No credit card required