{bc}
Live Jobs · Updated Daily

"Lead Pyspark Developer" Jobs in India

Get matched with opportunities that fit your skills, experience, and career goals.

Jobs found — scroll to load more

Clear filters

Lead Pyspark Developer

Luxoft · Hyderabad

LeadFull-time

Project description Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market a

Skills

• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application

Discovered 5 days ago

Apply

Lead Pyspark Developer

Luxoft · Bengaluru

LeadFull-time

Project description Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market a

Skills

• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application

Discovered 2 weeks ago

Apply

Lead Pyspark Developer

Luxoft · Chennai

LeadFull-time

Project description Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market a

Skills

• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application

Discovered 2 weeks ago

Apply

PySpark Developer / Lead

Tata Consultancy Services ·

MidFull-timeOnsite

Role - Pyspark Developer / Lead Experience - 4 to 15 years Location - PAN INDIA Job description Technical/Functional Skills •PySpark: In-depth knowledge of PySpark, Apache Spark, and Python. •Data Processing: Stron

Skills

PySparkApache SparkPythonAWS

Discovered 3 weeks ago

Apply

Lead Data Engineer (Databricks, PySpark & GCP)

Egen · Hyderabad

LeadFull-timeHybrid

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming, PySpark, Databricks and Google Cloud Platform (GCP) to join our data engineering team. The ideal c

Discovered Today

Apply

Machine Learning-AI and Data Science Engineer III

Deloitte ·

SeniorFull-time

Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, da

Skills

Data scienceMachine learningStatistical modelingPython

Discovered 4 days ago

Apply

Senior Software Engineer (Java ,PySpark and AWS )

Unisys · Hyderabad

SeniorFull-timeOnsite

What success looks like in this role: An ideal candidate should have strong experience in Java, Python, AWS Cloud, Microservices, and Data Engineering. The candidate will be responsible for developing and supporting clo

Skills

JavaPythonAWSSpring Boot

Discovered 1 weeks ago

Apply

Machine Learning-AI and Data Science Engineer III

Deloitte · Hyderabad

SeniorFull-time

Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, da

Skills

Data scienceMachine learningStatistical modelingPython

Discovered 1 weeks ago

Apply

Business Analyst III

Thermo Fisher Scientific ·

MidFull-time

Work Schedule Standard (Mon-Fri)Environmental Conditions OfficeJob Description Job Title –Product Owner Job Location: Bangalore, India About Company: ThermoFisher Scientific Inc. is the world leader in serving scie

Skills

SQLData engineeringETL/ELTData pipelines

Discovered 1 weeks ago

Apply

Python Developer

InfoBeans ·

SeniorFull-time

Job Title: Python Developer Experience Level: 7 - 15 years Plus Job Overview: We are seeking an experienced Python Developer to join our team. The ideal candidate will have a strong background in backend de

Skills

PythonDjangoBackend developmentAzure Cloud

Discovered 1 weeks ago

Apply

S&C Global Network -AI -CG&S -Manager Data Science

Accenture in India · Hyderabad

ManagerFull-time

Job Description Job Title: Industry & Function AI Decision Science Manager + S&C GN Management Level: 07 - Manager Location: Primary – Bengaluru, Secondary – Gurugram Must-Have Skills:

Skills

Consumer Goods & ServicesAI and machine learningPythonR

Discovered 1 weeks ago

Apply

Lead Assistant Manager

EXL · Bengaluru

LeadHybrid

Location: Bangalore/Ahmedabad/Pune We are seeking a dynamic and experienced Data Engineers in our Banking and Capital Markets practice. The specific skill requirement for concerned data engineer Profile: ETL – Using Alte

Skills

alteryxazureazure-data-factorygit

Discovered 2 weeks ago

Apply

Lead Assistant Manager

EXL · Bengaluru

LeadHybrid

Role & Experience: Data Analyst (4 to 6 YoE) Location - Bangalore Job Description Summary: Key Skills: Strong SQL, Python, Pyspark, Jupyter Notebook, Agile / Jira / Confluence, Microsoft Excel, Banking Domain knowledge,

Skills

awsazureconfluenceexcel

Discovered 2 weeks ago

Apply

Manager- Data Aggregation

beghouconsulting · Pune

ManagerFull-timeOnsite

Beghou brings over three decades of experience helping life sciences companies optimize their commercialization through strategic insight, advanced analytics, and technology. From developing go-to-market strategies and b

Skills

Patient data aggregationData managementData modelingData analytics

Discovered 2 weeks ago

Apply

Big Data / PySpark Engineering Lead - Vice President

Citi · Pune

SeniorFull-timeOnsite

The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The

Skills

SparkFlinkKafkaStarburst

Discovered 3 weeks ago

Apply

Showing 15 jobs

Your Career Platform

Launch Your Career Today

Browse thousands of jobs, tailor your resume in 60 seconds, and start applying with confidence.

Start Free Now

Free plan available · No credit card required