company_site
Lead Pyspark Developer
Luxoft
Hyderabad, IND
Full-time
Lead · 10+ years experience
Discovered 5 days ago
• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application
Key Skills for This Role
• 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading , transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application
Full Job Posting
Responsibilities
- Develop software applications based on business requirements • Maintain software applications and make enhancements according to project specifications • Participate in requirement analysis, design, development, testing, and implementation activities • Propose new techniques and technologies for software development. • Perform unit testing and user acceptance testing to evaluate application functionality • Ensure to complete the assigned development tasks within the deadlines • Work in compliance with coding standards and best practices • Provide assistance to Junior Developers when needed. • Perform code reviews and recommend improvements. • Review business requirements and recommend changes to develop reliable applications. • Develop coding documentation and other technical specifications for assigned projects. • Act as primary contact for development queries and concerns. • Analyze and resolve development issues accurately.
Skills
- 10+ years of experience in data intensive Pyspark development • Must have experience in leading a Development Team • Proven experience as a Core Python developer • Good understanding of Gen AI • Experience developing Classes, OOPS, exception handling, parallel processing • Strong knowledge of DB connectivity, data loading, transformation, calculation • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations • Lambda Functions, Decorators • Vector operations on Pandas dataframes /series • Application of applymap, apply, map functions • Concurrency and error handling data pipeline batch of size [1-10 gb] • Ability to understand business requirements and translate them into technical requirements • Ability to design architecture of data pipeline for concurrent data processing • Familiar with creating/designing RESTful services and APIs • Familiar with application unit tests • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services • Debugging application
About Luxoft
Technology10,001+Founded 2000
Global IT services and consulting company
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Luxoft
GoldenSource Consultant, Abu Dhabi (relocation friendly)
, UAE
Mid-SeniorFull-time
Project description The IT Engineer Application will be responsible for the operational management, support, and continuous improvement of the Golden Source SaaS-based Enterprise Data Management (EDM) platform. This role
Discovered TodayView →
Project Manager - FM Asset Class
Bengaluru, IND
Discovered TodayFull-time
Murex Front Office Support Consultant
Abu Dhabi, UAE
Discovered TodayFull-time
Temenos Senior Tester
Bengaluru, IND
Discovered TodayFull-time
Temenos Senior Tester
Bengaluru, IND
Discovered TodayFull-time
GoldenSource Consultant, Abu Dhabi (relocation friendly)
, UAE
Discovered TodayFull-time
Data Modeller
London, GBR
Discovered TodayFull-time
Snowflake DevOps Engineer
London, GBR
Discovered TodayFull-time
Senior Java Developer
Pune, IND
Discovered TodayFull-time