eightfold
Senior Big Data Engineer Pyspark Databricks - Vice President
Citi
Pune, IND
Full-time
Senior · 13+ years experience
Hybrid
Discovered 3 weeks ago
PySparkSparkECSKubernetesDeltaLakehouseKafka
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PySparkSparkECS
Key Skills for This Role
PySparkSparkECSKubernetesDeltaLakehouseKafka
Full Job Posting
Key Responsibilities
- Evaluate and provide technical solutions to solve a variety of complex and interdependent processes.
- Build and maintain the platform ensuring timely delivery of work items across the multiple initiatives/components.
- Ensure all team members adhere to our code quality and testing standards.
- Test and debug programs Coordinate with internal teams to understand user requirements and provide technical solutions.
- Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analysing/interpreting code
- Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
- Apply fundamental knowledge of programming languages for design specifications.
- Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
- Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
- Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
- Has the ability to operate with a limited level of direct supervision.
Skills & Experience
- Experience Professional with 13+ Years of experience in Data engineering with good exposure on spark architecture
- Good Exposure on PySpark , Spark development experience, particularly on data processing and the associated modules
- Work exposure on ECS , Kubernetes
- Have worked on DeltaLakehouse and exposure on consuming real time messages via Kafka
- Basic experience on Unix, hdfs and supported libraries such as PyArrow. Any PySpark experience is preferred as the environment uses Hadoop and Spark and it supports python.
- Working knowledge of Databases (SQL) is required.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Citi
Loan Documentation & Processing Associate Analyst
New Castle, USA
EntryFull-time
Discovered TodayView →
Senior Lead Counsel - Equities Derivatives and Cash - SVP
New York City, USA
SeniorFull-time
Discovered TodayView →
Marketing Analytics Analyst - Python, SQL and Machine Learning
Pune, IND
SeniorFull-time
Discovered TodayView →
Commercial Credit Officer
Irving, USA
Discovered TodayFull-time
Loan Documentation & Processing Associate Analyst
New Castle, USA
Discovered TodayFull-time
Senior Lead Counsel - Equities Derivatives and Cash - SVP
New York City, USA
Discovered TodayFull-time
IT Business Lead Analyst
Tampa, USA
Discovered TodayFull-time
Cash & Trade Proc Lead Analyst - VP
Mumbai, IND
Discovered TodayFull-time
Applications Developer
Chennai, IND
Discovered TodayFull-time
Marketing Analytics Analyst - Python, SQL and Machine Learning
Pune, IND
Discovered TodayFull-time
Applications Support Analyst
Pune, IND
Discovered TodayFull-time