Specialist Software Engineer - SPARK/SCALA, Java full stack - Innovation / Project / Organization - Bangalore, India

ResponsibilitiesWe are seeking a highly skilled Specialist Software Engineer with 5+ years of experience in Spark and Scala to join our Big Data Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data processing applications that analyze and process large datasets across distributed platforms. This role requires strong expertise in data engineering, backend development, and production support, along with a passion for delivering high-quality, reusable, and reliable solutions.Primary Skills: Spark, Scala, Python, Kafka, Hive, HDFS, Airflow/Oozie, Java 17, Spring Boot, REST APIs, Microservices.ig Data & Data Engineering5+ years of hands-on experience with Apache Spark and Scala.Strong experience in building and maintaining large-scale data pipelines and ETL processes.Experience with:PythonHadoop Ecosystem (HDFS)HiveKafkaScheduling/Workflow tools such as Oozie or AirflowStrong understanding of distributed computing, data processing, and performance optimization techniques.Backend DevelopmentExperience designing, developing, and deploying microservices using:Java 17+Spring BootStrong expertise in building and maintaining RESTful APIs.Understanding of API design, integration patterns, and service-oriented architecture.Software EngineeringStrong knowledge of Agile methodologies and SDLC processes.Experience with code reviews, unit testing, and software craftsmanship practices.Ability to write clean, maintainable, and reusable code.Excellent analytical, problem-solving, and debugging skills.Profile requiredDesign, develop, test, and maintain Spark-based applications for large-scale data processing and analytics.Build and optimize data ingestion, transformation, and integration pipelines across multiple data platforms.Independently design software components and deliver high-quality code that meets functional and non-functional requirements.Contribute across all phases of the Software Development Lifecycle (SDLC) following Agile and engineering best practices.Develop scalable, maintainable, and reusable solutions with a focus on performance, reliability, and operational excellence.Collaborate with cross-functional teams to define and implement APIs, data access standards, and integration solutions.Participate actively in Agile ceremonies, chapter meetings, design discussions, and technical reviews.Monitor, troubleshoot, and resolve production issues, providing Level 2 and Level 3 support when required.Identify recurring production issues and recommend improvements to enhance system stability and performance.Automate repetitive operational and production support activities to increase efficiency.Perform release validations and generate metrics, test reports, and defect reports.Ensure comprehensive documentation, including data models, metadata, data dictionaries, and data pipeline standards.Mentor team members and contribute to establishing engineering guidelines and best practices.Why join usWe are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.Business insightAt Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!Still hesitating? You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.