company_site

Senior Data Engineer

Luxoft

Bengaluru, IND

Full-time

Senior · 6–9 years experience

Discovered 2 weeks ago

• 6–9 years of software engineering experience, including at least 2–3 years working with distributed data stores and distributed computation. • Hands-on experience with one or more distributed data technologies such as Elasticsearch, Cassandra, Hadoop, or MongoDB. • Strong proficiency in Scala • Experience with Spark and Presto or Trino for large-scale data processing. • Experience with microservice-based architectures. • Hands-on experience with Kubernetes and container-based deployment. • Working knowledge of NoSQL data stores. • Experience operating in Unix/Linux environments. • Familiarity with Agile/Scrum delivery practices.

Apply

Free

Job Fit Check

Base Career helps you apply smarter for this job.

Ready to Scan

Key skills for this role

Smart Apply

Full Job Posting

Responsibilities

Design, build, and operate structured, semi-structured, and unstructured data stores supporting real-time and batch analytics workloads within your assigned scope. • Recommend and apply appropriate distributed data and computation technologies for assigned use cases, balancing performance, scalability, and maintainability. • Implement secure, reliable access patterns for connecting to multiple internal and external data sources. • Apply encryption and other controls to protect data at rest in line with security standards. • Build and maintain real-time analytics pipelines using distributed processing frameworks such as Spark and Presto/Trino. • Containerize and deploy data services using Kubernetes and related orchestration tooling. • Design and implement data replication strategies to support active/active data center resilience. • Design, implement, and test backup and recovery procedures for owned data platforms. • Own code quality, testing, and documentation for data engineering components within your scope. • Collaborate with engineering, security, and platform teams to ensure data solutions meet reliability and operational standards.

Skills

6–9 years of software engineering experience, including at least 2–3 years working with distributed data stores and distributed computation. • Hands-on experience with one or more distributed data technologies such as Elasticsearch, Cassandra, Hadoop, or MongoDB. • Strong proficiency in Scala • Experience with Spark and Presto or Trino for large-scale data processing. • Experience with microservice-based architectures. • Hands-on experience with Kubernetes and container-based deployment. • Working knowledge of NoSQL data stores. • Experience operating in Unix/Linux environments. • Familiarity with Agile/Scrum delivery practices.