Sr. Data Engineer

Job Summary

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for large-scale data processing.
• Optimize and troubleshoot data pipelines for improved efficiency and reliability.
• Build, manage, and optimize MongoDB, Elasticsearch, Redis, and SQL databases.
• Ensure high availability, data integrity, and scalability of database environments.
• Implement cloud-based data infrastructure on AWS, Azure, or Google Cloud.
• Configure and manage CI/CD pipelines for automated deployment and testing of data workflows.
• Use Docker for containerization; Kubernetes exposure is advantageous.
• Develop and maintain RESTful Flask APIs for internal and external data integration.
• Collaborate with frontend, backend, data science, and analytics teams.
• Contribute to architecture discussions, sprint planning, code reviews, and process improvements.
• Monitor performance, manage logging, and resolve production issues proactively.
• Mentor junior engineers and share best practices.

Required Skills and Qualifications

• Strong proficiency in Python for data pipelines and APIs.
• Hands-on experience with MongoDB, Elasticsearch, Redis, and SQL databases.
• In-depth understanding of ETL/ELT, distributed data systems, and data engineering frameworks.
• Experience developing and maintaining APIs using Flask.
• Working knowledge of AWS, GCP, or Azure.
• Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
• Knowledge of Docker; Kubernetes knowledge is a plus.
• Strong analytical, debugging, and problem-solving abilities.
• Excellent communication and collaboration skills, with the ability to work independently.
• Experience managing large-scale, production-grade data systems.
• Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field.

Preferred Skills

• Experience with data streaming technologies such as Kafka.
• Understanding of machine learning workflows or MLOps.
• Familiarity with Infrastructure as Code tools including Terraform or Ansible.

Workplace

• The role is based in Ahmedabad, Gujarat, and requires in-person work.
• Candidates must be able to reliably commute to Ahmedabad or plan to relocate before starting.

Compensation

• The annual pay range is ₹1,200,000.00 to ₹1,600,000.00.

Employment Type

• The position is full-time and permanent.