Senior Data Engineer (Technical Lead)

Role Overview

Technical Leadership

• Lead, mentor, and manage a team of five to eight data engineers.
• Provide technical guidance throughout the software development lifecycle.
• Conduct design, code, and solution reviews.
• Establish development standards, coding best practices, and quality controls.
• Support team members in resolving complex technical and production issues.

Data Engineering and Development

• Design, develop, and support enterprise-scale data engineering solutions using Python and Microsoft SQL.
• Develop and maintain ETL/ELT processes for data ingestion, transformation, and validation.
• Build scalable data pipelines for reporting, analytics, and operations.
• Develop reusable frameworks and utilities to improve efficiency and maintainability.

Data Quality

• Design and implement data quality frameworks and controls.
• Establish automated validation, reconciliation, completeness, and accuracy checks.
• Investigate data quality issues through root cause analysis.
• Continuously improve data reliability and governance practices.

SQL Performance and Optimization

• Analyze and optimize complex SQL queries, stored procedures, and database objects.
• Perform execution plan analysis, indexing reviews, and query optimization.
• Troubleshoot production performance issues and implement improvements.
• Ensure database solutions are scalable, stable, and efficient.

DevOps and Release Management

• Implement and manage source code repositories using Git.
• Drive DevOps practices across the delivery lifecycle.
• Manage branching strategies and CI/CD deployment pipelines.
• Support release management and change implementation processes.
• Ensure deployments follow governance, quality, and security standards.

Documentation and Delivery

• Prepare technical specifications, mapping documents, deployment guides, and runbooks.
• Ensure project documentation is complete and accurate throughout the lifecycle.
• Support audit, compliance, and governance requirements.
• Work with business analysts, architects, project managers, QA teams, and stakeholders.
• Participate in planning, estimation, resource allocation, risk management, and delivery reporting.
• Take ownership of complex development tasks and provide hands-on support during critical project phases.

Experience and Qualifications

• Bachelor's degree in computer science, information technology, engineering, or a related discipline.
• Ten to twelve years of IT experience in data engineering and application development.
• At least four years of experience leading technical teams.
• Experience delivering enterprise-scale data engineering solutions.

Technical Expertise

• Strong data engineering design and implementation experience.
• Extensive ETL/ELT and integration framework experience.
• Proficiency in Python for transformation, automation, and workflow development.
• Advanced SQL and T-SQL expertise, including stored procedures, views, functions, optimization, indexing, and database design.
• Experience with data quality controls, Git, branching strategies, CI/CD, and release management.

Ways of Working