Principal Data Engineer

Role Overview

Key Responsibilities

• Lead scalable data engineering design and development in the Lakehouse environment.
• Define ingestion, transformation, integration, and consumption approaches.
• Lead ETL/ELT initiatives across multiple systems and business domains.
• Oversee Azure Databricks, PySpark, SQL, and Delta Lake pipelines.
• Migrate existing data assets and models into the Lakehouse architecture.
• Define engineering standards, reusable frameworks, and best practices.
• Optimize layered architecture, data models, datasets, queries, and workloads.
• Establish loading, historical data, schema evolution, recovery, quality, and monitoring strategies.
• Ensure governance, security, metadata, lineage, and access requirements are met.
• Conduct technical reviews and mentor Data Engineers.
• Collaborate on requirements, estimation, planning, dependencies, risks, and continuous improvement.
• Maintain awareness of ISO 14001 and ISO 45001 standards.

Qualifications and Technical Competence

• Graduation or post-graduation degree is required.
• 10–15 years of professional experience is required.
• Strong Lakehouse architecture and modern data platform expertise is required.
• Extensive Azure Databricks, Apache Spark, PySpark, Delta Lake, Python, and SQL experience is required.
• Enterprise-scale ETL/ELT, dimensional modeling, and performance optimization experience is required.
• Knowledge of data governance, metadata, lineage, data quality, security, and access management is required.
• Knowledge of Git, version control, CI/CD, and automated deployment is required.
• Ability to lead initiatives, conduct code reviews, manage risks, and mentor engineers is required.

Location

• The additional information lists the position location as Chennai, India.

Compensation and Work Environment

• The posting mentions a competitive salary without specifying a compensation cadence.
• The employer describes a global, flexible, inclusive, and technology-focused working environment.

About Konecranes