Senior Data Engineer

Role overview

Responsibilities

• Integrate new sources with the existing batch ETL system.
• Create real-time pipelines using an infrastructure-as-code approach.
• Help teams extract warehouse data into their systems and support Reverse ETL processes.
• Improve data management processes, provide feedback, and propose solutions.
• Automate processes and optimize pipeline performance.
• Take responsibility for long-term improvements, refactoring, cost-reduction investigations, and implementation.

Requirements

• Strong programming skills, such as experience with several programming languages or Python frameworks.
• Software design skills, including design patterns and application design.
• Data system design or cloud systems experience, including examples such as AWS, GCP, message brokers, object storage, or query engines.
• Strong SQL skills, including subqueries, window functions, and CTEs.
• Warehouse design or ETL systems design experience.
• PySpark or other distributed systems knowledge, including distributed computing and performance optimization.
• Experience with or ability to use infrastructure as code, such as AWS CloudFormation.
• Experience with or ability to use the Databricks platform.

Technology stack

• Stack includes GCP, BigQuery, AWS message brokers, Databricks, Spark, dbt, Tableau, and Redash.

About Snoonu

Perks and work culture

• Perks include learning budgets, access to courses and tools, flexible time off, and a collaborative global team.
• The company describes its culture as autonomous, agile, inclusive, customer-focused, and oriented toward ownership and results.