Associate Software Engineer

Department and focus

Data engineering responsibilities

• Build production-grade ELT and ETL pipelines for batch and streaming ingestion.
• Implement Apache Iceberg and Delta Lake and optimize large-scale transformations.
• Implement data quality controls and support lineage, governance, CI/CD, and deployment processes.
• Deliver governed data products, self-service analytics, semantic models, curated data layers, and AI/ML-ready datasets.
• Promote scalable, reproducible lakehouse architecture and support regulatory and compliance requirements.
• Collaborate with stakeholders, analytics teams, data scientists, and engineers to deliver business-focused solutions.

Technical skills

• Advanced SQL, strong Python and Apache Spark or PySpark skills, and experience with Snowflake and lakehouse platforms.
• Knowledge of Apache Iceberg, Delta Lake, data governance, and quality frameworks.
• Experience with AWS, CI/CD, DevOps, Git, Docker, Kubernetes, and Terraform.
• Use AI agents and tools to accelerate coding, testing, migrations, SQL optimization, prompting, and documentation.