Senior Data Engineer Lead- ScotiaTech (271674)

Colombia, Canada

Business Unit: IBTT

Player-coach role within a multi-country data engineering team supporting International Banking, combining hands-on delivery with the leadership of a small team of Data Engineers. Accountable for the technical delivery and operational health of the data pipelines and data products in scope, typically working across one or more concurrent initiatives in global markets, and for the efficient consumption of Azure Databricks resources associated with those workloads.

• Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field.

• A Master’s degree is considered an asset.

• 5+ years of progressive hands-on experience in data engineering, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks .

• Demonstrated experience as a technical lead on complex data initiatives, including leading design and code reviews and directly supervising, coaching, and developing data engineers.

• Expertise in designing and implementing data pipelines using Azure Databricks (Spark, Delta Lake, Unity Catalog, Workflows), Azure Data Factory, Azure Data Lake Storage Gen2, Event Hubs, and Azure Synapse or equivalent serving layers.

• Advanced proficiency in Python, PySpark, and SQL (Scala or Java an asset) for large-scale batch and streaming data processing, including performance tuning and cost optimization of Spark workloads.

• Hands-on experience with data modelling, schema design, lakehouse/medallion patterns, and data warehousing concepts.

• Strong working knowledge of CI/CD pipelines (Azure DevOps or GitHub Actions), version control (Git), Infrastructure as Code (Terraform or Bicep), automated testing, and Databricks Asset Bundles or equivalent deployment tooling.

• Knowledge of data governance, security, and compliance standards in cloud environments (e.g., GDPR, local data residency and privacy regulations), including Microsoft Entra ID, RBAC, and cloud key management.

• Experience migrating workloads from another public cloud or on-premises platform (e.g., GCP BigQuery/Dataflow to Azure Databricks) is a strong asset; Azure or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Azure DP-203) are an asset.

• Excellent problem-solving, influencing, and communication skills, with the ability to present complex technical concepts to non-technical stakeholders; Spanish language ability is an asset given the International Banking footprint.

Work in a standard office-based environment , with standard hours .

​ Ubicación(s): Colombia : Bogota : Bogota ScotiaTech es una unidad de negocio de ScotiaGBS, un grupo de empresas de Scotiabank, ubicado en Bogotá, Colombia. ScotiaTech fue creado para apoyar diversos sistemas y procesos tecnológicos del Banco. Ofrecemos un entorno de trabajo inclusivo y positivo, además de ventajas competitivas. En ScotiaTech, valoramos las habilidades y experiencias únicas que cada persona aporta y nos hemos comprometido a crear y mantener un entorno inclusivo y accesible para todos. Los candidatos deben postularse directamente en línea si desean ser tomados en cuenta para este puesto. Agradecemos a todos los candidatos por su interés en esta oportunidad profesional en ScotiaTech; sin embargo, solo contactaremos a quienes hayan sido seleccionados para una entrevista. ​