Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Scotiabank is looking for a Data Engineer to join the Enterprise Data & AI Technology organization. You will design, build, and maintain scalable data pipelines using Azure and Databricks.
Key Skills for This Role
Responsibilities
- Design, build, and maintain scalable, resilient data pipelines to support ingestion, processing, and distribution of large datasets
- Leverage SaaS platforms and tools to develop, configure, and automate data workflows
- Partner with stakeholders and product managers to gather requirements, design ingestion patterns, and onboard new data sources into the cloud data platform
- Implement observability capabilities and continuously optimize application services and pipeline performance
- Perform data integrity validation to ensure accuracy, reliability, and consistency of data
Requirements
- 4+ years of experience working with Data Warehouse / Data Platforms
- 4+ years of experience creating ELT / ETL data pipelines, working with structured, semi structured, and unstructured data
- 4+ years of experience working on CI/CD and source control systems such as Github, Bitbucket, and Terraform
- 4+ years of experience in Cloud: Azure
- 4+ years of experience in Lakehouse: Databricks
- Strong programming and scripting skills (SQL, Python, Java, Scala)
- Strong knowledge of cloud infrastructure and microservices architecture
- Experience in creating technical design documentations
- Experience collaborating with DevOps, Scrum, and Product Teams
- Solid communication skills and ability to translate complex technical problems to business language
- Experience in leading and driving technical discussions
- Expert at problem solving and debugging
Full Job Posting
Role Overview
- The Data Engineer plays a critical role within the Enterprise Data & AI Technology organization—one of Scotiabank's most significant enterprise wide strategic initiatives.
- This organization drives data enabled decision making, AI innovation, and technology modernization across the Bank.
Is this role right for you? In this role, you will:
- Design, build, and maintain scalable, resilient data pipelines to support the ingestion, processing, and distribution of large datasets.
- Leverage SaaS platforms and tools to develop, configure, and automate data workflows, improving efficiency across the data engineering lifecycle.
- Partner with stakeholders and product managers to gather requirements, design ingestion patterns, and onboard new data sources into the cloud data platform.
- Implement observability capabilities and continuously optimize application services and pipeline performance.
- Perform data integrity validation to ensure accuracy, reliability, and consistency of data.
Do you have the skills that will enable you to succeed in this role?
- Experience building data pipelines, and composable cloud based data platforms (Azure), using Azure Data Factory, ADLS.
- Experience working with Lakehouse platforms: Databricks, Unity Catalog, Auto Loader.
- Experience with data engineering, programming, ETL and ELT processes for data extraction and processing.
- Experience working with structured, semi structured, and unstructured data.
- Strong programming and scripting skills (SQL, Python, Java, Scala).
- Strong knowledge of cloud infrastructure and microservices architecture.
- Experience in creating technical design documentations, both logical and physical view.
- Experience collaborating and working with DevOps, Scrum, and Product Teams.
- Demonstrated team player with strong communication skills and a track record of successful delivery.
- Solid communication skills – ability to translate complex technical problems to business language.
- Experience in leading and driving technical discussions.
- Expert at problem solving and debugging.
What's in it for you?
- Diversity, Equity, Inclusion & Allyship inclusive culture with Employee Resource Groups.
- Accessibility and Workplace Accommodations.
- Upskilling through online courses, cross functional development opportunities, and tuition assistance.
- Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits starting day one.
- Dynamic Ecosystem free tea & coffee, universal washrooms, and lots of space for team collaboration.
- Community Engagement opportunities.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Scotiabank
Business Analysis Specialist Market Risk
Toronto, CAN
Scotiabank is seeking a Business Analysis Specialist for Market Risk to provide subject matter expertise on FRTB aggregation and the Atoti platform. The role involves interacting with stakeholders, managing requirements,
Senior Manager, Enterprise Payments, Global Transaction Banking
Toronto, CAN
Scotiabank is seeking a Senior Manager, Product Management – Payments API Standardization to lead the strategy, roadmap, and lifecycle management for payment API standards across a global API platform. The role involves
Business Analysis Specialist Market Risk
Toronto, CAN
Scotiabank seeks a Business Analysis Specialist to join the Global Risk and Treasury Engineering team, providing technical expertise on FRTB Market Risk aggregation and managing the Atoti platform. The role involves stak
Manager, Data & Analytics Strategy
Toronto, CAN
Scotiabank is looking for a Manager, Data & Analytics Strategy to drive the creation and adoption of the CID&A strategy and support strategic initiatives. You will execute complex programs, develop strategy content, and
Inside Sales Representative, Dynamic
Calgary, CAN
Scotiabank's Dynamic Funds seeks an Inside Sales Representative to support wholesalers by generating sales, managing client relationships, and executing outbound campaigns. The role requires strong product knowledge and
Senior Manager, Analytics and BI
Toronto, CAN
Scotiabank seeks a Senior Manager, Analytics and BI for the Deposits & Savings business. You will lead analytics and BI initiatives, provide strategic insights, and manage a team. The role requires extensive analytics ex
Senior Manager, Product and Solutions, Private Banking
Toronto, CAN
Scotiabank seeks a Senior Manager, Product and Solutions for Private Banking to serve as the central product relationship manager, representing Private Banking in enterprise product initiatives and influencing product ro
Business Analyst, Business Initiatives - Scotia Jarislowsky Fraser - Toronto
Toronto, CAN
Scotiabank is seeking a Business Analyst to support the development, planning, and execution of business initiatives within Scotia Jarislowsky Fraser. You will assist with project delivery, data analysis, event coordinat
Business Analysis Specialist Market Risk
Toronto, CAN
Senior Manager, Enterprise Payments, Global Transaction Banking
Toronto, CAN
Business Analysis Specialist Market Risk
Toronto, CAN
Manager, Data & Analytics Strategy
Toronto, CAN
Inside Sales Representative, Dynamic
Calgary, CAN
Senior Manager, Analytics and BI
Toronto, CAN
Senior Manager, Product and Solutions, Private Banking
Toronto, CAN
Business Analyst, Business Initiatives - Scotia Jarislowsky Fraser - Toronto
Toronto, CAN