Senior Data Software Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Scotiabank is seeking a Senior Software Engineer to lead design and development of enterprise data catalog and data management solutions using Databricks. You will mentor junior engineers, drive architectural decisions, and ensure scalable, secure data services.
Key Skills for This Role
Responsibilities
- Design and build scalable components of an enterprise data catalog, using automation to streamline data governance processes
- Integrate enterprise data catalog with Databricks and other data platforms
- Design and develop data quality, data profiling and data classification solutions
- Lead technical design discussions and drive architectural decisions for data management solutions
- Advocate for good engineering and development practices within your squad
- Evaluate trade offs between correctness, robustness, performance, and customer impact
- Identify technical risks and proactively propose scalable, long term solutions
- Mentor and guide junior engineers
- Communicate with stakeholders and work with product managers to understand product requirements
Requirements
- Bachelor’s or master’s degree in computer science, Engineering, or a related field
- Solid understanding of common design patterns, lakehouse architecture, and experience with backend and frontend development frameworks
- Strong programming skills (Python and/or Java)
- Proven experience with DataBricks, Unity Catalog, Delta Lake and Apache Spark
- Experience building or integrating enterprise data catalog tools (e.g. Atlan, Alation, Collibra, DataHub, OpenMetadata)
- Experience designing and building reusable data quality, data profiling and data classification frameworks
- Experience implementing data security and access control models
- Solid understanding of data governance, metadata management, and data lineage concepts
- Experience with cloud platforms (Azure, GCP) and infrastructure as code tools (Terraform)
- Familiarity with RESTful APIs, microservice architecture and distributed designs
- Knowledge of streaming technologies (Kafka, structured streaming)
- 7+ years of experience in developing enterprise cloud native applications, with at least 4 years in enterprise data system focused on DataBricks/Azure
Full Job Posting
Overview
- As a Senior Software Engineer on Scotiabank’s Data & AI Technology team, you will lead the design, development and scaling of our enterprise data catalog and data management solutions leveraging the Databricks ecosystem.
- This role is ideal for someone ambitious, enjoys mentoring, thrives on intricate technical issues, and is enthusiastic about shaping the future of the data platform.
Is this role right for you? In this role, you will:
- Design and build scalable components of an enterprise data catalog, using automation to streamline data governance processes.
- Integrate enterprise data catalog with Databricks and other data platforms.
- Design and develop data quality, data profiling and data classification solutions.
- Lead technical design discussions and drive architectural decisions for data management solutions.
- Advocate for good engineering and development practices within your squad.
- Evaluate trade offs between correctness, robustness, performance, and customer impact.
- Identify technical risks and proactively propose scalable, long term solutions.
- Mentor and guide junior engineers.
- Communicate with stakeholders, work with product managers to understand product requirements.
Do you have the skills that will enable you to succeed in this role?
- Bachelor’s or master’s degree in computer science, Engineering, or a related field.
- Solid understanding of common design patterns, lakehouse architecture, and experience working with backend and frontend development frameworks.
- Strong programming skills (Python and/or Java).
- Proven experience with DataBricks, Unity Catalog, Delta Lake and Apache spark.
- Experience building or integrating enterprise data catalog tools (e.g. Atlan, Alation, Collibra, DataHub, OpenMetadata).
- Experience designing and building reusable data quality, data profiling and data classification frameworks.
- Experience implementing data security and access control models.
- Solid understanding of data governance, metadata management, and data lineage concepts.
- Experience with cloud platforms (Azure, GCP) and infrastructure as code tools (Terraform).
- Familiarity with restful APIs, microservice architecture and distributed designs.
- Knowledge of streaming technologies (Kafka, structured streaming).
- 7+ years of experience in developing enterprise cloud native applications, with at least 4 years in enterprise data system focused on DataBricks/Azure.
What's in it for you?
- Diversity, Equity, Inclusion & Allyship inclusive culture with Employee Resource Groups.
- Accessibility and Workplace Accommodations inclusive environment.
- Upskilling through online courses, cross functional development opportunities, and tuition assistance.
- Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits.
- Dynamic Ecosystem free tea & coffee, universal washrooms, and collaboration space.
- Community Engagement opportunities for community engagement & belonging.
About Scotiabank
- Scotiabank is a leading bank in the Americas, guided by our purpose: 'for every future'.
- We help customers, their families and their communities achieve success through a broad range of advice, products and services.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Scotiabank
Business Analysis Specialist Market Risk
Toronto, CAN
Scotiabank is seeking a Business Analysis Specialist for Market Risk to provide subject matter expertise on FRTB aggregation and the Atoti platform. The role involves interacting with stakeholders, managing requirements,
Senior Manager, Enterprise Payments, Global Transaction Banking
Toronto, CAN
Scotiabank is seeking a Senior Manager, Product Management – Payments API Standardization to lead the strategy, roadmap, and lifecycle management for payment API standards across a global API platform. The role involves
Business Analysis Specialist Market Risk
Toronto, CAN
Scotiabank seeks a Business Analysis Specialist to join the Global Risk and Treasury Engineering team, providing technical expertise on FRTB Market Risk aggregation and managing the Atoti platform. The role involves stak
Manager, Data & Analytics Strategy
Toronto, CAN
Scotiabank is looking for a Manager, Data & Analytics Strategy to drive the creation and adoption of the CID&A strategy and support strategic initiatives. You will execute complex programs, develop strategy content, and
Inside Sales Representative, Dynamic
Calgary, CAN
Scotiabank's Dynamic Funds seeks an Inside Sales Representative to support wholesalers by generating sales, managing client relationships, and executing outbound campaigns. The role requires strong product knowledge and
Business Analyst, Business Initiatives - Scotia Jarislowsky Fraser - Toronto
Toronto, CAN
Scotiabank is seeking a Business Analyst to support the development, planning, and execution of business initiatives within Scotia Jarislowsky Fraser. You will assist with project delivery, data analysis, event coordinat
Senior Manager, Analytics and BI
Toronto, CAN
Scotiabank seeks a Senior Manager, Analytics and BI for the Deposits & Savings business. You will lead analytics and BI initiatives, provide strategic insights, and manage a team. The role requires extensive analytics ex
Senior Manager, Product Strategy and Solutions, Private Banking
Toronto, CAN
Scotiabank seeks a Senior Manager to serve as the central product relationship manager for Private Banking, representing the division in enterprise product initiatives and influencing product roadmaps. The role requires
Business Analysis Specialist Market Risk
Toronto, CAN
Senior Manager, Enterprise Payments, Global Transaction Banking
Toronto, CAN
Business Analysis Specialist Market Risk
Toronto, CAN
Manager, Data & Analytics Strategy
Toronto, CAN
Inside Sales Representative, Dynamic
Calgary, CAN
Business Analyst, Business Initiatives - Scotia Jarislowsky Fraser - Toronto
Toronto, CAN
Senior Manager, Analytics and BI
Toronto, CAN
Senior Manager, Product Strategy and Solutions, Private Banking
Toronto, CAN