Engineer, TSG Data Engineering

WHERE YOU’LL FIT WITHIN THE TEAM

A Data Engineer is someone with a proven track record of delivering application modules with minimal to no supervision from senior engineering team members. Additionally, the individual is also responsible of providing guidance to associate/ entry level engineers in the team.

WHAT YOU’LL DO

Technical Delivery (80%)

Work with teams developing and updating enterprise applications.

Work as a member of an agile software development team with full participation in all Agile team events and activities.

Demonstrate ability to identify all technical steps required to complete a story. Work with the senior team members to evaluate product backlog items and functional specifications and determine the appropriate approach to developing the required functionality in the software application.

Demonstrate high-level business and domain knowledge and ability to understand and achieve business outcomes.

Work in collaboration with other team members on an agile team to analyze user stories and perform task breakdown and complete committed tasks as per sprint schedule.

Demonstrate good understanding of using the underlying infrastructure to develop his/her features.

Follow the standard application design and architecture to develop his/her features and work with senior team members to ensure non-functional metrics (e.g. scalability, performance) are met.

Prepare work estimates for committed tasks and components with support from senior team members.

Write unit test plans for committed components. Execute and confirm successful completion of unit tests as part of the criteria for completion.

Participate in the testing and implementation of applications releases.

Provide ongoing support for applications already in use. This includes problem diagnosis and resolution, ad hoc reporting support and database administration.

Demonstrate ability to acquire new skills e.g. creating automation tests using selenium, creating UX designs, DevOps, performing functional/ load testing etc. through internal/ external trainings to be a T-Shaped team member helping the team in achieving sprint goals.

Provide input during sprint retrospective to improve team experience.

Follow Bain development project process and standards in completing committed tasks and modules and contribute to the continual evolution of processes and standards.

With guidance, write technical documentation as required.

Research (10%)

Contribute to evaluating and employing new and/or supplemental technologies necessary to deliver functionality for a given software application.

Contribute to the research and evaluation of new tools and technologies beyond current product requirements that are likely to be used in future initiatives. Help in the presentation of findings and recommendations to the full Software Development team.

Participate in internal skill development by sharing concepts and technologies with the full Software Development team.

Communication (10%)

Ability to present the technical findings and recommendations to the Software Development team.

Clearly communicates impediments to completing a story and ensures clear understanding of definition of ‘done’.

ABOUT YOU

Demonstrated knowledge of agile software development methodologies and processes

Demonstrated record of strong performance in prior software development positions,

Strong communication and customer service skills

Strong analytic and problem-solving skills

Data Engineering - Technical skills:

Languages: T-SQL, PySpark, Python, Scala

Data Storage & Analytics: Delta Lake, Unity catalog, Microsoft SQL Server, Azure SQL, Azure Data Lake, Blob Storage, etc.

ETL Tools: Azure Databricks, Azure Data Factory

Cloud-based data warehouse and Lakehouse architectures on Microsoft Azure

Cloud & Infrastructure: Azure Databricks, ADLS, ADF, Azure Logic app

DevOps: Azure DevOps, Git, GitHub Actions

NoSQL databases: MongoDB, Cosmos, etc.

Visualization Tools: Tableau, Power BI, etc.

Experience

2-4+ years of relevant experience in Data Engineering

Experience developing enterprise scale applications

Demonstrated knowledge of agile software development methodologies and processes.

Demonstrated record of strong performance in prior software development positions.

Demonstrated record of T shape behavior to expedite delivery by managing conflicts/ contingencies

Education OR equivalent combination of education, training, and experience

Bachelor’s or equivalent degree