Data Engineer

· 3–4 years of hands-on experience with Microsoft Azure.

· Strong experience with Azure Data Factory (ADF).

· Experience creating and scheduling pipelines, triggers, parameterized pipelines, and reusable datasets.

· Good understanding of linked services and integration runtimes.

· Experience integrating data from REST APIs.

· Ability to work with JSON payloads.

· Experience handling:

o Pagination

o Rate limiting

o Authentication

o Historical backfills

o Incremental loads

· Azure DevOps

o Experience maintaining code repositories in Azure DevOps.

o Knowledge of Git branching strategies.

o Experience with pull requests and deployment pipelines.

o Data Storage

o Experience working with:

§ Azure Blob Storage

§ Azure SQL Database

· Strong hands-on experience in SQL.

· Experience writing:

· Complex queries

· Stored procedures

· Views

· Joins

· Window functions

· Performance tuning

· Experience developing Power BI dashboards and reports.

· Ability to create data models, measures (DAX), and visualizations.

· Experience connecting Power BI to Azure SQL and Azure Blob data sources.

· 3–4 years of experience as a Data Engineer or ETL Developer.

· Hands-on experience with Azure data integration technologies.

· Experience delivering end-to-end data pipelines and reporting solutions.

Glencore is one of the world’s largest global diversified natural resource companies and a major producer and marketer of more than 60 commodities. Through a network of assets, customers and suppliers that spans the globe, we produce, process, recycle, source, market and distribute the commodities that advance everyday life.

With over 140,000 employees and contractors and a strong footprint in over 30 countries in both established and emerging regions for natural resources, our marketing and industrial activities are supported by a global network of offices.

Glencore’s customers are principally industrial consumers, such as those in the automotive, steel, power generation, battery manufacturing and oil sectors. We also provide financing, logistics and other services to producers and consumers of commodities.