Senior Data Engineer

HyROI Solutions- An ISO-certified company

Doha, QAT

Contract

Senior

3 days ago

Azure Data FactoryAzure Synapse AnalyticsMicrosoft FabricSQLT SQLAzure SQL Database

Apply

Free

Job Fit Check

Base Career helps you apply smarter for this job.

Ready to Scan

Key skills for this role

Azure Data FactoryAzure Synapse AnalyticsMicrosoft Fabric

Smart Apply

About the Role

HyROI Solutions is looking for a Senior Data Engineer with expertise in Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric for a contract role in Doha, Qatar.

Key Skills for This Role

Azure Data FactoryAzure Synapse AnalyticsMicrosoft FabricSQLT SQLAzure SQL Database

Responsibilities

Design, develop, and deploy ETL pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources
Integrate Azure Data Factory with external data sources such as SQL Databases, NoSQL Databases, REST APIs, flat files, and cloud based storage
Ensure data quality by implementing data validation, transformation rules, and seamless error handling in pipelines
Automate data movement and orchestration between different storage systems, databases, and analytics platforms using ADF pipelines and Data Flows
Work with Azure Data Factory Mapping Data Flows to perform complex transformations and aggregations
Build and manage data lakes and data warehouses on Azure Synapse Analytics, ensuring seamless integration with Azure SQL Data Warehouse, Azure Data Lake, and other Azure services
Implement data transformation processes to support large scale data analytics, including batch processing and real time analytics
Develop data models for OLAP and OLTP to support reporting and data exploration
Work with Azure Synapse Studio to design serverless SQL pools, Spark Pools, and data integration pipelines
Optimize performance of data workloads in Azure Synapse Analytics, ensuring scalability and efficiency for reporting and analysis
Implement Microsoft Fabric for end to end data integration across Azure Data Services, ensuring seamless collaboration between data engineering, data science, and business intelligence teams
Utilize Microsoft Fabric's unified data platform to integrate data from multiple sources, ensuring easy access and transformation for real time analytics

Requirements

6+ years of hands on experience in data engineering, building and managing data pipelines, data integration, and cloud data architecture
Expertise in Azure Data Factory (ADF) for building scalable ETL pipelines
Strong experience with Azure Synapse Analytics and designing data models for data lakes, data warehouses, and analytics
Experience using Microsoft Fabric for collaborative data workflows, integrating data sources, and building data pipelines
Proficiency in SQL, T SQL, and Azure SQL Database for querying and managing data
Knowledge of data storage options, including Azure Blob Storage, Data Lake, and Azure SQL Database
Experience with big data technologies (Hadoop, Spark) and integration within Azure Synapse or Azure Databricks
Familiarity with DevOps practices, CI/CD pipelines, and automation for data workflows and deployments
Strong understanding of data governance, data quality, and cloud security in the Azure ecosystem
Familiarity with Power BI, Azure Machine Learning, or other BI/AI tools is a plus
Bachelor's or master's degree in Accounting, Business, Computer Science, Information Systems, Engineering, or related field

Full Job Posting

Role Overview

We are looking for a Data Engineer with expertise in Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric to join our growing data engineering team.
The ideal candidate will have hands on experience in building, managing, and optimizing data pipelines, data lakes, and data warehouses on Azure.
You will work closely with cross functional teams to design and implement scalable, efficient, and reliable data architectures that empower data scientists, analysts, and business stakeholders.

Key Responsibilities

Design, develop, and deploy ETL pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources (on premise and cloud).
Integrate Azure Data Factory with external data sources such as SQL Databases, NoSQL Databases, REST APIs, flat files, and cloud based storage (Azure Blob, Data Lake).
Ensure data quality by implementing data validation, transformation rules, and ensuring seamless error handling in pipelines.
Automate data movement and orchestration between different storage systems, databases, and analytics platforms using ADF pipelines and Data Flows.
Work with Azure Data Factory Mapping Data Flows to perform complex transformations and aggregations.
Build and manage data lakes and data warehouses on Azure Synapse Analytics, ensuring seamless integration with Azure SQL Data Warehouse, Azure Data Lake, and other Azure services.
Implement data transformation processes to support large scale data analytics, including batch processing and real time analytics.
Develop data models for OLAP (Online Analytical Processing) and OLTP (Online Transaction Processing) to support reporting and data exploration.
Work with Azure Synapse Studio to design serverless SQL pools, Spark Pools, and data integration pipelines.
Optimize performance of data workloads in Azure Synapse Analytics, ensuring scalability and efficiency for reporting and analysis.
Implement Microsoft Fabric for end to end data integration across Azure Data Services, ensuring seamless collaboration between data engineering, data science, and business intelligence teams.
Utilize Microsoft Fabric's unified data platform to integrate data from multiple sources, ensuring easy access and transformation for real time analytics.

Required Skills & Experience

6+ years of hands on experience in data engineering, building and managing data pipelines, data integration, and cloud data architecture.
Expertise in Azure Data Factory (ADF) for building scalable ETL pipelines.
Strong experience with Azure Synapse Analytics and designing data models for data lakes, data warehouses, and analytics.
Experience using Microsoft Fabric for collaborative data workflows, integrating data sources, and building data pipelines.
Proficiency in SQL, T SQL, and Azure SQL Database for querying and managing data.
Knowledge of data storage options, including Azure Blob Storage, Data Lake, and Azure SQL Database.
Experience with big data technologies (Hadoop, Spark) and integration within Azure Synapse or Azure Databricks.
Familiarity with DevOps practices, CI/CD pipelines, and automation for data workflows and deployments.
Strong understanding of data governance, data quality, and cloud security in the Azure ecosystem.
Familiarity with Power BI, Azure Machine Learning, or other BI/AI tools is a plus.

Preferred Certifications

Microsoft Certified: Azure Data Engineer Associate
Microsoft Certified: Azure Synapse Analytics
Microsoft Certified: Azure AI Engineer Associate
Certified Azure Solutions Architect Expert

Qualification

Bachelors or master’s degree in accounting, Business / Computer Science / Information Systems / Engineering

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Trusted by over 500,000 job seekers on Base Career

Start Free Today