Senior Data Engineer - AI & Data Platform (Offshore)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
DataFirst Solutions is hiring a Senior Data Engineer to design and optimize cloud-native data platforms for analytics, BI, ML, and GenAI. The role involves building scalable data pipelines, Lakehouse solutions, and AI-ready data foundations using Microsoft Fabric, Azure, Databricks, and other technologies.
Key Skills for This Role
Responsibilities
- Develop robust batch and real time data ingestion pipelines from structured, semi structured, and unstructured data sources
- Design and implement scalable enterprise data platforms using Microsoft Fabric, Azure, Databricks, Synapse, or similar
- Build and optimize Medallion Architecture (Bronze, Silver, Gold) and Lakehouse solutions
- Develop enterprise grade ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric Data Factory, Databricks, Spark, or equivalent
- Design dimensional models, semantic models, and modern analytical data models for enterprise reporting
- Build scalable Delta Lake architectures with optimized partitioning, indexing, and performance tuning
- Implement data quality validation, monitoring, observability, lineage, and governance frameworks
- Collaborate with AI Engineers to prepare feature stores and AI ready datasets for ML and GenAI
- Develop Retrieval Augmented Generation (RAG) data pipelines supporting enterprise AI applications
- Integrate Vector Databases, Embedding models, and enterprise document repositories for LLM based solutions
- Work with Azure AI Foundry, Azure OpenAI, Microsoft Copilot Studio, Azure AI Search, or equivalent AI services
- Implement secure data platforms following enterprise governance, RBAC, Purview, data masking, encryption, and compliance standards
Requirements
- 7+ years of experience in Data Engineering
- Strong expertise in Microsoft Fabric
- Strong expertise in Azure Data Engineering services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage Gen2)
- Hands on experience with Databricks
- Expertise in Apache Spark (PySpark preferred)
- Strong SQL development and query optimization skills
- Advanced Python programming
- Experience in Delta Lake and Lakehouse Architecture
- Strong understanding of Medallion Architecture
- Experience in dimensional modeling and semantic data models
- Experience with Microsoft Fabric OneLake
- Knowledge of Power BI semantic models and Direct Lake architecture
Full Job Posting
Company Description
- DataFirst Solutions is a leading Data, Analytics, AI, and Digital Transformation company.
- Headquartered in Dubai, delivers solutions across Middle East, Europe, and Asia.
- Expertise spans Microsoft Fabric, Azure, Databricks, Power BI, AI & Machine Learning, Generative AI.
Role Description
- Full time Senior Data Engineer role designing and optimizing cloud native data platforms.
- Architect scalable data pipelines, build Lakehouse solutions, implement semantic data models.
- Collaborate with Data Scientists, AI Engineers, Solution Architects, and business stakeholders.
Key Responsibilities
- Develop batch and real time data ingestion pipelines.
- Design and implement enterprise data platforms using Microsoft Fabric, Azure, Databricks.
- Build and optimize Medallion Architecture and Lakehouse solutions.
- Develop ETL/ELT pipelines using Azure Data Factory, Databricks, Spark.
- Design dimensional and semantic data models.
- Build scalable Delta Lake architectures.
- Implement data quality, monitoring, and governance frameworks.
- Prepare AI ready datasets for ML and GenAI.
- Develop RAG data pipelines.
- Integrate Vector Databases and Embedding models.
- Work with Azure AI services.
- Implement secure data platforms with governance and compliance.
Required Qualifications
- 7+ years in Data Engineering.
- Strong expertise in Microsoft Fabric.
- Strong expertise in Azure Data Engineering services.
- Hands on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage Gen2.
- Strong experience with Databricks.
- Expertise in Apache Spark (PySpark).
- Strong SQL and Python skills.
- Experience in Delta Lake and Lakehouse Architecture.
- Understanding of Medallion Architecture.
- Experience in dimensional modeling.
- Experience with Microsoft Fabric OneLake.
- Knowledge of Power BI semantic models and Direct Lake.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at DataFirst Solutions
Senior Java Software Engineer - Sharjah
Dubai, UAE
DataFirst Solutions is seeking a Senior Java Software Engineer for an on-site role in Sharjah. The engineer will design, develop, and maintain Java-based applications, collaborate with cross-functional teams, and deliver
Senior Power BI Consultant- AI & Data Platform- Abu Dhabi
Dubai, UAE
DataFirst Solutions seeks a Senior Power BI Consultant with AI experience for a government client in Abu Dhabi. The role involves designing Power BI dashboards, developing semantic models, implementing Microsoft Fabric C
Power BI Consultant - Dubai
Dubai, UAE
DataFirst Solutions seeks a Power BI Consultant with 3-5 years of experience for a client in Dubai. The role involves designing interactive dashboards, writing complex SQL queries, and collaborating with stakeholders. Re
Palantir Foundry Engineer
Dubai, UAE
About Company Datafirst is a technology and consulting services company focused on delivering skilled IT talent and data-driven solutions to clients across industries. We are looking for an experienced Palantir Foundry E