Azure Data Engineer

Prodapt is the largest specialized player in the Connectedness industry.

As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow.

A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider.

A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan.

Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.

We are seeking a highly skilled Azure Data Engineer with deep expertise in Microsoft Fabric to design, implement, and optimize our next-generation data analytics platform.

In this role, you will lead the transition and development of end-to-end data pipelines within a unified SaaS analytics environment.

You will leverage the full power of OneLake, Lakehouses, and PySpark notebooks to build scalable, high-performance architectures that transform raw data into actionable enterprise insights.

• Fabric Architecture Design: Architect and deploy end-to-end data engineering solutions leveraging the Microsoft Fabric ecosystem including OneLake, Lakehouses, Warehouses, and Streamhouses.
• Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using Fabric Datafactory, Pipelines, and Dataflows Gen2.
• Data Processing & Transformation: Write complex, optimized data transformation scripts using PySpark, Spark SQL, and Python within Fabric Notebooks.
• Modern Data Warehousing: Implement a Medallion Architecture (Bronze/Silver/Gold layers) inside OneLake utilizing Delta Lake formats for Delta Live Tables.
• Performance Tuning: Optimize query speeds and pipeline performance through strategic file partitioning, indexing, and workspace capacity management.
• Data Modeling & Analytics Integration: Construct and optimize Fabric Semantic Models to ensure seamless, high-performance integration with Power BI reporting.
• Governance & Security: Enforce enterprise data security using Fabric RBAC, Azure Key Vault, Managed Identities, and Microsoft Purview for metadata lineage.