{bc}
Apply
workday

Senior Data Engineer (Azure Synapse)

Quantiphi
Bengaluru, IND
Full-time
Senior · 3+ years experience
Onsite
Discovered 2 days ago
Azure Synapse AnalyticsSQLPythonPySparkAzure Data FactoryAzure Data Lake Storage (ADLS Gen2)
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

Azure Synapse AnalyticsSQLPython
Smart Apply

Full Job Posting

Work location: Mumbai, Bangalore & Trivandrum

  • We are seeking a highly skilled and experienced Senior Data Engineer with a strong focus on Azure Synapse Analytics to join our innovative team within the healthcare domain. In this critical role, you will be instrumental in designing and delivering robust big data pipelines for both structured and unstructured data, operating across multiple geographies. Your expertise will directly contribute to helping healthcare organizations achieve their business goals through advanced data ingestion technologies, cloud services, and DevOps practices. You will collaborate closely with Architects from various specialties, including Cloud Engineering, Software Engineering, and ML Engineering, to create cutting-edge platforms, solutions, and applications. These initiatives will address the latest trends in the healthcare industry, such as digital diagnosis, software as a medical product (SaMD), and AI marketplaces.

Role & Responsibilities

  • Azure Synapse Expertise: Work with cloud engineers and customers to solve complex big data problems by developing utilities for migration, storage, and processing specifically leveraging Azure Synapse Analytics.
  • Cloud Migration Strategy: Design and build a comprehensive cloud migration strategy for both cloud and on-premise applications, with a strong emphasis on integrating with Azure Synapse.
  • Troubleshooting & Optimization: Diagnose and troubleshoot complex distributed systems problems within the Azure ecosystem, developing solutions with a significant impact at massive scale, particularly within Synapse environments.
  • Large-Scale Data Processing: Build tools to ingest and jobs to process several terabytes or petabytes per day, optimizing performance and cost within Azure Synapse.
  • Next-Gen Storage & Compute: Design and develop next-generation storage and compute solutions for several large customers, utilizing the full capabilities of Azure Synapse.
  • Cross-Functional Collaboration: Communicate effectively with a wide set of teams, including Infrastructure, Network, Engineering, DevOps, SiteOps teams, and cloud customers, ensuring seamless integration and delivery.
  • Advanced Tooling: Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple Azure Synapse workspaces and associated cloud clusters.

Skill Must Skills

  • 3+ years of hands-on Data Engineering experience with strong knowledge of data structures, distributed systems, data modeling, and databases.
  • Strong proficiency in SQL and hands-on experience with Python/PySpark .
  • Extensive experience in developing Big Data solutions (migration, storage, processing) with a proven track record of implementing solutions on cloud platforms.
  • Experience building and supporting large-scale systems in a production environment.
  • Strong experience developing ETL/ELT pipelines using Azure Data Factory (ADF) and Synapse Pipelines.
  • Cloud Platforms: Deep expertise in Azure, specifically Azure Synapse Analytics (SQL Pools, Spark Pools, Data Explorer, Pipelines).
  • Big Data Distributions: Experience with Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2).
  • Distributed Processing Frameworks: Strong experience with Apache Spark (especially within Azure Synapse Spark Pools).
  • Database/Warehouse: Azure Synapse SQL Pools, Azure Cosmos DB, Azure Data Explorer, and other relevant Azure data services.
  • Orchestration Frameworks: Azure Data Factory, Apache Airflow, or similar.
  • Message/Event Solutions: Azure Event Hubs, Azure Service Bus, Kafka.
  • Container Orchestration (Good to have): Kubernetes (Azure Kubernetes Service - AKS).
  • If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us !

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Quantiphi

Lead, Senior Lead - Delivery Assurance

Mumbai, IND

Discovered 2 days agoFull-time

Senior Software Developer - Ruby On Rails

Bengaluru, IND

Discovered 6 days agoFull-time

Frontend Developer

Mumbai, IND

Discovered 6 days agoFull-time

Senior Machine Learning Engineer

Mumbai, IND

Discovered 1 weeks agoFull-time

Senior Data Engineer - India - (Profisee)

Bengaluru, IND

Discovered 1 weeks agoFull-time

Senior Software Developer - Java/Springboot

Bengaluru, IND

Discovered 1 weeks agoFull-time

Client Solutions Partner

Mumbai, IND

Discovered 1 weeks agoFull-time

Senior Machine Learning Engineer

Mumbai, IND

Discovered 1 weeks agoFull-time