Senior Data Lead - Azure Data Factory (ADF), Databricks (IN)

JD: Need experienced Senior Data Engineer (6+ years) to design and optimize scalable data solutions on Microsoft Azure. You will work with Snowflake for data warehousing and Databricks for big data processing within a Lakehouse architecture using medallion principles (Bronze, Silver, Gold). Key Responsibilities: JD: Need experienced Senior Data Engineer (6+ years) to design and optimize scalable data solutions on Microsoft Azure. You will work with Snowflake for data warehousing and Databricks for big data processing within a Lakehouse architecture using medallion principles (Bronze, Silver, Gold). Key Responsibilities: Data Pipelines: Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks (PySpark, SQL), and ingest data from diverse sources into ADLS and Snowflake. Databricks Development: Create and tune Spark jobs, leverage Delta Lake, Autoloader, and advanced optimization techniques. Data Warehousing: Design and manage Snowflake schemas, queries, and performance tuning. Data Quality & Governance: Implement security, lineage, validation frameworks, and compliance policies. Programming: Develop in Python, PySpark, Scala, and advanced SQL for data processing and automation. Collaboration: Partner with data architects and mentor junior engineers. DevOps: Maintain CI/CD pipelines using Azure DevOps Databricks Development: Create and tune Spark jobs, leverage Delta Lake, Autoloader, and advanced optimization techniques. Data Warehousing: Design and manage Snowflake schemas, queries, and performance tuning. Data Quality & Governance: Implement security, lineage, validation frameworks, and compliance policies. Programming: Develop in Python, PySpark, Scala, and advanced SQL for data processing and automation. Collaboration: Partner with data architects and mentor junior engineers. DevOps: Maintain CI/CD pipelines using Azure DevOp