Senior Data Lead - Azure Data Factory (ADF), Databricks (137744)

Skill Requirements

• Required Skills & Experience 8+ years of overall IT experience with 3+ years in Snowflake engineering Strong expertise in: Snowflake (SnowSQL, Snowpark, Snowpipe, Streams/Tasks) Pipeline design and data engineering frameworks Metadata-driven ingestion architectures Hands-on experience with: Kafka-based ingestion (mandatory) File formats: Parquet (must), CSV, XML, JSON Experience delivering data in predefined formats for reporting and analytics Strong proficiency in SQL and data modeling Hands-on experience or exposure to Snowflake Cortex AI (required) Excellent communication, presentation, and stakeholder management skills Strong technical consulting and problem-solving mindset Good-to-Have Skills Experience with DBT (Data Build Tool) Knowledge of PL/SQL or procedural SQL programming Exposure to cloud platforms (AWS/Azure/GCP) Familiarity with CI/CD pipelines and version control systems Skill Matrix Must-Have Skills Skill Area Expected Competency Relevance to Role Snowflake Engineering Strong hands-on experience with Snowflake, SnowSQL, Snowpark, Snowpipe, Streams, and Tasks. Core capability required to design, build, and optimize Snowflake-based data engineering solutions. Data Pipeline Development Ability to design scalable batch and real-time ELT/ETL pipelines using Snowflake native capabilities. Required for building enterprise-grade ingestion and transformation frameworks. Metadata-Driven Ingestion Experience designing metadata-driven ingestion frameworks for onboarding multiple datasets and source systems. Critical for scalable, reusable, and automated data onboarding. Kafka Integration Hands-on experience with Kafka-based data ingestion and streaming pipeline integration. Mandatory for real-time data ingestion and event-driven data processing. File Format Handling Strong experience working with Parquet, CSV, JSON, and XML formats. Required to support structured, semi-structured, and enterprise file-based ingestion scenarios. SQL and Data Modeling Strong SQL proficiency with experience in data modeling, transformations, query optimization, and analytics-ready datasets. Essential for developing reliable reporting, analytics

Relevance to Role