Module Lead - Data Bricks Job
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Key Skills for This Role
Full Job Posting
Module Lead - Data Bricks Job
Hyderabad, TG, IN
YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.
At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.
Experience
5+ Years
Responsibilities
- Migrate existing code and workloads from Databricks to Azure Synapse .
- Refactor pandas-based data transformation logic into scalable PySpark / Azure Synapse Spark implementations
- Develop, enhance, and support data products that serve business and analytics needs.
- Write and optimize SQL for data extraction, transformation, validation, and reconciliation.
- Design and build reliable data pipelines and data processing workflows.
- Work with structured and semi-structured data to support downstream data products.
- Validate migrated code and data outputs to ensure accuracy and consistency.
- Troubleshoot issues across data pipelines, scripts, and Azure-based environments.
- Collaborate with data analysts, engineers, and business stakeholders to understand requirements and deliver solutions.
- Document technical solutions, migration changes, and data product logic.
- Support code reviews, testing, and deployment activities.
Required Technical Skills
- Strong hands-on experience with Azure Synapse
- Strong hands-on experience with Spark/PySpark
- Hands-on experience with Microsoft Fabric
- Proficiency in SQL and Python
- Experience working with pandas and re-factoring into PySpark and Azure Synapse Spark implementations
- Strong experience using Git and Azure DevOps for source control, pull requests, CI/CD pipelines, and deployment automation
- Strong experience with contributing to reusable engineering patterns and shared libraries
- Solid understanding of Azure fundamentals, including storage, compute, security, and identity
- Sold understanding of data modeling and data transformation concepts
- Solid experience in performance optimization
Preferred Technologies, Platforms, and Tools
Microsoft Fabric
SAP ECC / S/4HANA
Oracle ERP
Salesforce
Parquet, JSON, CSV data formats
GitHub, Azure DevOps, Terraform
Preferred / Nice-to-Have
Experience with Databricks notebooks and migration of workloads to Synapse
Familiarity with Azure Data Factory or Synapse Pipelines
Exposure to Microsoft Fabric and modern cloud data platforms
Knowledge of data quality checks, performance tuning, and monitoring.
Experience building data products in a cloud environment.
Familiarity with version control, collaborative development, and DevOps practices, and tooling (Git, Azure DevOps)
Experience with JSON, CSV, Parquet, or other common data formats
Experience with observability practices, including monitoring data pipelines, performance tuning, and investigating failures
At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.
Our Hyperlearning workplace is grounded upon four principles
- Flexible work arrangements, Free spirit, and emotional positivity
- Agile self-determination, trust, transparency, and open collaboration
- All Support needed for the realization of business goals,
- Stable employment with a great atmosphere and ethical corporate culture
About Yash Technologies Private Limited
Global technology integrator providing IT consulting and digital transformation services.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Yash Technologies Private Limited
Contractor - SAP Basis HANA Job
Bengaluru, IND
Sr. Software Engineer - Microsoft Fabric Job
Pune, IND
Sr. Test Engineer - API Testing Job
Pune, IND
Tech Lead - Tableau Job
Hyderabad, IND
AI Full Stack Software Developer Job
Indore, IND
Sr. Software Engineer - Graph DB Job
Pune, IND
Tech Lead - Informatica Job
Pune, IND
Associate Lead Consultant - SAP MDG Job
Hyderabad, IND