linkedin
Senior Data Engineer
VITA Solutions
, UAE
Senior
DatabricksPySparkSQLDelta LakeUnity CatalogAzure Data Factory
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
DatabricksPySparkSQL
About the Role
VITA Solutions is hiring a Senior Data Engineer with strong Databricks experience to design, develop, and manage end-to-end data pipelines on the Databricks Lakehouse platform. You will build scalable data solutions, implement governance with Unity Catalog, and enable AI/BI analytics.
Key Skills for This Role
DatabricksPySparkSQLDelta LakeUnity CatalogAzure Data Factory
Responsibilities
- Design, develop, and maintain scalable data ingestion and ETL/ELT pipelines using Databricks
- Build and orchestrate data workflows using Databricks Workflows (Lakeflow Jobs) and Azure Data Factory
- Develop and manage Delta Lake tables across Bronze, Silver, and Gold layers
- Implement data governance using Unity Catalog, including access controls, lineage, and data quality
- Build declarative pipelines using Databricks Lakeflow, supporting CDC and incremental data processing
- Configure and maintain integrations with SharePoint and other external data sources using Lakeflow Connect
- Design semantic models and certified datasets to support Databricks AI/BI dashboards and Genie
- Ensure data quality, monitoring, testing, and performance optimization across pipelines
- Implement CI/CD practices using Git, Databricks Repos, and Asset Bundles
- Collaborate with business stakeholders, analytics teams, and solution architects
- Troubleshoot production issues and independently drive solutions
Requirements
- 7–10 years of experience in Data Engineering
- Strong hands on experience with Databricks
- Expertise in PySpark and SQL
- Experience with Databricks Workflows/Jobs orchestration
- Strong knowledge of Delta Lake
- Experience with Unity Catalog
- Hands on experience with Databricks Lakeflow (Declarative Pipelines/Connect)
- Experience implementing CDC and incremental data processing
- Working knowledge of Azure Data Factory
- Exposure to Databricks AI/BI and Genie
- Experience with CI/CD, Git, Databricks Repos, and Asset Bundles
- Strong understanding of data governance, data quality, and performance optimization
Full Job Posting
Company Description
- VITA Solutions is an AI first, purpose led technology firm enabling ethical and enterprise ready AI adoption.
- Delivers trusted, end to end AI transformations for CIOs and CDOs across legal, finance, procurement, manufacturing, and retail.
- Flagship platforms include Retrofit, MoveSmart, SmartCode, iVITAContract, SmartSupply, and SmartShelf.
Role Description
- Looking for a highly skilled Senior Data Engineer with strong hands on experience in Databricks and modern data engineering practices.
- Capable of independently designing, developing, and managing end to end data pipelines while leveraging the Databricks Lakehouse platform.
- Requires expertise in building scalable data solutions, implementing governance standards, and enabling AI/BI analytics.
Key Responsibilities
- Design, develop, and maintain scalable data ingestion and ETL/ELT pipelines using Databricks.
- Build and orchestrate data workflows using Databricks Workflows (Lakeflow Jobs) and Azure Data Factory.
- Develop and manage Delta Lake tables across Bronze, Silver, and Gold layers.
- Implement data governance using Unity Catalog, including access controls, lineage, and data quality.
- Build declarative pipelines using Databricks Lakeflow, supporting CDC and incremental data processing.
- Configure and maintain integrations with SharePoint and other external data sources using Lakeflow Connect.
- Design semantic models and certified datasets to support Databricks AI/BI dashboards and Genie.
- Ensure data quality, monitoring, testing, and performance optimization across pipelines.
- Implement CI/CD practices using Git, Databricks Repos, and Asset Bundles.
- Collaborate with business stakeholders, analytics teams, and solution architects.
- Troubleshoot production issues and independently drive solutions with minimal supervision.
Qualifications
- 7–10 years of experience in Data Engineering.
- Strong hands on experience with Databricks.
- Expertise in PySpark and SQL.
- Experience with Databricks Workflows/Jobs orchestration.
- Strong knowledge of Delta Lake.
- Experience with Unity Catalog.
- Hands on experience with Databricks Lakeflow (Declarative Pipelines/Connect).
- Experience implementing CDC and incremental data processing.
- Working knowledge of Azure Data Factory.
- Exposure to Databricks AI/BI and Genie.
- Experience with CI/CD, Git, Databricks Repos, and Asset Bundles.
- Strong understanding of data governance, data quality, and performance optimization.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career