{bc}
workable

Senior Solutions Consultant

Unison Group
Remote, IND
Remote
Discovered 1 weeks ago
DatabricksApache SparkPySparkPythonSQLData Lake architecture
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

DatabricksApache SparkPySpark
Smart Apply

Full Job Posting

Job Summary

Design, develop, and implement modern data engineering solutions using the Databricks platform.

Work with customers and internal teams to understand business requirements and deliver scalable data solutions using cloud-based Lakehouse architecture.

The role requires hands-on experience with Databricks, Apache Spark, Python, and SQL.

Experience

  • At least 6 years of overall Information Technology experience is required.
  • At least 3 years of hands-on Databricks experience is required.
  • Experience developing and implementing enterprise data engineering solutions is required.

Key Responsibilities

  • Collaborate with customers and business stakeholders to understand data and analytics requirements.
  • Design, develop, and maintain scalable Databricks and Apache Spark data pipelines.
  • Build and optimize ETL/ELT workflows for batch and near-real-time processing.
  • Implement Bronze, Silver, and Gold Data Lakehouse layers.
  • Develop transformations using Python, PySpark, and SQL.
  • Ensure data quality, reliability, and performance through testing and optimization.
  • Troubleshoot data-processing and performance issues.
  • Work with Solution Architects, Data Engineers, and DevOps teams on end-to-end solutions.
  • Participate in code reviews and follow development best practices.
  • Create technical documentation and support deployment and production activities.

Required Technical Skills

  • Strong hands-on Databricks experience is required.
  • Proficiency in Python, SQL, and Apache Spark or PySpark is required.
  • Understanding of Data Lake and Lakehouse architecture is required.
  • Experience implementing Bronze, Silver, and Gold data layers is required.
  • Experience designing and developing ETL/ELT pipelines is required.
  • Knowledge of Delta Lake, Spark performance optimization, data modeling, and data integration is required.
  • Experience with structured and semi-structured data is required.

Preferred Skills

  • Experience with Azure, AWS, or Google Cloud Platform is preferred.
  • Familiarity with Delta Live Tables, Unity Catalog, Databricks Workflows, and MLflow is preferred.
  • Experience with Azure Data Factory, Apache Airflow, or similar orchestration tools is preferred.
  • Knowledge of Git, CI/CD pipelines, and Agile development methodologies is preferred.
  • Databricks or cloud-platform certifications are advantageous.

Working Style

The role requires analytical and problem-solving skills, customer interaction, collaboration, and teamwork.

The consultant should be able to gather and analyze business requirements, manage multiple tasks, and deliver within project timelines.

The role requires independent and cross-functional work, continuous learning, and adaptation to evolving project requirements.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Unison Group