Databricks Data Engineer with a Solution Architect

As a Databricks Data Engineer with a Solution Architect background, you will lead the design of enterprise-scale data solutions, establish engineering standards and best practices, optimize platform performance and cost, and provide technical leadership for cloud modernization, real-time analytics, AI/ML enablement, and data governance initiatives. This role requires strong expertise in Spark, Delta Lake, Unity Catalog, cloud architecture, Infrastructure as Code (IaC), and modern data platform engineering principles to deliver secure, resilient, and highly scalable solutions.

We are seeking a highly skilled and experienced Senior Solution Architect to lead the implementation and adoption of the Databricks Lakehouse Platform as part of our enterprise data strategy.

This role will serve as the technical leader and subject matter expert for Databricks, supporting multiple business segments and strategic initiatives across the organization

• Applies advanced expertise in Databricks, Spark, Delta Lake, and cloud-native architectures to design and govern large-scale enterprise data platforms.
• Leads architecture decisions for cloud-based data and analytics solutions, ensuring scalability, security, resiliency, and operational excellence across Azure, AWS, or GCP environments.
• Establishes and evolves platform standards, best practices, and governance frameworks for data engineering, streaming, AI/ML, and analytics workloads.
• Recommends innovative technologies, architectural patterns, and optimization strategies to improve platform performance, reliability, and cost efficiency.
• Works on and may lead highly complex, cross-functional initiatives involving cloud modernization, data platform transformation, and enterprise architecture adoption.
• Designs and optimizes high-volume batch and real-time data pipelines, leveraging deep knowledge of Spark internals, Structured Streaming, and distributed computing principles.
• Provides architectural leadership for Delta Lake, Unity Catalog, security, data governance, and data-sharing capabilities across multiple business domains.