Chief Lakehouse Architect – Databricks CoE

Key Responsibilities

• Define Databricks reference architectures (batch, streaming, ML, GenAI)
• Own standards for Delta Lake, medallion architecture, Unity Catalog
• Design multi-workspace Databricks platform architectures
• Lead Databricks migrations from legacy data warehouses programs
• Design, Review and approve architecture for all Databricks deals
• Mentor architects and senior Databricks engineers
• Define Databricks FinOps framework
• Optimize cluster policies, DBU usage, and job scheduling
• Work with engineering teams on performance-to-cost optimization
• Advise leadership and clients on Databricks cost strategies

Experience

Skills

• Databricks platform internals & optimization
• Spark performance tuning and scalability
• Delta Lake internals (ACID, compaction, Z-order)
• Databricks Jobs, Workflows, CI/CD, IaC
• Cloud-native Databricks (AWS / Azure / GCP)
• Cluster tuning & auto-scaling strategies, Databricks DBU model & pricing
• Cloud billing & monitoring tools
• Cost optimization patterns for Spark workloads

Certifications (Preferred)