Senior Software Engineer II
Full Job Posting
Qualifications
- Lakehouse Platform Ownership: Own the end-to-end architecture of the Databricks Lakehouse, including workspace topology, cluster policies, compute strategy (job clusters, SQL warehouses, serverless), and multi-cloud deployment patterns (AWS/Azure/GCP).
- Unity Catalog & Governance: Design and enforce the global data governance model — catalogs, schemas, access controls, lineage, and audit logging — via Unity Catalog, ensuring consistent metadata management and fine-grained access across business units.
- Data Engineering Standards: Define and enforce best practices for Delta Lake table design, Delta Live Tables (DLT) pipelines, medallion architecture (bronze/silver/gold), and performance optimization (Z-ordering, liquid clustering, partitioning, file compaction).
- Platform Reliability & Automation: Partner with CloudOps and DevOps to industrialize the platform through Infrastructure-as-Code (Terraform/Databricks Asset Bundles), CI/CD pipelines, and monitoring, targeting 99.99% platform availability.
- FinOps & Cost Governance: Own cost transparency and optimization across the Databricks estate — cluster right-sizing, workload isolation, chargeback/showback models, and proactive budget alerting — bringing "Strategic Foresight" to cloud spend.
- Cross-Functional Enablement: Work directly with Data Engineering, Analytics, Data Science, and business stakeholders (Finance, HR, Product) to translate requirements into platform capabilities and self-service patterns.
- Governed AI Enablement: Own the governed rollout of AI use cases and native AI features (e.g., Databricks Genie, AI/BI Dashboards, Mosaic AI) on the platform. You hold the keys to unlocking GenAI and natural-language analytics for the business, safely, within Unity Catalog's governance and access-control boundaries.
- Community & Mentorship: Build and lead a community of practice for Databricks developers across the organization — publishing standards, running enablement sessions, and unblocking delivery friction for engineering teams
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at The Nielsen Company
Senior Customer Success Manager
, USA
Customer Success at Nielsen As a part of our Customer Success team at Nielsen, you will play a critical role in ensuring customer satisfaction by helping our customers utilize Nielsen’s products and services to achieve t
Senior Controllership Associate II
Mumbai, IND
Role Summary Support global Record-to-Report (R2R) operations by delivering accurate, timely, and compliant financial reporting. The role goes beyond processing to enable stronger stakeholder collaboration and drive cont
Senior Process Improvement Professional II
Mumbai, IND
Overall objective The Senior Process Improvement Professional will be a key driver in transforming our operational capabilities. This role is responsible for leading, implementing, and sustaining a culture of continuous
Senior Technical Program Manager II (Bangalore)
Bengaluru, IND
Lead governance of growth initiatives with comprehensive weekly updates on progress, providing visibility into development timelines, milestone achievements, risks and any deviations from targets. Identify and communicat
Member Technical Staff 2 - C/C++
Bengaluru, IND
We are looking for a highly skilled Senior Member of Technical Staff with 5–8 years of hands-on experience in systems-level programming, cloud infrastructure, and database technologies. The ideal candidate will have deep
Customer Support Representative II
Mumbai, IND
This is role is for Gracenote - A Global entertainment data and technology company that provides music, video, and sports metadata, automatic content recognition (ACR), and content discovery solutions that power search a
Treasury Manager, Capital Markets
, USA
Nielsen is seeking a Treasury Manager, Capital Markets to lead key capital markets activities across the treasury function. This role is responsible for managing debt and credit facilities, driving cash flow forecasting,
Manager, Convening Event Experiences
New York City, USA
The Manager, Convening runs Nielsen's always-on engagement calendar, mainly in New York. Where the premium portfolio creates a handful of major moments each year, this role keeps Nielsen in front of clients continuously
Senior Customer Success Manager
, USA
Senior Controllership Associate II
Mumbai, IND
Senior Process Improvement Professional II
Mumbai, IND
Senior Technical Program Manager II (Bangalore)
Bengaluru, IND
Member Technical Staff 2 - C/C++
Bengaluru, IND
Customer Support Representative II
Mumbai, IND
Treasury Manager, Capital Markets
, USA
Manager, Convening Event Experiences
New York City, USA