ashby
Senior Data Platform Engineer
Ellipsis Health
San Francisco, USA
Full-time
Senior · 5+ years experience
Hybrid
USD 150000-170000 yearly / year
Discovered 1 weeks ago
SQLPythonDatabricksdbtApache SparkSnowflake
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
SQLPythonDatabricks
Key Skills for This Role
SQLPythonDatabricksdbtApache SparkSnowflake
Full Job Posting
Responsibilities:
- Lead the design, development, and operation of a scalable and secure data platform to support analytics, ML Ops, and business intelligence
- Collaborate closely with Data Science, Machine Learning, Application and DevOps teams to implement end-to-end ML Ops pipelines
- Architect and manage data warehousing solutions using Databricks, Dbt, and Spark
- Develop and maintain ETL/data pipelines that handle structured and unstructured data across diverse sources
- Optimize data storage, access, and processing for cost-efficiency and performance in GCP and AWS Cloud environments
- Build and maintain dashboards and analytics solutions using tools such as Sigma, Metabase, and other BI platforms
- Ensure compliance with data governance, security, and privacy best practices, including HIPAA, SOC-2, and other regulatory requirements
- Evaluate and integrate third-party anonymization and security solutions to protect sensitive data
- Provide strategic guidance on the evolution of the data platform to meet the company's growth and technical needs
- Design and implement scalable infrastructure for Large Language Model (LLM) operations, including training, fine-tuning, and inference workflows
- Collaborate with AI/ML teams to build and optimize LLM serving platforms for real-time and batch processing
- Develop monitoring and observability solutions for LLMs, ensuring model performance, cost-efficiency, and compliance with ethical AI guidelines
- Evaluate and integrate state-of-the-art LLM technologies into existing data platforms to enhance analytics and decision-making
Qualifications:
- Bachelor's or Master's Degree in Computer Science or equivalent experience
- 5+ years of industry experience in designing and building large-scale data platforms
- Strong expertise in SQL, Data Modeling, and Data Warehousing (Databricks, Snowflake, Redshift, BigQuery, etc.)
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Ellipsis Health
Senior Software Development Engineer in Test (SDET), Salesforce
San Francisco, USA
SeniorFull-time
Discovered 1 weeks agoView →
Senior Backend Engineer, Core Services
San Francisco, USA
Discovered YesterdayFull-time
Senior Full Stack Engineer
, USA
Discovered 1 weeks agoFull-time
Forward Deployed Product Manager, AI Assistant
, USA
Discovered 1 weeks agoFull-time
Senior Backend Developer
, USA
Discovered 1 weeks agoFull-time
Senior Backend Engineer (Python)
, USA
Discovered 1 weeks agoFull-time
AI Evaluations Engineer
, USA
Discovered 1 weeks agoFull-time
Senior Software Development Engineer in Test (SDET), Salesforce
San Francisco, USA
Discovered 1 weeks agoFull-time
Senior QA Engineer, Forward Deployed
San Francisco, USA
Discovered 1 weeks agoFull-time