Senior Software Engineer - Big Data/ML Ops

Responsibilities:

• Leverage software engineering skills to build and deliver reliable, secure and scalable software solutions using modern cloud-based paradigms across different components in Truveta.
• Collaborate closely with partner teams inside & outside of Truveta.
• Show creativity and curiosity to build integration proof of concepts across the Truveta and partner ecosystems.
• Bring your curiosity, entrepreneurial spirit, and passion to deliver on the promise of technology in the difficult, competitive, and exciting industry of healthcare.
• We are seeking backend engineers who:
• Have proven experience building reliable, secure and scalable software solutions using modern cloud-based paradigms.
• Experience working with machine learning infrastructure, including scaling GPU resources to optimize model throughput and performance at large scale.
• Familiarity with vLLM and GPU optimization techniques to maximize compute utilization and improve inference efficiency.
• Have familiarities with LLMs and generative models for various applications.
• Good to have prior experiences with Agentic AI platform
• Utilize your expertise in deploying large-scale machine learning models in production environments.
• Are quick learners knowing how to iterate and evolve a distributed software solution while carefully balancing the needs of privacy, security and reliability against a changing product landscape.
• Have knowledge and experience in using and designing distributed systems, data pipelines, APIs and consumption experiences.
• Strict adherence to Truveta principles in support of ethical innovation.
• Willingness to commit to ongoing training on key topics like privacy, ethics, and security
• Key Qualifications:
• 5+ years of experience building production quality software in a team setting.
• 2+ years of experience working on modern cloud-native platforms and languages (AWS, GCP, Azure)
• Some familiarity with crafting modular APIs and building engaging and intuitive web experiences.