indeed
Principal Software Engineer - AI Foundations
JPMorganChase
Jersey City, USA
Full-time
Onsite
USD 204250-285000 yearly
Discovered 1 weeks ago
Software engineeringPythonJavaScalaGoLLM inference
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
Software engineeringPythonJava
Role Overview
Serve as a Principal Software Engineer within JPMorganChase's Chief Data and Analytics Office.
Lead the design and evolution of an enterprise GenAI serving platform focused on reliable, cost-effective AI capabilities.
Influence leaders and senior stakeholders across business, product, and technology to drive alignment and outcomes.
Key Skills for This Role
Software engineeringPythonJavaScalaGoLLM inference
Full Job Posting
Role overview
Serve as a Principal Software Engineer within JPMorganChase's Chief Data and Analytics Office.
Lead the design and evolution of an enterprise GenAI serving platform focused on reliable, cost-effective AI capabilities.
Influence leaders and senior stakeholders across business, product, and technology to drive alignment and outcomes.
Responsibilities
- Design and operate high-throughput, low-latency LLM serving across GPU and CPU fleets.
- Build a GenAI Gateway and inference API layer with access control, routing, quotas, policy hooks, and observability.
- Develop intelligent model routing across multiple model backends with configurable policies and guardrails.
- Optimize GPU serving, memory management, KV caching, model acceleration, quantization, and throughput.
- Design disaggregated serving and distributed inference architectures to improve utilization and tail latency.
- Create secure production code, reusable platform components, SDK integrations, and operational tooling.
- Establish SLOs and SLAs, capacity planning, incident response, benchmarking, and performance and cost observability.
- Architect governed agentic AI engineering workflows with validation, security, resiliency, and reuse guardrails.
Required qualifications
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at JPMorganChase
Control Manager Program - Vice President - Finance Control Management
, IND
Full-time
Discovered TodayView →
Java Lead Software Engineer
Glasgow, GBR
Discovered TodayFull-time
Control Manager Program - Vice President - Finance Control Management
, IND
Discovered TodayFull-time
Payment Lifecycle Manager - Vice President
, IND
Discovered TodayFull-time
Trade Lifecycle Manager - Vice President
, IND
Discovered TodayFull-time
Asset and Wealth Management Audit Manager (Vice President)
, IND
Discovered TodayFull-time
Associate - Business Manager
, IND
Discovered TodayFull-time
Senior Product Delivery Associate
, IND
Discovered TodayFull-time
Lead Software Engineer - Lead Data Architect
, IND
Discovered TodayFull-time