Base Career helps you apply smarter for this job.
Key skills for this role
Design, build, and evolve agentic AI systems that reason, plan, execute, and adapt in production environments.
Take AI-driven features from concept to production in a true 0–1 product environment.
Write and review high-quality production code (Python-first) across AI pipelines, inference services, orchestration layers, and supporting systems.
Implement prompt engineering, tool use, memory, evaluation, and guardrails as first-class engineering concerns, not experiments.
Design agent frameworks that balance autonomy with determinism, observability, and safety.
Make pragmatic architectural trade-offs across latency, cost, accuracy, scalability, and maintainability.
Integrate and operate LLMs (commercial and/or open-source) including model selection, fine-tuning strategies, embeddings, retrieval (RAG), and inference optimization.
Address real-world issues: hallucinations, drift, prompt regressions, failure modes, and customer trust.
Deploy and operate AI services across cloud platforms (AWS, Azure, GCP), including secure enterprise integrations and customer-specific deployments.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
Houston, USA
Cary, USA
Cary, USA
, USA
Houston, USA
Cary, USA
Dallas, USA
Cary, USA
, USA
, GBR
Santa Clara, USA
, USA
Design scalable inference and orchestration architectures using containers, APIs, and distributed systems.
Ensure the platform is shippable, debuggable, and supportable — not fragile or research-grade.
Act with founder-level ownership: identify gaps, propose solutions, and move forward without waiting for perfect requirements.
Agent frameworks and orchestration
Prompt engineering and tool-use patterns
RAG architectures and vector search
Model evaluation, feedback loops, and monitoring
Safety, guardrails, and enterprise controls
LangGraph and/or LangChain
LlamaIndex
Vector databases (e.g., Pinecone, Weaviate, FAISS, Milvus)
Prompt engineering as a managed, versioned, testable artifact
Experience deploying and operating LLMs using: -AWS SageMaker, Vertex AI, or equivalent managed platforms. Direct API integrations (OpenAI, Anthropic)
Experience designing multi-agent systems or complex agent workflows.
Experience commercializing AI features under enterprise constraints (security, compliance, uptime).
Comfort operating in ambiguity and making decisions with incomplete information.
BMC’s culture is built around its people. We have 6000+ brilliant minds working together across the globe. You won’t be known just by your employee number, but for your true authentic self. BMC lets you be YOU!
If after reading the above, You’re unsure if you meet the qualifications of this role but are deeply excited about BMC and this team, we still encourage you to apply! We want to attract talents from diverse backgrounds and experience to ensure we face the world together with the best ideas!
BMC is committed to equal opportunity employment regardless of race, age, sex, creed, color, religion, citizenship status, sexual orientation, gender, gender expression, gender identity, national origin, disability, marital status, pregnancy, disabled veteran or status as a protected veteran. If you need a reasonable accommodation for any part of the application and hiring process, visit the accommodation request page.
( Returnship@BMC )
Had a break in your career? No worries. This role is eligible for candidates who have taken a break in their career and want to re-enter the workforce. If your expertise matches the above job, visit to https://bmcrecruit.avature.net/returnship know more and how to apply.
Private American enterprise software company that orchestrates workflows across cloud, mainframe, and hybrid IT for large enterprises.
Visit company websiteJobs and hiring trendsINR 2549100-4248500 yearly / year
Full-time
Senior · 10+ years experience
Hybrid
Apply faster on company sites with our extension.