Hands-on, daily use of AI-assisted and agentic coding tools (e.g., Claude Code, Cursor, GitHub Copilot, autonomous coding agents) to write and refactor code, automate workflows, and optimize engineering processes.
Strong experience with Python, particularly in building REST APIs using frameworks like FastAPI.
Grounding in NLP and machine learning as they relate to building LLM systems
Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic)
Experience building, deploying, and securing MCP servers at scale.
Understanding of multi-agent systems and their applications in complex problem-solving scenarios.
Designing and implementing RAG systems end to end: vector databases, semantic search, retrieval quality, and chunking strategy.
Experience with distributed search and indexing technologies (e.g., Elasticsearch, OpenSearch, Solr)
Experience with prompt writing for various use cases
Experience with Java or confidence in agentic coding skills to develop in Java
Experience with generative solutions released to prod, at scale, beyond POCs
Proficiency with server-side events, event-driven architectures, and messaging systems.
Strong critical thinking and systems thinking skills, with experience debugging, optimizing, and making sound engineering decisions across complex backend systems, not just solving isolated problems.
Solid understanding of security best practices for backend systems, including authentication and data protection.
Nice-to-Have Skills
Experience with LLM guardrails
Experience with LLM Frameworks (e.g. LangChain, LlamaIndex)
Experience with LLM monitoring and observability
Experience developing AI/ML technologies within large and business critical applications
Building evaluation into LLM systems: eval harnesses, regression suites, LLM-as-judge, and offline/online quality metrics.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws. BCG is an E - Verify Employer. Click here for more information on E-Verify.
About Boston Consulting Group
Management Consulting33000 employeesFounded 1963
Global management consulting firm driving business transformation and strategy.