AI Ops - AI/ML Engineer

4+ years of experience in AI/ML engineering, data engineering, NLP, or a closely related field, including hands-on LLM work.

Production experience building and operating a vector database (pgvector, Pinecone, Weaviate, or equivalent).

Strong understanding of embedding models and how embedding quality affects retrieval accuracy.

Experience designing and operating data ingestion pipelines at scale (Celery, Airflow, or similar).

Demonstrated experience prompt engineering for production LLM systems requiring reliable structured outputs, not just chatbots or demos.

Experience building LLM evaluation frameworks, including golden test sets, judge prompts, and accuracy metrics.

Strong Python skills, including FastAPI, Pydantic, SQLAlchemy, and async patterns.

Clear understanding of how RAG context affects LLM reasoning and how to diagnose retrieval-driven errors.

Familiarity with semantic search concepts: cosine similarity, approximate nearest neighbor, and hybrid search.

Production experience with the Claude API (messages format, system prompts, structured output patterns) is a plus.

Experience with LLM output validation frameworks such as Pydantic or Guardrails is a plus.

Understanding of confidence calibration techniques (ECE, Platt scaling, temperature effects) is a plus.

Exposure to SRE or observability domains, and familiarity with multi-tenant architectures where tenant isolation is a hard requirement, is a plus.

Knowledge of re-ranking models (cross-encoders) and experience with Kubernetes/AWS EKS is a plus.

An inclusive culture strongly reflecting our core values: Act Like an Owner, Delight Our Customers and Earn the Respect of Others.

The opportunity to make an impact and develop professionally by leveraging your unique strengths and participating in valuable learning experiences.

Highly competitive compensation, benefits and rewards programs that encourage you to bring your best every day and be recognized for doing so.

An engaging, people-first work environment offering work/life balance, employee resource groups, and social events to promote interaction and camaraderie.

At FICO, you can develop your career with a leading organization in one of the fastest-growing fields in technology today – Big Data analytics. You’ll play a part in our commitment to help businesses use data to improve every choice they make, using advances in artificial intelligence, machine learning, optimization, and much more.

FICO makes a real difference in the way businesses operate worldwide:

• Credit Scoring — FICO® Scores are used by 90 of the top 100 US lenders.

• Fraud Detection and Security — 4 billion payment cards globally are protected by FICO fraud systems.

• Lending — 3/4 of US mortgages are approved using the FICO Score.

Global trends toward digital transformation have created tremendous demand for FICO’s solutions, placing us among the world’s top 100 software companies by revenue. We help many of the world’s largest banks, insurers, retailers, telecommunications providers and other firms reach a new level of success. Our success is dependent on really talented people – just like you – who thrive on the collaboration and innovation that’s nurtured by a diverse and inclusive environment. We’ll provide the support you need, while ensuring you have the freedom to develop your skills and grow your career. Join FICO and help change the way business thinks!

Learn more about how you can fulfil your potential at www.fico.com/Careers

FICO promotes a culture of inclusion and seeks to attract a diverse set of candidates for each job opportunity. We are an equal employment opportunity employer and we’re proud to offer employment and advancement opportunities to all candidates without regard to race, color, ancestry, religion, sex, national origin, pregnancy, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. Research has shown that women and candidates from underrepresented communities may not apply for an opportunity if they don’t meet all stated qualifications. While our qualifications are clearly related to role success, each candidate’s profile is unique and strengths in certain skill and/or experience areas can be equally effective. If you believe you have many, but not necessarily all, of the stated qualifications we encourage you to apply.

Information submitted with your application is subject to the FICO Privacy policy at https://www.fico.com/en/privacy-policy