IN_Senior Associate_AI Architect_Data and Analytics_Advisory_Bangalore

Role overview

Responsibilities

• Design ML pipelines for experiment management, model management, feature management, and model retraining.
• Design APIs for model inferencing at scale.
• Develop distributed training and serving solutions for large language models using GPU architectures.
• Fine-tune and optimize LLM and LVM models to improve latency, accuracy, and resource efficiency.
• Apply DevOps and LLMOps practices using Kubernetes, Docker, and container orchestration.
• Use LLM orchestration frameworks such as Flowise, Langflow, and LangGraph.

Mandatory requirements

• 8-16 years of professional experience is required.
• A B.Tech, MCA, BCA, or M.Tech qualification is required.
• Expertise with MLflow, SageMaker, Vertex AI, and Azure AI is required.
• Deep knowledge of GPU architectures and distributed LLM training and serving is required.
• Proficiency with DeepSpeed, vLLM, model fine-tuning, Kubernetes, and Docker is required.