IN_Senior Associate_AI Architect_Data and Analytics_Advisory_Bangalore

Role Overview

Core Responsibilities

• Design ML pipelines for experiment management, model management, feature management, and model retraining.
• Design APIs for model inferencing at scale.
• Work with GPU architectures and distributed training and serving of large language models.
• Use DeepSpeed for model and data parallel training and vLLM for model serving.
• Fine-tune and optimize models to improve latency and accuracy and reduce training and resource requirements.
• Apply DevOps and LLMOps practices with Kubernetes, Docker, and container orchestration.
• Use LLM orchestration frameworks such as Flowise, Langflow, and Langgraph.

Required Technical Skills

• Required AI and LLM technologies include MLflow, SageMaker, Vertex AI, and Azure AI.
• The skill matrix includes Hugging Face OSS LLMs, GPT, Gemini, Claude, Mixtral, and Llama.