IN_Senior Associate_Gen AI_Data and Analytics_Advisory_Bangalore

Advisory role overview

ML and AI responsibilities

• Design ML pipelines for experiment management, model management, feature management, and model retraining.
• Design APIs for model inference at scale.
• Use MLflow, SageMaker, Vertex AI, and Azure AI in ML workflows.
• Apply GPU architecture knowledge to distributed training and serving of large language models.
• Use DeepSpeed for model and data parallel training and vLLM for model serving.
• Fine-tune and optimize models to improve latency and accuracy.
• Reduce training and resource requirements for LLM and LVM fine-tuning.
• Apply DevOps and LLMOps practices to AI systems.
• Use Kubernetes, Docker, and container orchestration technologies.
• Work with Flowise, Langflow, and LangGraph for LLM orchestration.

Technical skills

• Mandatory skills include generative AI, LLMs, Hugging Face, Python, PyTorch or TensorFlow/Keras, LangChain, LangGraph, Docker, and Kubernetes.
• The technology matrix includes Hugging Face OSS LLMs, GPT, Gemini, Claude, Mixtral, and Llama.