IN_Senior Associate_Gen AI_Data and Analytics_Advisory_Bangalore

Role overview

ML pipeline design

• Design ML pipelines for experiment management, model management, feature management, and model retraining.
• Design APIs for model inferencing at scale.

LLM serving and optimization

• Work with GPU architectures and distributed training and serving of large language models.
• Apply model and data parallel training with DeepSpeed and vLLM.
• Fine-tune and optimize models to improve latency and accuracy.
• Reduce training and resource requirements for LLM and LVM fine-tuning.

DevOps and LLMOps

• Apply DevOps and LLMOps practices with Kubernetes, Docker, and container orchestration.
• Use Flowise, Langflow, and LangGraph for LLM orchestration.

Required skills

• Generative AI, large language models, Hugging Face, Python, PyTorch, LangChain, LangGraph, Docker, and Kubernetes are listed as mandatory skills.

Additional technology areas

• The skill matrix includes MLflow, SageMaker, Vertex AI, Azure AI, AWS, Azure, GCP, SQL, JavaScript, databases, observability tools, and cloud platforms.
• Machine learning, SQL, and data science are listed as preferred skills.
• Cloud certifications are listed as a bonus.

Experience and education

• At least 3 years of experience is required.
• The education qualification lists BE, B.Tech, MBA, or MCA.