IN_Senior Associate_Gen AI_Data and Analytics_Advisory_Bangalore

Role overview

ML pipeline and inference

• Design pipelines for experiment management, model management, feature management, and model retraining.
• Design APIs for model inference at scale.

LLM serving and architecture

• Apply deep knowledge of GPU architectures to LLM serving and training.
• Use distributed training and serving approaches for large language models.
• Apply model and data parallel training with frameworks such as DeepSpeed and serving frameworks such as vLLM.

Fine-tuning and optimization

• Fine-tune and optimize models to improve latency and accuracy.
• Reduce training and resource requirements for fine-tuning LLM and LVM models.

DevOps and LLMOps