IN_Senior Associate_AI Architect_Data and Analytics_Advisory_Bangalore

Role overview

ML pipeline architecture

• Design ML pipelines for experiment management, model management, feature management, and model retraining.
• Design APIs for model inferencing at scale.
• Use MLflow, SageMaker, Vertex AI, and Azure AI.

LLM serving and GPU architecture

• Work with GPU architectures and distributed training and serving of large language models.
• Apply model and data parallel training with DeepSpeed and vLLM.

Model optimization

• Fine-tune and optimize models to improve latency and accuracy.
• Reduce training and resource requirements for LLM and LVM fine-tuning.

DevOps and LLMOps

• Apply DevOps and LLMOps practices with Kubernetes, Docker, and container orchestration.