{bc}
linkedin

AI Research Engineer (Pre-training - LLM & Multi-Modal)

Tether.io
Abu Dhabi, UAE
Full Time
Senior
1 months ago
Large Language ModelsMulti Modal ModelsPre trainingPyTorchHugging FaceDistributed Training
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

Large Language ModelsMulti Modal ModelsPre training
Smart Apply

Full Job Posting

About The Job

  • As a member of the AI model team, you will drive innovation in architecture development for cutting edge models of various scales, including small, large, and multi modal systems.
  • Your work will enhance intelligence, improve efficiency, and introduce new capabilities to advance the field.
  • You will have deep expertise in LLM and Multi Modal architectures, a strong grasp of pre training optimization, and a hands on, research driven approach.

Responsibilities

  • Large Scale Pre Training: Conduct foundational pre training for LLMs and Multi Modal models on large, distributed servers with multi nodes and thousands of NVIDIA GPUs.
  • Architecture & Alignment Innovation: Design, prototype, and scale innovative architectures, tokenizers, and cross modal alignment layers.
  • Data Strategy: Source, filter, and curate massive scale textual and multi modal datasets, establishing robust data pipelines.
  • Experimental Research: Independently and collaboratively execute experiments, analyze results, and refine training methodologies.
  • Optimization & Debugging: Investigate, debug, and eliminate bottlenecks in model efficiency and computational performance.
  • System Scalability: Contribute to the advancement of distributed training systems for seamless scalability and hardware efficiency.

Qualifications

  • A degree in Computer Science or related field. Ideally PhD in NLP, Machine Learning, or related field with good publications in A* conferences.
  • Hands on experience contributing to large scale LLM or Multi Modal pre training runs on large distributed servers with thousands of NVIDIA GPUs.
  • Familiarity and practical experience with large scale distributed training frameworks, libraries, and tools.
  • Deep knowledge of state of the art transformer and non transformer modifications aimed at enhancing intelligence, efficiency, and scalability.
  • Strong expertise in PyTorch and Hugging Face libraries with practical experience in model development, continual pretraining, and deployment.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Tether.io