Software Engineer – AI Evaluation (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
We are seeking a Senior Software Engineer for LLM Evaluation to create datasets for training and benchmarking large language models. The role involves curating code examples, refining AI-generated code, and designing verification mechanisms.
Key Skills for This Role
Responsibilities
- Curate code examples, provide precise solutions, and make corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go
- Evaluate and refine AI generated code for efficiency, scalability, and reliability
- Collaborate with cross functional teams to enhance enterprise level AI driven coding solutions against industry benchmarks
- Build verification agents to assess code quality and identify error patterns
- Hypothesize on software engineering lifecycle steps and evaluate model capabilities against them
Requirements
- Several years of software engineering experience (3 years or more)
- Strong expertise in building full stack applications and deploying scalable, production grade software
- Deep understanding of software engineering principles including prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, and operational maintenance
- Proficiency in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go
- Experience designing verification mechanisms for automated solution validation
Full Job Posting
Role Overview
- We are hiring for one of our clients, seeking a Senior Software Engineer – LLM Evaluation (US/Canada/WEU based) to work on a part time basis.
- You will create cutting edge datasets for training, benchmarking, and advancing large language models while collaborating closely with researchers.
- This includes curating code examples, refining AI generated code, and designing verification mechanisms for software engineering tasks.
Key Responsibilities
- Curate code examples, provide precise solutions, and make corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
- Evaluate and refine AI generated code for efficiency, scalability, and reliability.
- Collaborate with cross functional teams to enhance enterprise level AI driven coding solutions against industry benchmarks.
- Build verification agents to assess code quality and identify error patterns.
- Hypothesize on software engineering lifecycle steps and evaluate model capabilities against them.
Required Skills & Qualifications
- Several years of software engineering experience (3 years or more).
- Strong expertise in building full stack applications and deploying scalable, production grade software.
- Deep understanding of software engineering principles including prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, and operational maintenance.
- Proficiency in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
- Experience designing verification mechanisms for automated solution validation.
More About the Opportunity
- This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet | IT Services and IT Consulting | Data Infrastructure and Analytics | Research Services industry.
- Contributing to the advancement of frontier AI systems.
- The position supports customers in accelerating research and transforming AI proofs of concept into proprietary intelligence.
Equal Opportunity Employer
- We hire based on skills and expertise.
- All qualified candidates are welcome regardless of background, experience, or prior employment history.
- Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
Image/Video Annotator (Remote)
Abu Dhabi, UAE
Role : Image/Video Annotator (Remote) Location : Remote (Work from Anywhere) Job Type : Part-Time Payout : Competitive, based on experience Role Overview: We are hiring for one of our clients to assist in advancing la
Senior Full Stack Developer (Remote)
Abu Dhabi, UAE
Role : Senior Full Stack Developer (Remote) Location : Remote (Work from Anywhere) Job Type : Contract Payout : $30 - $130/hour Role Overview: We are hiring for one of our clients, seeking a Senior Full Stack Develope
UI Engineer (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a UI Engineer for a contract role with one of its clients. You will build and maintain user interface components, collaborate with designers, and ensure cross-browser compatibility. Requires proficien
Software Developer - Python (Remote)
Abu Dhabi, UAE
Hire Feed is seeking a Software Developer - Python for a contract role with one of its clients. You will design, develop, test, and maintain software solutions, collaborating with cross-functional teams. Requires profici
Mathematics Expert (Remote)
Abu Dhabi, UAE
Hire Feed seeks a Mathematics Expert (Master's/Ph.D.) to work part-time on projects improving large language models through advanced mathematical reasoning. Requires proficiency in number theory, combinatorics, probabili
Physics Specialist (Remote)
Abu Dhabi, UAE
We are hiring a Physics Expert (PhD/Master's) to design and solve challenging physics problems to evaluate large language models. You will create step-by-step solutions with detailed reasoning and collaborate with LLM re
Research Analyst (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Research Analyst for a client to work on fine-tuning large language models. The role involves reading, summarizing, and breaking down content, conducting online research, and validating claims. Requ
Machine Learning Analyst (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Machine Learning Analyst for a part-time remote role. The position involves analyzing structured and unstructured datasets, defining metrics, and supporting ML evaluation workflows. Candidates need
Image/Video Annotator (Remote)
Abu Dhabi, UAE
Senior Full Stack Developer (Remote)
Abu Dhabi, UAE
UI Engineer (Remote)
Abu Dhabi, UAE
Software Developer - Python (Remote)
Abu Dhabi, UAE
Mathematics Expert (Remote)
Abu Dhabi, UAE
Physics Specialist (Remote)
Abu Dhabi, UAE
Research Analyst (Remote)
Abu Dhabi, UAE
Machine Learning Analyst (Remote)
Abu Dhabi, UAE