Software Engineer (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Hire Feed seeks a Software Engineer for AI Code Evaluation & Benchmarking to assess AI-generated code, validate solutions, and create evaluation datasets. The role requires 3+ years of software engineering experience and strong proficiency in languages like Python, Java, or C/C++.
Key Skills for This Role
Responsibilities
- Review and evaluate AI generated code for correctness, efficiency, maintainability, and adherence to requirements.
- Analyze software engineering tasks and validate whether proposed solutions meet expected outcomes.
- Debug code, reproduce issues, and verify fixes across different programming environments.
- Assess model generated explanations, reasoning, and implementation approaches for technical accuracy.
- Create, refine, and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks.
Requirements
- Bachelor's or master's degree in computer science, software engineering, or a related technical field
- 3+ years of professional software engineering experience
- Strong proficiency in one or more programming languages, such as Python, Java, C/C++, Go, Swift, Objective C, PHP, or SQL
- Strong understanding of data structures, algorithms, software design principles, and debugging methodologies
- Experience performing code review and identifying edge cases, failure modes, and areas where AI systems struggle with software engineering problems
Full Job Posting
Role Overview
- We are hiring for one of our clients, seeking a Software Engineer – AI Code Evaluation & Benchmarking (US candidates only) to work on a full time basis. This role involves evaluating and benchmarking the coding capabilities of advanced AI models to ensure their accuracy, efficiency, and reliability.
Key Responsibilities
- Review and evaluate AI generated code for correctness, efficiency, maintainability, and adherence to requirements.
- Analyze software engineering tasks and validate whether proposed solutions meet expected outcomes.
- Debug code, reproduce issues, and verify fixes across different programming environments.
- Assess model generated explanations, reasoning, and implementation approaches for technical accuracy.
- Create, refine, and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks.
Required Skills & Qualifications
- Bachelor's or master's degree in computer science, software engineering, or a related technical field.
- 3+ years of professional software engineering experience.
- Strong proficiency in one or more programming languages, such as Python, Java, C/C++, Go, Swift, Objective C, PHP, or SQL.
- Strong understanding of data structures, algorithms, software design principles, and debugging methodologies.
- Experience performing code review and identifying edge cases, failure modes, and areas where AI systems struggle with software engineering problems.
More About the Opportunity
- This role offers a unique opportunity to work with a global leader in the AI industry, contributing to the advancement of large language models through high quality human feedback and evaluation.
- The position is ideal for engineers who enjoy code review, debugging, problem solving, and applying strong software engineering judgment to complex technical scenarios.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
Research Analyst (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Research Analyst for a client to work on fine-tuning large language models. The role involves reading, summarizing, and breaking down content, conducting online research, and validating claims. Requ
Machine Learning Analyst (Remote)
Abu Dhabi, UAE
Role: Machine Learning Analyst (Remote) Location: Remote (Work from Anywhere) Job Type: Part-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a MLE Bench – Dat
Technical Content Writer (Remote)
Abu Dhabi, UAE
Hiring a part-time Technical Content Writer to produce clear technical documentation and support data-driven work using JSON and public datasets. Requires 3+ years of experience in technical writing, analysis, or softwar
Analytical Chemist (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Chemistry Expert (PhD/Master's) to work on fine-tuning large language models by creating and solving advanced chemistry problems. The role requires strong analytical skills, proficiency in organic c
SQL Developer (Remote)
Abu Dhabi, UAE
We are hiring a SQL Developer for a contract role. You will design, develop, and maintain SQL-based solutions, optimize database performance, and collaborate with cross-functional teams. Proficiency in SQL, query optimiz
Biologist (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Biology Expert (PhD/Master's) to design and solve biology problems for evaluating large language models. The role involves creating high-quality solutions, collaborating with LLM researchers, and de
ML Engineer (Remote)
Abu Dhabi, UAE
Role : ML Engineer (Remote) Location : Remote (Work from Anywhere) Job Type : Part-Time Payout : Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a MLE Bench – ML Engineers
Business Analyst - Arabic Language (Remote)
Abu Dhabi, UAE
Role: Business Analyst - Arabic Language (Remote) Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a Busin
Research Analyst (Remote)
Abu Dhabi, UAE
Machine Learning Analyst (Remote)
Abu Dhabi, UAE
Technical Content Writer (Remote)
Abu Dhabi, UAE
Analytical Chemist (Remote)
Abu Dhabi, UAE
SQL Developer (Remote)
Abu Dhabi, UAE
Biologist (Remote)
Abu Dhabi, UAE
ML Engineer (Remote)
Abu Dhabi, UAE
Business Analyst - Arabic Language (Remote)
Abu Dhabi, UAE