Software Engineer – Python (Remote)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Hire Feed is hiring a Senior Software Engineer – Python for a client to build verifiable software engineering tasks based on public repository histories for LLM evaluation. Responsibilities include analyzing GitHub issues, setting up code repositories, and evaluating unit test coverage.
Key Skills for This Role
Responsibilities
- Analyze and triage GitHub issues across trending open source libraries to assess LLM performance in bug fixing scenarios
- Set up and configure code repositories, including Dockerization and environment setup, for evaluation purposes
- Evaluate unit test coverage and quality in public repositories to ensure robust dataset validation
- Modify and run codebases locally to assess how LLMs interact with real world software projects
- Collaborate with researchers to identify repositories and issues that present challenges for LLMs, expanding dataset coverage
Requirements
- Minimum 3+ years of overall software engineering experience with strong Python proficiency
- Hands on experience with Git, Docker, and basic software pipeline setup for repository evaluation
- Ability to navigate and understand complex codebases, including open source projects
Full Job Posting
Role Overview
- We are hiring for one of our clients, seeking a Senior Software Engineer – Python (LLM Evaluation & Repository Validation) to work on a part time basis.
- The role involves building verifiable software engineering tasks based on public repository histories using synthetic approaches with human in the loop validation.
- The projects focus on creating LLM evaluation and training datasets for realistic software engineering problems.
Key Responsibilities
- Analyze and triage GitHub issues across trending open source libraries to assess LLM performance in bug fixing scenarios.
- Set up and configure code repositories, including Dockerization and environment setup, for evaluation purposes.
- Evaluate unit test coverage and quality in public repositories to ensure robust dataset validation.
- Modify and run codebases locally to assess how LLMs interact with real world software projects.
- Collaborate with researchers to identify repositories and issues that present challenges for LLMs, expanding dataset coverage.
Required Skills & Qualifications
- Minimum 3+ years of overall software engineering experience with strong Python proficiency.
- Hands on experience with Git, Docker, and basic software pipeline setup for repository evaluation.
- Ability to navigate and understand complex codebases, including open source projects.
- Experience contributing to or evaluating open source projects is a plus.
- Comfort with running, modifying, and testing real world projects locally in development environments.
More About the Opportunity
- This role offers a unique opportunity to work on cutting edge AI projects with leading LLMs, contributing to advancements in AI assisted software development.
- The work involves blending practical software engineering with AI research to shape the future of developer tools.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Hire Feed
Research Analyst (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Research Analyst for a client to work on fine-tuning large language models. The role involves reading, summarizing, and breaking down content, conducting online research, and validating claims. Requ
Machine Learning Analyst (Remote)
Abu Dhabi, UAE
Role: Machine Learning Analyst (Remote) Location: Remote (Work from Anywhere) Job Type: Part-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a MLE Bench – Dat
Technical Content Writer (Remote)
Abu Dhabi, UAE
Hiring a part-time Technical Content Writer to produce clear technical documentation and support data-driven work using JSON and public datasets. Requires 3+ years of experience in technical writing, analysis, or softwar
Analytical Chemist (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Chemistry Expert (PhD/Master's) to work on fine-tuning large language models by creating and solving advanced chemistry problems. The role requires strong analytical skills, proficiency in organic c
SQL Developer (Remote)
Abu Dhabi, UAE
We are hiring a SQL Developer for a contract role. You will design, develop, and maintain SQL-based solutions, optimize database performance, and collaborate with cross-functional teams. Proficiency in SQL, query optimiz
Biologist (Remote)
Abu Dhabi, UAE
Hire Feed is hiring a Biology Expert (PhD/Master's) to design and solve biology problems for evaluating large language models. The role involves creating high-quality solutions, collaborating with LLM researchers, and de
ML Engineer (Remote)
Abu Dhabi, UAE
Role : ML Engineer (Remote) Location : Remote (Work from Anywhere) Job Type : Part-Time Payout : Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a MLE Bench – ML Engineers
Business Analyst - Arabic Language (Remote)
Abu Dhabi, UAE
Role: Business Analyst - Arabic Language (Remote) Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a Busin
Research Analyst (Remote)
Abu Dhabi, UAE
Machine Learning Analyst (Remote)
Abu Dhabi, UAE
Technical Content Writer (Remote)
Abu Dhabi, UAE
Analytical Chemist (Remote)
Abu Dhabi, UAE
SQL Developer (Remote)
Abu Dhabi, UAE
Biologist (Remote)
Abu Dhabi, UAE
ML Engineer (Remote)
Abu Dhabi, UAE
Business Analyst - Arabic Language (Remote)
Abu Dhabi, UAE