AI Code Reviewer – Python | LLM Evaluation Project

Hello,

Greetings from ZettaMine!!!

Full-Time Opportunity: We are hiring AI Code Reviewer – Python | LLM Evaluation Project to work on an exciting AI Code Evaluation Project, contributing to the evaluation and improvement of next-generation AI coding models.

Eligible Locations: 🇳🇬 Nigeria | 🇪🇬 Egypt | 🇬🇭 Ghana | 🇧🇩 Bangladesh | 🇹🇷 Turkey | 🇲🇽 Mexico | 🇦🇷 Argentina | 🇧🇷 Brazil | 🇨🇱 Chile | 🇨🇴 Colombia | 🇵🇪 Peru

Role: AI Code Reviewer – Python | LLM Evaluation Project

Experience: Minimum 2+ Years

Mode: Remote

Start: Immediate

Mandatory Eligibility Criteria

Technical Qualification:

• Minimum 2+ years of overall professional experience.
• Strong hands-on experience in Python programming.
• Proficiency in Git, Docker, and basic software pipeline setup.
• Ability to understand, navigate, and analyze complex codebases.
• Comfortable running, modifying, and testing real-world software projects locally.
• Experience with software development, debugging, and code evaluation.
• Ability to analyze and triage issues across public GitHub repositories.
• Knowledge of unit testing, test coverage, and code quality evaluation.
• Experience contributing to or evaluating open-source projects is an added advantage.

Good to Have:

• Previous participation in LLM research or AI evaluation projects.
• Experience building or testing developer tools and automation agents.
• Familiarity with high-quality public GitHub repositories and open-source libraries.

Availability Requirements

• Available to work a minimum of 40 hours per week (8 hours per day).
• Must have at least 4 hours of working-hour overlap with PST.
• Immediate availability for remote contract work.
• Willingness to work in a fast-paced project environment.

What You'll Work On:

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and development environment setup.
• Evaluate unit test coverage and overall test quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Review and evaluate AI-generated code for quality, functionality, and correctness.
• Identify challenging repositories and issues for LLM evaluation.
• Collaborate with researchers to design and identify complex coding tasks.
• Assess software engineering workflows and identify potential issues.
• Work with real-world codebases to evaluate AI model capabilities.

Project & Payment Details

• Working Hours: 40 hours per week.
• Payment: $25 per approved task.
• Average Handling Time: 45–60 minutes per task.
• Work Mode: Fully Remote.

Perks of Freelancing:

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects.
• Gain exposure to advanced LLM research and evaluation projects.
• Collaborate with researchers and software engineering professionals.

Interested candidates: Please share your updated CV at: vyshnavi.e@zettamine.com

Thanks & Regards,

Vyshnavi E

ZettaMine