Skip to content
OpenTrain AIFor AI Companies

The posting you looked for has closed.

Here are the open AI Code Evaluator roles.

Remote AI Code Evaluator jobs

AI code evaluator roles are AI training work for people who can read and judge code. Each open role below has its own page with the work, the requirements and the pay where listed.

  • 100% remote
  • Flexible hours
  • Hourly / per-task pay
  • 27 open roles

Open AI Code Evaluator roles

27 open roles

Hourly pay on these roles, where listed: $8–$200/hr

Member Technical Staff Coding Agent Research Evaluation

Evaluate coding agents, build benchmarks and datasets, study model failures, and improve evaluation tools. This part-time contractor role pays $8 to $9 per hour and requires English plus 3 years of relevant technical experience.

Coding Agent Evaluation & Benchmark DesignSoftware Engineering & PythonLLM & Agentic SystemsModel Failure Analysis & Experimentation
Coding & Software
Computer Code Programming
Remote · Argentina, Bangladesh, Bahrain +35 more
English
Part-time · Flexible
Hourly · $8–$9/hr

Posted Nov 17, 2026

SWE Bench Engineer C# Code Evaluation

Evaluate open-source C# code, tests, and bug-fixing tasks used to assess AI models. This remote contractor role pays $25 per label and requires fluent English, software engineering skills, and 20+ hours per week.

Coding & Software
Computer Code Programming
Remote · Argentina, Belize, Bolivia +20 more
English
Part-time · Flexible
Per task · $25/label

Posted Nov 10, 2026

SWE Bench Engineer (Java LLM Code Evaluation)

Work remotely on Java open-source repositories, testing code and evaluating how well language models solve realistic bugs. The one-month contract pays $25 per approved task and is open to contractors in Latin America.

Coding & Software
Computer Code Programming
Remote · Argentina, Belize, Bolivia +20 more
English
Part-time · Flexible
Per task · $25/label

Posted Nov 10, 2026

Coding Expert for AI Evaluation

Review code, documentation, and AI-generated software answers across Python, JavaScript, C++, Java, C, and SQL. This part-time contract role pays $20 to $45 per hour.

PythonJavaScriptC++
Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $20–$45/hr

Posted Nov 10, 2026

Full-Stack Software Engineer, Testing & Evaluation

Build realistic full-stack software projects, coding challenges, Docker workflows, and deterministic tests for AI evaluation. This remote contract role pays $75 per hour and requires English fluency plus software engineering experience.

Coding & Software
Computer Code Programming
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $75/hr

Posted Nov 8, 2026

Architecture and Building Code Expert for AI Evaluation

Review AI responses against US architecture, building, accessibility, energy, and fire codes using real construction documents. This remote contract offers flexible project-based work and pays up to $62.50 per hour.

Generative AI & RLHF
Document
Remote · United States
English
Flexible hours
Hourly · $62.5/hr

Posted Nov 7, 2026

Senior Software Engineer for AI Data Evaluation (India)

Evaluate coding agents on real software tasks, review generated code, and explain technical failures. This ongoing India contract pays up to $60 per hour with flexible scheduling and weekly payment.

Coding & Software
Computer Code Programming
Remote · India
English
Part-time · Flexible
Hourly · $60/hr

Posted Nov 7, 2026

Software and ML Engineer, LLM Systems Evaluation

Evaluate frontier AI models on LLM inference, GPU optimization, custom kernels, and model-serving systems for $125 per hour on a flexible, part-time contract. Apply through OpenTrain, then complete the hiring site application.

Coding & Software
Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $125/hr

Posted Nov 7, 2026

Senior Python Engineer, LLM Code Evaluation (US)

Review AI-generated code and programming examples, apply project guidelines, and explain your judgments. This U.S.-based role requires 20 or more hours per week and strong Python and software engineering skills.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Senior Software Engineer, LLM Code Evaluation

Evaluate and improve code generated by large language models, build verification tools, and assess software engineering skills across the development lifecycle. This flexible contractor role requires 20 or more hours per week in the United States.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer AI Research & Evaluation (US-Based)

Evaluate and improve AI-generated code across full-stack applications, Python and machine learning workflows, and multiple programming languages. This flexible US-based contractor role requires 20+ hours per week and starts with a one-month engagement.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer, AI Research & Evaluation (US-Based)

Create coding datasets and assess AI-generated software for correctness, performance, scalability, and reliability. This US-based contractor role offers a flexible schedule of 20 or more hours per week.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer, AI Research and Evaluation (US-Based)

Create and assess code datasets for AI systems, reviewing generated implementations for correctness, performance, scalability, and reliability. This US-based contract role requires at least three years of software engineering experience and 20+ hours a week.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer, AI Research and Code Evaluation

Evaluate and improve AI-generated software across full-stack applications, APIs, and machine learning systems in a flexible US-based contractor role. Apply through OpenTrain to help build code datasets and software benchmarks.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer AI Research And Evaluation (US)

Build and assess coding datasets for AI systems as a US-based Software Engineer contractor. The role involves evaluating AI-generated code and requires 20+ hours each week plus at least three years of software engineering experience.

Coding & Software
Computer Code Programming
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026

Software Engineer, AI Code Evaluation ($200 per Hour)

Evaluate AI-generated code, build Python verification tools, and improve programming datasets for AI models. This remote U.S. contractor role pays $200 per hour for 10 to 40 flexible hours weekly.

Coding & Software
Computer Code Programming
Remote · United States
English
Flexible hours
Hourly · $200/hr

Posted Nov 6, 2026

Software Engineer AI Response Evaluator

Review AI-generated software engineering answers for technical accuracy, feasibility, and production quality. This flexible, remote US contract pays up to $150 per hour and uses your software engineering expertise to improve AI systems.

Coding & Software
Text
Remote · United States
English
Flexible hours
Hourly · $150/hr

Posted Sep 30, 2026

Full-Stack Engineer

Build, debug, and review full-stack software for AI code evaluation. This part-time role is open to English-fluent candidates in multiple countries and pays $50 to $100 per hour equivalent, paid per task that meets the project specifications.

PythonReactJavaScriptJAVANode.jsRust
Coding & Software
Computer Code Programming
Remote · Mexico, Philippines, United States
English
Part-time · Flexible
Mid-Senior level
Per task · $50–$100/hr equivalent

Posted Sep 16, 2026

C/C++ Developer, AI Training & Code Evaluation (English)

Evaluate and improve AI-generated software in C/C++ and related languages. This flexible contractor role requires 20+ hours weekly and is open to candidates in the United States, Canada, and selected European countries.

Coding & Software
Computer Code Programming
Remote · Austria, Belgium, Canada +8 more
English
Part-time · Flexible

Posted Aug 6, 2026

Go (Golang) Developer AI Training Code Evaluation

Use Go and your software engineering judgment to create, correct, and evaluate code for AI training. This flexible contractor role includes work across full-stack development and production software workflows.

Coding & Software
Computer Code Programming
Remote · Austria, Belgium, Canada +8 more
English
Part-time · Flexible

Posted Aug 5, 2026

Rust Developer AI Training And Code Evaluation

Create Rust code datasets, fix and review software, and evaluate AI-generated code. This remote contractor role requires 20+ hours per week and is open across the United States, Canada, and selected European countries.

Coding & Software
Computer Code Programming
Remote · Austria, Belgium, Canada +8 more
English
Part-time · Flexible

Posted Aug 5, 2026

Java Developer AI Training and Code Evaluation

Use your Java and software engineering skills to curate training examples, test solutions, and evaluate AI-generated code. This flexible contract runs 20+ hours per week and starts with 1 month.

Coding & Software
Computer Code Programming
Remote · Austria, Belgium, Canada +8 more
English
Part-time · Flexible

Posted Aug 5, 2026

Full-Stack Code Evaluation Engineer (Node.js and React)

Review AI-generated full-stack code, system designs, and technical explanations using Node.js, React, and TypeScript. Remote contractor work offers 20+ hours per week, with rates up to $100 per hour in Germany and the United States and up to $60 in India.

Coding & Software
Computer Code Programming
Remote · Germany, India, United States
English
Part-time · Flexible
Hourly · $60–$100/hr

Posted Jul 8, 2026

Create a free OpenTrain account to apply and get matched to future roles.

Create a free account