LLM Evaluation Analyst (English)

You will evaluate written content and large language model outputs to help improve how models reason and answer questions. The work combines text review, research, logical problem solving, feedback, and careful judgment.

• Read, summarize, and divide large pieces of content into smaller logical sections.
• Answer analytical questions and create scenarios that reveal weaknesses in model reasoning.
• Research information online and validate claims made in written content.
• Correct inaccurate model answers and explain the reasoning behind accurate answers.
• Analyze examples such as sales trends across locations and rule-based logic problems.
• Provide constructive feedback and detailed annotations focused on text accuracy and formatting.

The work requires strong English reading and writing skills, analytical judgment, and the ability to work independently.

• Time: 20+ hours per week.
• Language: High-level English reading and writing comprehension.
• Skills: Research, analytical thinking, logical reasoning, basic arithmetic, creative thinking, and clear explanations.
• Tools and setup: Familiarity with Excel and Google Suite, plus a reliable computer and internet connection.