Colorado, United States · Bangladesh · Brazil · Egypt · Ghana · India · Indonesia · Nigeria · Pakistan · Turkey · Vietnam
Offer Details
Total Number of Positions: 40
01Commitments Required: At least 8 hours per day and 40 hours per week, with 4 hours of overlap with PST.
02Engagement type: Contractor assignment/freelancer (no medical/paid leave).
Role Overview
01In this role, you will work on projects that improve and evaluate large language models by crafting challenging, competition-level mathematics problems and rigorously assessing model reasoning.
02The ideal candidate has a strong foundation in competitive mathematics at the AIME, HMMT, and IMO (Olympiad) level across the four classic pillars: Algebra, Number Theory, Combinatorics, and Geometry.
03You should be able to design novel, "Google-proof" problems intended to expose deep reasoning deficiencies in state-of-the-art models, and to diagnose precisely where and why a model's reasoning breaks down.
04The role combines original problem authoring, rigorous solution writing, and detailed evaluation of model-generated responses.
05This is your chance to future-proof your career in an AI-first world by working at the frontier of mathematical reasoning evaluation.
What does the day-to-day look like
01Design original, challenging mathematics problems at AIME, HMMT, and IMO difficulty that test the reasoning limits of large language models in multi-step, abstract settings, drawn strictly from Algebra, Number Theory, Combinatorics, or Geometry.
02Author novel prompts that "break" evaluated models, meaning the model arrives at an incorrect final answer; ensure problems cannot be bypassed via brute-force or computationally intensive methods.
03Solve problems independently and write detailed, logically structured, self-contained solutions with clear justifications, properly rendered in LaTeX.
04Review model-generated solutions, identify mathematical errors, logical fallacies, or missing arguments, and diagnose the root cause using defined failure categories (Final Answer, Reasoning Steps, Instruction Following).
05Contribute to defining new evaluation benchmarks across competition and Olympiad-level mathematics curricula.
06Classify each prompt accurately by domain, sub-domain, topic, and proficiency level within the labeling tool.
Requirements
01Mathematical Expertise: Strong command of competitive mathematics at the level of AIME, HMMT, and IMO across Algebra, Number Theory, Combinatorics, and Geometry.
02Writing Proficiency: Excellent structured written communication, including fluency with standard LaTeX delimiters for all mathematical expressions.
03Analytical Skills: Strong research and analytical skills, with the ability to construct rigorous, proof-based reasoning.
04Creative Thinking: Creative and lateral thinking abilities to design novel problems that are not adapted from existing competitions or online repositories.
05Feedback Skills: Ability to provide constructive feedback, precise annotations, and accurate error diagnosis on model outputs.
06Independence: Self-motivated and able to work independently in a remote setting.
07Technical Setup: Desktop/Laptop setup with a good internet connection.
Preferred Qualifications
01Candidates pursuing or holding a Bachelor’s/Master's degree in Mathematics, Applied Mathematics, Statistics, Engineering, or a related field are eligible and encouraged to apply.
02Prior experience in competitive mathematics (e.g., national or international Olympiads or equivalent competitive examinations) as a participant, coach, or problem setter is a bonus.
03Ability to analyze and solve complex problems with a structured, logical approach and to express solutions clearly and rigorously.
Perks of Freelancing
Work in a fully remote environment.
Opportunity to work on cutting-edge AI projects with leading LLM companies.
Potential for contract extension based on performance and project needs.