Aiden contributed seven accepted records in OpenAI’s Parameter Golf challenge. Explore the experiments, results, and human contributions in the research write-up.
An outer loop rewrote our research agent over 100 steps and outperformed two years of manual development on the evaluated tasks. Read the methods and limitations in the full report.
Autoresearch for your team
Pursue more ambitious research with your current team.
16–40×effective experiment throughput per researcher.*
Forecasting and signals
Test different approaches to predictive modeling, whether that’s an LLM harness, heuristics, or an ML model built from scratch.
Build on the findings with each data refresh and earnings season.
RL environments and synthetic data
Optimize the pipeline that generates your RL environments or synthetic data, balancing constraints like difficulty, novelty, and diversity.
Extend the work with each new model release and training cycle.
Fraud and credit modeling
Optimize the model and how flagged cases are handled. Find better trade-offs between missed cases, false positives, and review cost.
Keep models effective as data and risk patterns change.
*Parameter Golf scenario estimate based on accepted leaderboard records and assumed human effort. Not measured experiment throughput.
How the estimate is calculated
This is a sensitivity calculation of accepted leaderboard records per assumed person-day, not a measured experiment-throughput gain or a controlled productivity result.
The published Parameter Golf write-up reports 7 accepted records from Aiden, 47 overall, 1,016 entrants, and 22 days of Aiden operation. Removing Aiden leaves 40 accepted records across 1,015 other entrants.
Assume one ML engineer operated Aiden for 22 full-time-equivalent days, and each other entrant spent an average of 2–5 full-time-equivalent days. These labor assumptions have not been measured; other entrants may also use AI tools.
Relative output rate: (7 / 22) ÷ [40 / (1,015 × d)]. At d = 2, this is 16.15×; at d = 5, 40.37×. The range reflects assumed effort, not a statistical confidence interval. Actual human effort, participant activity, and the operator’s output without Aiden are unknown. Record counts do not capture differences in the value of discoveries.