BENCHMARKS / VIDEO EDITING
TimelineBench.
Can AI agents complete real video editing jobs? Explore the results, comparisons, and research behind the benchmark.
- 56real editing jobs
- 16agent setups
- 896runs graded
- 43professional editors
Headline result · 896 runs
Agents say they’re done. Most aren’t.
93%
Ended with the agent claiming success
14.0%
Resolved [11.7, 16.4]
0100%
TimelineBench gave 16 agent setups 56 real editing jobs. Each is a whole job: raw footage, audio and a brief in, a finished cut out. A run resolves only if it passes hard checks on delivery, content and the brief, and a quality test calibrated on blind judgments by 43 professional editors.
From the paper
The human cut. The agent cut.
Professional editor
Codex - Skills off