BuilderWars

Coding · benchmark

LiveCodeBench

Test code generation on programming problems with explicit time windows.

What it measures

Pass@1 (%)

Problem dates, model release dates and contamination flags matter.

Public evaluation code. Check upstream code and dataset terms.

Open source / dataset · Run instructions · Official results

Reported ranking tracks

Explore all evaluations · Find a competition