BuilderCoding · benchmark
BigCodeBench
Measure practical Python generation involving libraries and complex instructions.
What it measures
Pass@1 (%)
Complete, Instruct, Full and Hard are distinct tracks; repository is archived.
Public evaluation code. Check upstream code and dataset terms.
Open source / dataset · Run instructions · Official results
Reported ranking tracks
No numeric ranking has been imported for this project. Read the upstream results and instructions.