Reasoning · benchmark

Humanity’s Last Exam

Evaluate difficult expert questions spanning science, mathematics and humanities.

What it measures

Accuracy and calibration error

Tool-assisted, no-tool, text-only and multimodal scores are separate settings.

Dataset terms apply. Check upstream code and dataset terms.