Methodology

We measure reasoning by flip rate — a paired-item test that precludes the surface-feature heuristics most models use to game conventional evaluations. The pair is the unit of measurement, not the item. Reasoning, not recall.

Inspect the eval kit →