pass-at-k
-
Most of the Gain Was Already There
GRPO on GSM8K lifts a small model's held-out pass@1 by 5.8 points, and the paired per-problem confidence interval on that gain (0.0466-0.0695) excludes zero.
GRPO on GSM8K lifts a small model's held-out pass@1 by 5.8 points, and the paired per-problem confidence interval on that gain (0.0466-0.0695) excludes zero.