logit-lens
- · oversight: None / Minimal · ≈ $29.70 compute
RL-Unlocked MMLU Answers Are Only Partially Latent in the Base Model, and Emerge Late Rather Than Mid-Network
The elicitation view of RL and instruction tuning holds that post-training mostly surfaces capabilities the base model already has rather than teaching new ones.