MIT Reports Sixfold Score Gain From a 0.016% Weight Edit
Researchers at MIT CSAIL have reported that an outside model rewrote just 0.016% of a small model’s weights and lifted its MATH-500 score roughly sixfold, a single-benchmark result that tests the assumption that capability must come from pre-training.