Scale Bought the Base
8B versus 14B was a controlled comparison. 32B was a fit-on-40GB experiment. Neither scale won the adapter.
Index / term
Gsm8k
The Loss Is Not the Task
A 50-step math adapter beat a 600-step one, and ViT-Large was best after one epoch—on a single Colab A100.