Index / term

Evaluation

note 10Transformers

The Extra Code Is Not Another Brain

Flash Attention, mixed precision, DDP, shards, checkpointing, and HellaSwag without pretending I trained GPT-2.