https://blog.crazyai.uk/tags/attention/Recent content in Attention on Zero to One AIHugoenThu, 20 Aug 2026 11:32:00 +0800https://blog.crazyai.uk/posts/transformer-field-notes-02-four-ways-to-average-the-past/Thu, 20 Aug 2026 11:32:00 +0800https://blog.crazyai.uk/posts/transformer-field-notes-02-four-ways-to-average-the-past/Q, K, and V stopped feeling magical when I rebuilt attention as four increasingly selective ways to mix the same past.