https://blog.crazyai.uk/categories/evaluation/Recent content in Evaluation on Zero to One AIHugoenVolume 01 · Zero to One AI · Typeset in publicSun, 27 Sep 2026 10:15:00 +0800https://blog.crazyai.uk/posts/eval-field-notes-02-the-tool-said-no/Sun, 27 Sep 2026 10:15:00 +0800https://blog.crazyai.uk/posts/eval-field-notes-02-the-tool-said-no/In four of twelve security cases the agent really did try to read data that was not its user's. None of it got through, because the prompt was never the thing enforcing access.https://blog.crazyai.uk/posts/eval-field-notes-01-the-blind-set-went-stale/Sun, 27 Sep 2026 10:00:00 +0800https://blog.crazyai.uk/posts/eval-field-notes-01-the-blind-set-went-stale/My agent beat single-shot RAG by five questions on a blind set. Then I noticed I had been tuning on that blind set. Sixteen fresh questions later, the gap was gone.