Coding agents in practice, and how to tell whether they were right.
AI coding agents fail in specific, repeatable ways, and almost none of them look like the demos. A test command piped through head exits 0 when nothing ran. A 27B model re-reads a file it was handed moments ago, ninety-five percent of the time. A swarm reaches agreement with itself and ships the bug anyway.
Most of this was written while building goose Local Edition, LeanZero's own agent running against local models, so the examples come from a harness that had to actually work. Expect measured before-and-after numbers and the levers that moved them. Expect a lot on verification too: making an agent act is the easy half, and knowing whether it was right is the half that takes the work.
What actually constrains an AI coding agent: the tool you run it in, the protocol underneath, and what the wire really carries.
How the goose swarm was built - a fleet of small local models coordinated to ship working code - and what broke in it over weeks of real runs.