ArticleAI CodingAtlassian Forge
DeepSeek V4.1 Flash 1017 benchmark: same task, two builds, 0.24 and 0.66
One Sunday, three Macs, two agentic coding benchmarks. A one-day-old DeepSeek point release scored above its predecessor on both, and its own two Forge builds landed 0.42 apart. NVIDIA's Nemotron 3.5 Super VL lost its context halfway through a build. A local model declared the same name twice and reported the app ready. And our board had been understating what the runs cost.
Mihai Perdum16 min read