ArticleAI CodingAtlassian Forge
DeepSeek V4.1 Flash coding benchmark: 0.33 on a Forge app upgrade, Opus 5.5 got 0.67
I ran DeepSeek V4.1 Flash twice through Forge 2.0, our Atlassian Forge app-upgrade benchmark. It scored 0.2893 and 0.3790, a median of 0.3342 against 0.6745 for Claude Opus 5.5 and 0.5283 for MiMo V2.6 Flash. Then I read the code behind its biggest penalty, and I don't think our scorer got that one right.
Mihai Perdum14 min read