
ArticleAI CodingAtlassian Forge
Are AI benchmarks reliable? We had 32 models build the same app twice
Gemini 4 Argon built our Forge 2.0 test app twice and scored 0.79, then 0.29. Claude Sonnet 5.5 scored 0.59 and 0.55. I wanted to know which models are the unpredictable ones. Two builds can't tell you, and part of one swing was our own harness.