Notes from the work

One email when a tutorial or migration write-up goes live. Nothing else, and an unsubscribe link in every email.

LeanZero

Two people in Romania doing Atlassian migrations, Forge apps and practical AI work for teams that would rather talk to the person doing the job. Most of what we learn ends up on this site.

Services

  • Atlassian migrations
  • Atlassian FastShift
  • Atlassian maintenance
  • Forge app development
  • AI development consultation

Topics

  • Jira
  • Jira Service Management
  • Confluence
  • Bitbucket
  • Atlassian Forge
  • Cloud Migration
  • Local AI
  • AI Coding
  • Certifications
  • Atlassian Team
  • All topics

Company

  • Blog
  • Tutorials
  • Contact

Community

  • Join Discord
  • Support this site

© 2026 LeanZero. All rights reserved.

Privacy policyTerms of service24/7 SupportTrust centerSecurityDPALegal notice
  1. Home
  2. Blog
Knowledge Base

Atlassian insights & tutorials

Real Atlassian solutions to real problems — no fluff, no SEO spam.

Read the latestFollow the tutorials
JiraConfiguration, workflows and fixes from real projectsLocal AIModels and agents running on your hardwareAI codingCoding tools and workflows tested in practice

Articles 19

All topicsAI CodingAtlassian ForgeAtlassian TeamBitbucketCertificationsCloud MigrationCogniRunnerConfluenceCost SlasherJiraJira Service ManagementLeanZero ManagementLocal AISentinel Vault
Best model for agentic coding in October 2026: who won our benchmarks, and who surprised
ArticleAI CodingAtlassian Forge

Best model for agentic coding in October 2026: who won our benchmarks, and who surprised

We ran 44 models through two agentic coding benchmarks, then read their builds line by line. Paying per token I'd use GPT-6.1 Sol, and MiMo V2.6 Flash came 7th on our Jira benchmark at 31 cents a build. The winners mostly did dull things right, and Claude Haiku 5.5 stopped with the app half written.

Mihai PerdumOct 20, 202615 min read

More articles

DeepSeek V4.1 Flash 1017 benchmark: same task, two builds, 0.24 and 0.66
ArticleAI CodingAtlassian Forge

DeepSeek V4.1 Flash 1017 benchmark: same task, two builds, 0.24 and 0.66

One Sunday, three Macs, two agentic coding benchmarks. A one-day-old DeepSeek point release scored above its predecessor on both, and its own two Forge builds landed 0.42 apart. NVIDIA's Nemotron 3.5 Super VL lost its context halfway through a build. A local model declared the same name twice and reported the app ready. And our board had been understating what the runs cost.

Mihai PerdumOct 19, 202616 min read
Four Qwen3.8-27B fine-tunes and merges on a coding benchmark: none beat the base
ArticleAI CodingAtlassian Forge

Four Qwen3.8-27B fine-tunes and merges on a coding benchmark: none beat the base

We ran four popular Qwen3.8-27B fine-tunes and merges through Forge 2.0, our long agentic coding benchmark, on one 64 GB MacBook next to the stock base, one build each in our own 8-bit conversions. In our setup one model's write calls came back malformed, one wrote careful code and then got stuck hunting for a method that doesn't exist, one finished fast with placeholders, and the merge got the hardest parts right and scored 0.1105. The base's median is 0.1852.

Mihai PerdumOct 19, 202617 min read
Jev Router topped our coding benchmark. 117 of its 118 calls went to GPT-6.1 Sol
ArticleAI CodingAtlassian Forge

Jev Router topped our coding benchmark. 117 of its 118 calls went to GPT-6.1 Sol

TypeSafe's Jev Router took the top median on our Forge 2.0 agentic coding benchmark, 0.746 from two builds. OpenRouter's own generation records show it sent 117 of its 118 calls to GPT-6.1 Sol, which sits third on the same board. What a model router is, what Jev Router did here, and why two long builds per model can't tell a router from the model it picked.

Mihai PerdumOct 17, 202614 min read
DeepSeek V4.1 Flash coding benchmark: 0.33 on a Forge app upgrade, Opus 5.5 got 0.67
ArticleAI CodingAtlassian Forge

DeepSeek V4.1 Flash coding benchmark: 0.33 on a Forge app upgrade, Opus 5.5 got 0.67

I ran DeepSeek V4.1 Flash twice through Forge 2.0, our Atlassian Forge app-upgrade benchmark. It scored 0.2893 and 0.3790, a median of 0.3342 against 0.6745 for Claude Opus 5.5 and 0.5283 for MiMo V2.6 Flash. Then I read the code behind its biggest penalty, and I don't think our scorer got that one right.

Mihai PerdumOct 13, 202614 min read
Claude Haiku 5.5 vs GPT-6 Luna on two coding benchmarks: same price, 3.5x the agent bill
ArticleAI CodingAtlassian Forge

Claude Haiku 5.5 vs GPT-6 Luna on two coding benchmarks: same price, 3.5x the agent bill

Claude Haiku 5.5 and GPT-6 Luna both list at $0.10 in and $0.50 out per million tokens. In our agent runs Haiku billed 3.5 times as much, mostly because 64 of its 111 calls crossed the 100k-token line where its price goes up five times, and part of that was a bug in our own agent. It also built the better apps: 0.9661 to 0.395 on an Atlassian Forge app, 0.661 to 0.4797 on a payments app. The checks that decided both, the call-by-call bill, and how to keep Haiku under the step.

Mihai PerdumOct 12, 202622 min read
Qwen3.8 Flash vs Max Prime: the cheap one beat the flagship on our Forge 1.0 benchmark
ArticleLocal AIAtlassian Forge

Qwen3.8 Flash vs Max Prime: the cheap one beat the flagship on our Forge 1.0 benchmark

Qwen3.8 Flash beat Qwen3.8 Max Prime on an Atlassian Forge app built with no internet, 0.7961 to 0.6953, and lost to it on a payments web app, 0.6846 to 0.8364. Every check behind both results, the one manifest line that decided Forge, a probe in which neither model showed it knew the rule until it was handed the docs sentence, and what fine-tuning our own 27B taught us about forgetting.

Mihai PerdumOct 8, 202638 min read
Claude Opus 5.5 vs Sonnet 5.5 vs GPT-6.1 Sol: pricing and our coding benchmarks
ArticleLocal AIAtlassian Forge

Claude Opus 5.5 vs Sonnet 5.5 vs GPT-6.1 Sol: pricing and our coding benchmarks

Claude Opus 5.5 vs Sonnet 5.5: Anthropic's prices, context window, effort levels and release dates side by side, then our two coding benchmarks. Sonnet edged Opus on a payments app, 0.7984 to 0.7926, a margin I read as level. On an Atlassian Forge app Opus won, 0.9767 to 0.8649 after a 15 October re-score. GPT-6.1 Sol and Sol Pro ran on both boards, and the full bill for fine-tuning our own 27B model is at the end.

Mihai PerdumOct 5, 202645 min read
llama.cpp vs MLX on Qwen3.6-27B: MTP is 1.04x here, not 1.85x
ArticleAI CodingLocal AI

llama.cpp vs MLX on Qwen3.6-27B: MTP is 1.04x here, not 1.85x

Multi-token prediction is merged in llama.cpp and still an open PR in mlx-lm. I measured both on an M3 Ultra with the same model. Every default MTP setting was slower than no MTP at all, and the runtime that deletes the MTP head outright was still the fastest thing I ran.

Mihai PerdumAug 10, 202615 min read
Previous
Page2of 3
Next

Found my advice helpful?

If I helped you solve something for free, coffee money is always appreciated (but never expected).

Buy Me a Coffee

Join the community

Join the community to ask questions, share your work, and connect with other professionals.

Join Discord

Recent writings

View all
Qwen4 Max benchmark: below Qwen3.8 Max Prime on both our boards, at a tenth of the cost
ArticleAI Coding

Qwen4 Max benchmark: below Qwen3.8 Max Prime on both our boards, at a tenth of the cost

Mihai Perdum14 min read
Ricursive Ripple-65B Preview benchmark: 0.028 on Gauntlet, 0.0814 on Forge, plus LFM3-1.7B
ArticleLocal AI

Ricursive Ripple-65B Preview benchmark: 0.028 on Gauntlet, 0.0814 on Forge, plus LFM3-1.7B

Mihai Perdum16 min read
Nanbeige4.3-33B benchmark attempt on a Mac Studio, plus Particle-1 vs DeepSeek V4.1 Flash
ArticleLocal AI

Nanbeige4.3-33B benchmark attempt on a Mac Studio, plus Particle-1 vs DeepSeek V4.1 Flash

Mihai Perdum24 min read
Qwen3.8-Flash-Next on a Mac Studio vs OpenRouter: what it took to reach 0.6932
ArticleLocal AI

Qwen3.8-Flash-Next on a Mac Studio vs OpenRouter: what it took to reach 0.6932

Mihai Perdum20 min read
I ran MiMo V2.6 Flash local on two Mac Studios over Thunderbolt 5 RDMA
ArticleLocal AI

I ran MiMo V2.6 Flash local on two Mac Studios over Thunderbolt 5 RDMA

Mihai Perdum15 min read