Notes from the work

One email when a tutorial or migration write-up goes live. Nothing else, and an unsubscribe link in every email.

LeanZero

Two people in Romania doing Atlassian migrations, Forge apps and practical AI work for teams that would rather talk to the person doing the job. Most of what we learn ends up on this site.

Services

  • Atlassian migrations
  • Atlassian FastShift
  • Atlassian maintenance
  • Forge app development
  • AI development consultation

Topics

  • Jira
  • Jira Service Management
  • Confluence
  • Bitbucket
  • Atlassian Forge
  • Cloud Migration
  • Local AI
  • AI Coding
  • Certifications
  • Atlassian Team
  • All topics

Company

  • Blog
  • Tutorials
  • Contact

Community

  • Join Discord
  • Support this site

© 2026 LeanZero. All rights reserved.

Privacy policyTerms of service24/7 SupportTrust centerSecurityDPALegal notice
  1. Home
  2. Blog
Knowledge Base

Atlassian insights & tutorials

Real Atlassian solutions to real problems — no fluff, no SEO spam.

Read the latestFollow the tutorials
JiraConfiguration, workflows and fixes from real projectsLocal AIModels and agents running on your hardwareAI codingCoding tools and workflows tested in practice

Articles 19

All topicsAI CodingAtlassian ForgeAtlassian TeamBitbucketCertificationsCloud MigrationCogniRunnerConfluenceCost SlasherJiraJira Service ManagementLeanZero ManagementLocal AISentinel Vault
Qwen4 Max benchmark: below Qwen3.8 Max Prime on both our boards, at a tenth of the cost
ArticleAI Coding

Qwen4 Max benchmark: below Qwen3.8 Max Prime on both our boards, at a tenth of the cost

Qwen4 Max scored 0.7365 on our Gauntlet coding benchmark and 0.3473 and 0.4087 on Forge 2.0, below Qwen3.8 Max Prime on both, for $9.30 against $88.72. On Gauntlet it earned slightly more than Max Prime and lost the difference to a score ceiling. We also ran Baidu's ERNIE Light DT 1.0.

Mihai PerdumNov 18, 202614 min read

More articles

Ricursive Ripple-65B Preview benchmark: 0.028 on Gauntlet, 0.0814 on Forge, plus LFM3-1.7B
ArticleLocal AIAI Coding

Ricursive Ripple-65B Preview benchmark: 0.028 on Gauntlet, 0.0814 on Forge, plus LFM3-1.7B

We ran Ricursive's Ripple-65B Preview and Liquid AI's LFM3-1.7B through our agentic coding benchmarks. Ripple scored 0.028 on the Gauntlet: one wiring line broke its API, and its tests went around the server. Its two Forge 2.0 builds scored 0.0858 and 0.0770, a little above the 0.0617 of the unchanged starter app. LFM3-1.7B stopped itself with 30 calls left and changed no file on Forge 2.0. On a Mac, llama.cpp runs both and mlx-lm runs neither yet.

Mihai PerdumNov 11, 202616 min read
Nanbeige4.3-33B benchmark attempt on a Mac Studio, plus Particle-1 vs DeepSeek V4.1 Flash
ArticleLocal AIAI Coding

Nanbeige4.3-33B benchmark attempt on a Mac Studio, plus Particle-1 vs DeepSeek V4.1 Flash

We tried to benchmark Nanbeige4.3-33B on a Mac Studio with MLX and it never started: our engine dropped its tool calls, and the 96 GB Studio served at most 75,925 tokens of the 322,851 our Gauntlet needs. We can give you measured speed and memory, a fit table by Mac size, and Particle-1 measured against two DeepSeek V4.1 Flash snapshots.

Mihai PerdumNov 6, 202624 min read
Qwen3.8-Flash-Next on a Mac Studio vs OpenRouter: what it took to reach 0.6932
ArticleLocal AIAI Coding

Qwen3.8-Flash-Next on a Mac Studio vs OpenRouter: what it took to reach 0.6932

Our own 4-bit DWQ build of the official Qwen3.8-Flash-Next weights ran on one M5 Max Mac Studio in our MLX engine and scored 0.6932 on our Gauntlet sb-7.2 coding benchmark. Qwen3.8 Flash on OpenRouter has 0.6846 on the same board, and I explain why that comparison isn't settled. This is what we built to get there, with the numbers, and what went wrong on the way.

Mihai PerdumNov 4, 202620 min read
I ran MiMo V2.6 Flash local on two Mac Studios over Thunderbolt 5 RDMA
ArticleLocal AI

I ran MiMo V2.6 Flash local on two Mac Studios over Thunderbolt 5 RDMA

We split Xiaomi's MiMo-V2.6-Flash across two Mac Studios over Thunderbolt 5 RDMA, with vision and a 256k context, and ran our agentic coding benchmark on it. It scored 0.6605 against 0.7909 for the same model in Xiaomi's cloud. Before the 3D ceiling it earned 0.8309 to the cloud's 0.838. I go through where the rest went, and the bugs we hit splitting one model over two machines.

Mihai PerdumOct 29, 202615 min read
GPT-6.1 Terra benchmarks on agentic coding: 13th of 48, and what beat it
ArticleAI CodingAtlassian Forge

GPT-6.1 Terra benchmarks on agentic coding: 13th of 48, and what beat it

GPT-6.1 Terra scored 0.6953 on our Gauntlet, 13th of 48, and 0.4384 and 0.4174 on two Forge 2.0 builds, for under $1.10 a run. It passes almost as many checks as GPT-6.1 Sol. It loses on what a demo never checks: a background reconcile that never finished, a flick it never tested, and a six-hour run it admitted it hadn't verified.

Mihai PerdumOct 28, 202616 min read
Muse Spark Open benchmark: where the open-weight models we ran this month broke as coding agents
ArticleAI CodingAtlassian Forge

Muse Spark Open benchmark: where the open-weight models we ran this month broke as coding agents

Meta's Muse Spark Open scored 0.091 and 0.0877 out of 1 on our Forge 2.0 coding benchmark and never got a Gauntlet verdict. The other open-weight models we ran locally, Google's Gemma 4 among them, did no better, and neither did our own Qwen3.8-27B fine-tunes. The best open result on our Macs came from the plain Qwen3.8-27B base. We read every build to find where each one broke, and a fair share of the breakage was ours.

Mihai PerdumOct 22, 202620 min read
Are AI benchmarks reliable? We had 32 models build the same app twice
ArticleAI CodingAtlassian Forge

Are AI benchmarks reliable? We had 32 models build the same app twice

Gemini 4 Argon built our Forge 2.0 test app twice and scored 0.79, then 0.29. Claude Sonnet 5.5 scored 0.59 and 0.55. I wanted to know which models are the unpredictable ones. Two builds can't tell you, and part of one swing was our own harness.

Mihai PerdumOct 22, 202620 min read
Mistral Large 4 coding benchmark: the money bug was ours, and DeepSeek V4.1 Flash still won on Forge
ArticleAI CodingAtlassian Forge

Mistral Large 4 coding benchmark: the money bug was ours, and DeepSeek V4.1 Flash still won on Forge

Mistral Large 4 scored 0.5462 on our Gauntlet because a check of ours compared its newest payments with our oldest ones. Every amount it showed was right. On Forge 2.0 it was slow and expensive, mostly for reasons of its own, and DeepSeek V4.1 Flash 1017 built the same app better in about a quarter of the time, for about an eighteenth of the bill.

Mihai PerdumOct 21, 202618 min read
Previous
Page1of 3
Next

Found my advice helpful?

If I helped you solve something for free, coffee money is always appreciated (but never expected).

Buy Me a Coffee

Join the community

Join the community to ask questions, share your work, and connect with other professionals.

Join Discord