Benchmark run

qwen3.8-27b 3-node swarm — 0.1112 on Gauntlet 7.0

qwen3.8-27b · 3 nodes · scorer sb-7.0-rc

mighty-crane-54f2r6j-experiment3-node local fleetSep 3, 2026
Overall
0.1112
Excellent
no
Benchmark
Gauntlet 7.0
Recorded duration
580m 24s
Nodes
3
Prompt tok
15.5M
Gen tok
772.3k

Tier breakdown

A · structure & runtime1.00
B · behaviour0.89
C · vendor contract0.66
D · finesse0.80

Scoring detail

How this score was built

Per-check scorer output, as posted by the app. Expand a section to inspect its checks.

Findings that held

Raised by the verify gate, still open when the run ended.

1

the app ships NO executable tests (`pytest -q` collected 0) — an empty suite is not a passing suite. Write real tests that assert the spec's concrete expected values, and never delete or skip a failing test to go green.

Repair progression

R0·1

One chip per verify round: the number of open findings at that round. The run ends when a round reports zero findings or the round budget is exhausted.

Token rates

Measured by the engine itself, one record per completed model call: prefill rate is prompt tokens over time-to-first-token, generation rate is completion tokens over the decode window. Medians per node.

NodeCallsPrompt tokGen tokPrefill tok/sGen tok/s
gabee371,978,857156,4492619.713.0
mihai584,181,514177,4023127.613.6
workhorse1549,321,259438,4054713.716.4
fleet24915,481,630772,2564016.115.1

Screenshots

Recorded views of the built application. Captions identify the available captures; the number of images does not imply a number of repair rounds.

1First render — before repairs
2Final render
3Mobile · 375px
4After sync

Run details

Model
qwen3.8-27b
Engine events
1,644
Repair rounds
0
Started
Sep 2, 2026, 03:35 PM
Finished
Sep 3, 2026, 01:37 AM

Fleet nodes

NodeModel
gabeegabee-qwen3.8-27b
mihaimihai-qwen3.8-27b
workhorseworkhorse-qwen3.8-27b

How the benchmark is scored