Cloud baseline

qwen/qwen3.8-flash, single model via OpenRouter — 0.6846 on Gauntlet 7.2

qwen/qwen3.8-flash · scorer sb-7.2

qwen/qwen3.8-flash · single agentOct 5, 2026
Overall
0.6846
Excellent
no
Benchmark
Gauntlet 7.2
Model build
82m 11s
Prompt tok
25.5M
Gen tok
253.5k

Tier breakdown

A · structure & runtime1.00
B · behaviour1.00
C · vendor contract0.93
D · finesse0.90

Scoring detail

How this score was built

Per-check scorer output, as posted by the app. Expand a section to inspect its checks.

Earned credit before admission

(0.88 × 0.8425 core + 0.12 × 0.88 gate × 0.60 excellence) × 0.8857 critical = 0.7126

Critical defects compound a multiplier on the whole score (pre-severity 0.8045):

j_workflow_journey 0.71 → ×0.89

The core (88% of the total) is the weighted mean of the thirteen measured tiers. The last 12% is the excellence slice: it unlocks in proportion to the perfection conditions below (13 of 16 met here), then pays out at the excellence tier's own measured mean. Core 0.7414 + excellence 0.0631.

j_first_use 1.00j_workflow_journey 0.71j_error_state 0.30j_empty_state 1.00console_clean 0.00v_responsive_375 1.00v_dates_readable 1.00t_scene_binding 1.00x_conservation_residual 1.00r_no_row_loss 1.00p_drag_frames 1.00p_idle_flatness 1.00p_stream_apply 0.00p_under_stream 1.00p_api_latency 1.00p_sync_wall 1.00

Earned score 0.713 · Admission ceiling 0.699 · Final score 0.685

Final score is the lower of earned credit and the admission ceiling. Passing admission adds no points.

Visible: passedMatching: passedGood: not metVisual excellence: not metBackend excellence: not met

3D interaction and overview legibility: t_coast_identity, t_labels_culling, t_brush_link, t_stream_diff, q_inspector_framing (maximum 0.699)

Event animation and backend recovery: m_committed_event_replay, x_l1_no_invented_states (maximum 0.869)

Token rates

Measured by the engine itself, one record per completed model call: prefill rate is prompt tokens over time-to-first-token, generation rate is completion tokens over the decode window. Medians per node.

NodeCallsPrompt tokGen tokPrefill tok/sGen tok/s
gemini197251650.357.5
qwen3.814625,540,941253,53751535.270.2
fleet14725,541,913253,54251115.970.2

Graded browser recording

Loading duration…

Watch the full graded browser recording at its original speed: the payment field, structure inspection, committed updates and replay. The check results and screenshots on this page provide the wider evidence. Pause or scrub to inspect a view.

Each tower represents a payment: height encodes its amount, cap color its status, and the collar its currency. The selected detailed tower is expected to animate its collar after a committed backend update or replay. These are the task requirements; the check results show what this app actually achieved.

Ready to play0:00 / —:—
Open recording file

Drag the timeline to seek. Keyboard: arrow keys move 5 seconds; Home and End jump to the start and end.

Full graded browser recording: payment field, structure inspection, committed updates and replay
Recording integrity

SHA-256: 7ebdbf1c2d0ebf85ef398a33abcdd24c68b11bfd69f94a16ea0d55ed016a292a

Screenshots

Captured from the built application during browser grading. Captions identify the recorded views and checks; these images do not represent repair rounds.

1Initial app view
2Error state
3Payment workflow
4First captured render
5Latest captured render

Run details

Model
qwen/qwen3.8-flash
Engine events
0
Repair rounds
0
Started
Oct 5, 2026, 03:31 PM
Finished
Oct 5, 2026, 05:03 PM