Benchmark run

Gemini 3.8 Flash · SB7.1 · Goose 3.0.2 — 0.4992 on Gauntlet 7.1

gemini-3.8-flash · scorer sb-7.1

steady-yak-9b4bgemini-3.8-flash · single agentSep 21, 2026
Overall
0.4992
Excellent
no
Benchmark
Gauntlet 7.1
Model build
10m 16s

Tier breakdown

A · structure & runtime1.00
B · behaviour0.85
C · vendor contract1.00
D · finesse0.83

Scoring detail

How this score was built

Per-check scorer output, as posted by the app. Expand a section to inspect its checks.

Earned credit before admission

(0.88 × 0.8773 core + 0.12 × 0.77 gate × 0.65 excellence) × 0.6000 critical = 0.4992

Critical defects compound a multiplier on the whole score (pre-severity 0.8320):

b_buckets_dst 0.30 → ×0.60

The core (88% of the total) is the weighted mean of the ten measured tiers. The last 12% is the excellence slice: it unlocks in proportion to the perfection conditions below (12 of 16 met here), then pays out at the excellence tier's own measured mean. Core 0.7720 + excellence 0.0599.

j_first_use 1.00j_workflow_journey 1.00j_error_state 0.30j_empty_state 1.00console_clean 1.00v_responsive_375 1.00v_dates_readable 1.00t_scene_binding 1.00x_conservation_residual 1.00r_no_row_loss 1.00p_drag_frames 1.00p_idle_flatness 1.00p_stream_apply 1.00p_under_stream 0.00p_api_latency 1.00p_sync_wall 0.00

Earned score 0.499 · Admission ceiling 0.699 · Final score 0.499

Final score is the lower of earned credit and the admission ceiling. Passing admission adds no points.

Visible: passedMatching: not metGood: not metVisual excellence: not metBackend excellence: not met

Payment geometry, mapping and scene truth: t_vs7dbg_truth (maximum 0.699)

Readable presentation and field interaction: q_legible_presentation, t_brush_link (maximum 0.799)

Event animation and backend recovery: x_l5_group_atomicity, x_m2_pair_conservation, r_b3_sigkill_resync, r_notification_multiset (maximum 0.899)

Run notes and corrections

Correction, 21 September 2026: the original money-check label described a DST error. Initial synchronization completed with only 8,388 payments against 12,289 expected; daily bucket counts did not match the full fixture. The recorded critical multiplier remains ×0.6. Later recovery reached 12,291 payments and was a separate measurement. This explanation does not change the original check scores, final score, scorer provenance or Goose 3.0.2 build attribution. Recording expanded from the original 28.56-second excerpt to the complete 110.56-second graded browser recording, in original order and at original speed; no new model run or browser grading. Raw source SHA-256: 61e599a55b15c27d2ce59dcdf67e304d704ee356e4b88c25f016c328b65af0f1. Full recording SHA-256: cd6c1143e4d56682b2e3a55368ad8a5fbd3d7f3b74b1a4e4362ae341996166fc. Previous excerpt asset retained: file-1ef2ee126bcb3f850a8b4d2a916f8610bf52e064-webm, SHA-256 54eab8b85449d2c4f8bb776b2e68719e6a8d798d37e66b2bbe5e454d78da08d9.

Graded browser recording

Loading duration…

Watch the full graded browser recording at its original speed: the payment field, structure inspection, committed updates and replay. The check results and screenshots on this page provide the wider evidence. Pause or scrub to inspect a view.

Each tower represents a payment: height encodes its amount, cap color its status, and the collar its currency. The selected detailed tower is expected to animate its collar after a committed backend update or replay. These are the task requirements; the check results show what this app actually achieved.

Ready to play0:00 / —:—
Open recording file

Drag the timeline to seek. Keyboard: arrow keys move 5 seconds; Home and End jump to the start and end.

Full graded browser recording: payment field, structure inspection, committed updates and replay

Screenshots

Captured from the built application during browser grading. Captions identify the recorded views and checks; these images do not represent repair rounds.

1Initial app view
2Error state
3Payment workflow
4First captured render
5Latest captured render

Run details

Model
gemini-3.8-flash
Engine events
0
Repair rounds
0
Started
Sep 21, 2026, 06:25 AM
Finished
Sep 21, 2026, 07:46 AM

How the benchmark is scored