Cloud baseline

Sonnet 5 — 0.8635 on Gauntlet 6.0

us.anthropic.claude-sonnet-5 · scorer sb-6.0

Claude Sonnet 5Aug 19, 2026
Overall
0.8635
Excellent
no
Benchmark
Gauntlet 6.0
Recorded duration
29m 50s

Token usage

Tokens: at least 9.5M in · 133k out (lower bound, harness session counters)

9,598,855 tokens over 104 model calls: every call of the run, the model's own and the harness's helper calls, counted from harness session counters. These are a lower bound.

The harness's session counters for this run (the usage AWS Bedrock returned per response, summed); calls counted from the stored transcript (approximate). Prompt caching was off on Bedrock for Claude then, so no cached tokens. Bedrock keeps no per-call bill to query.

  • us.anthropic.claude-sonnet-5

    In 9.5M · Out 133k · 104 calls

Tier breakdown

A · structure & runtime1.00
B · behaviour1.00
C · vendor contract1.00
D · finesse0.86

Scoring detail

How this score was built

Per-check scorer output, as posted by the app. Expand a section to inspect its checks.

The number, exactly

(0.88 × 0.8786 core + 0.12 × 0.88 gate × 0.86 excellence) × 0.9996 critical = 0.8635

Critical defects compound a multiplier on the whole score (pre-severity 0.8638):

h_durability 0.00 → ×1.00

The core (88% of the total) is the weighted mean of the nine measured tiers. The last 12% is the excellence slice: it unlocks in proportion to the perfection conditions below (11 of 14 met here), then pays out at the excellence tier's own measured mean. Core 0.7732 + excellence 0.0907.

j_first_use 0.00j_sync_journey 1.00j_error_state 0.30j_empty_state 1.00console_clean 0.00v_responsive_375 1.00v_dates_readable 1.00t_scene_binding 0.99p_list_latency 1.00p_buckets_latency 1.00p_summary_latency 1.00p_page_interactive 1.00p_first_frame 1.00p_sync_wall 1.00
ComponentWeightEarnedPoints
Core (tiers A–D)60%——
A · Structure25% of core1.000.150
B · Behaviour30% of core1.000.180
C · Vendor contract25% of core1.000.150
D · Finesse20% of core0.860.103
Journey (J)15%0.5750.086
Visual (V)10%0.8930.089
Performance (P)5%1.0000.050
Hard blocks10%——
Total0.2255

Run notes and corrections

Cloud baseline — a single harness run session on the frozen VendorSync Pro spec, scored by the sb-6 scorer with the severity model (critical defects — crash, wrong money, data loss, dead primary flow — compound a multiplier on the composed score). Serial, hermetic, advertised vendor port.

Screenshots

Recorded views of the built application. Captions identify the available captures; the number of images does not imply a number of repair rounds.

1Final render
23D buckets · WebGL
3After sync
4Mobile · 375px

Run details

Model
us.anthropic.claude-sonnet-5

How the benchmark is scored