Cloud baseline

Muse Ember — 0.3587 on Gauntlet 7.2

meta/muse-ember · scorer sb-7.2

Muse Ember, single model via OpenRoutermeta/muse-ember · single agentNov 12, 2026
Overall
0.3587
Excellent
no
Benchmark
Gauntlet 7.2
Model build
14m 47s

Recorded inference cost

$0.12

From the saved OpenRouter generation billing summary (122 recorded requests). Includes auxiliary model calls made during the build. Scoring reuses the saved build; this amount describes the original inference spend.

  • Read again at publish: OpenRouter's records for all 122 generation ids of the run. 1 of them had no record yet when the run ended (OpenRouter writes a record after the stream ends).

Token usage

Tokens: 10M in · 107k out · 9.7M cached (exact, OpenRouter records)

10,134,053 tokens over 122 model calls: every call of the run, the model's own and the harness's helper calls, counted from OpenRouter records. Reasoning tokens as the provider reports them: 45,703 (not added to the total).

  • meta/muse-ember

    In 10M · Out 107k · Cached 9.7M · Reasoning 45.7k · 121 calls

  • google/gemini-2.5-flash

    In 974 · Out 5 · Cached 0 · Reasoning 0 · 1 call

Tier breakdown

A · structure & runtime1.00
B · behaviour0.97
C · vendor contract0.80
D · finesse0.88

Scoring detail

How this score was built

Per-check scorer output, as posted by the app. Expand a section to inspect its checks.

Earned credit before admission

(0.88 × 0.7043 core + 0.12 × 0.63 gate × 0.40 excellence) × 0.5520 critical = 0.3587

Critical defects compound a multiplier on the whole score (pre-severity 0.6498):

b_money_rendered 0.80 → ×0.92j_workflow_journey 0.00 → ×0.60

The core (88% of the total) is the weighted mean of the thirteen measured tiers. The last 12% is the excellence slice: it unlocks in proportion to the perfection conditions below (10 of 16 met here), then pays out at the excellence tier's own measured mean. Core 0.6198 + excellence 0.0300.

j_first_use 1.00j_workflow_journey 0.00j_error_state 0.00j_empty_state 1.00console_clean 3.00v_responsive_375 0.00v_dates_readable 1.00t_scene_binding 1.00x_conservation_residual 1.00r_no_row_loss 1.00p_drag_frames 1.00p_idle_flatness 1.00p_stream_apply 0.00p_under_stream 0.00p_api_latency 1.00p_sync_wall 1.00

Earned score 0.359 · Admission ceiling 0.599 · Final score 0.359

Final score is the lower of earned credit and the admission ceiling. Passing admission adds no points.

Visible: not metMatching: not metGood: not metVisual excellence: not metBackend excellence: passed

Visible data-backed 3D: s_visible_surface (maximum 0.599)

Tower structure, currency mapping and scene truth: s_visible_surface, s_tower_geometry, s_currency_collar, t_height_pixels, t_vs7dbg_truth (maximum 0.609)

3D interaction and overview legibility: t_camera_math, t_brush_link, t_stream_diff, q_overview_legibility, q_inspector_framing (maximum 0.699)

Event animation and backend recovery: m_committed_event_replay (maximum 0.899)

Run notes and corrections

Scoring load: this build was scored four times in the app while the Mac was busy (the scorer's own browser plus other jobs on that Mac), with 1-minute load peaks between 11.7 and 20, above the limit of 8 we normally score under. The first two scorings are discarded: test servers left running by a cancelled run on the same Mac were alive during both and interfered with the second. The two clean scorings gave 0.3498 and 0.3587. Idle drawing and overview framing had the same values in every scoring; the under-load response check and inspector framing scored 0 in every scoring. The published score is the latest clean scoring.

Graded browser recording

Loading duration…

Watch the full graded browser recording at its original speed: the payment field, structure inspection, committed updates and replay. The check results and screenshots on this page provide the wider evidence. Pause or scrub to inspect a view.

Each tower represents a payment: height encodes its amount, cap color its status, and the collar its currency. The selected detailed tower is expected to animate its collar after a committed backend update or replay. These are the task requirements; the check results show what this app actually achieved.

Ready to play0:00 / —:—
Open recording file

Drag the timeline to seek. Keyboard: arrow keys move 5 seconds; Home and End jump to the start and end.

Full graded browser recording: payment field, structure inspection, committed updates and replay

Screenshots

Captured from the built application during browser grading. Captions identify the recorded views and checks; these images do not represent repair rounds.

1First captured render
2Latest captured render
3After sync
4Error state
5Mobile · 375px

Run details

Model
meta/muse-ember
Engine events
0
Repair rounds
0
Started
Nov 12, 2026, 01:28 AM
Finished
Nov 12, 2026, 01:54 AM
Call budget
With wrap-up nudge, version 2: as the call budget ran low, the agent harness told the model to start no new work and finish
Re-scored
Nov 12, 2026, 03:00 AM (same build, corrected scorer)

How the benchmark is scored