Benchmark run

MiMo-V2.6-Flash MOPD 4-bit · 2-Mac split · vision, 512k — 0.6644 on Gauntlet 7.2

EigenLabs/MiMo-V2.6-Flash-MOPD-MLX-4bit-mtp · scorer sb-7.2

wild-lynx-ada7EigenLabs/MiMo-V2.6-Flash-MOPD-MLX-4bit-mtp · single agentNov 2, 2026
Overall
0.6644
Excellent
no
Benchmark
Gauntlet 7.2
Model build
396m 3s

Token usage

Tokens: 33.6M in · 363k out (exact, goose session counters, reported by the publisher)

34,007,875 tokens over 124 model calls: every call of the run, the model's own and the harness's helper calls, counted from goose session counters. Reported by the publisher's app; LeanZero did not count them.

  • EigenLabs/MiMo-V2.6-Flash-MOPD-MLX-4bit-mtp

    In 33.6M · Out 363k · 124 calls

Tier breakdown

A · structure & runtime1.00
B · behaviour0.98
C · vendor contract0.92
D · finesse0.93

Scoring detail

How this score was built

Per-check scorer output, as posted by the app. Expand a section to inspect its checks.

Earned credit before admission

(0.88 × 0.9488 core + 0.12 × 0.94 gate × 1.00 excellence) × 0.9600 critical = 0.9096

Critical defects compound a multiplier on the whole score (pre-severity 0.9475):

b_buckets_dst 0.98 → ×0.96

The core (88% of the total) is the weighted mean of the thirteen measured tiers. The last 12% is the excellence slice: it unlocks in proportion to the perfection conditions below (15 of 16 met here), then pays out at the excellence tier's own measured mean. Core 0.8349 + excellence 0.1125.

j_first_use 1.00j_workflow_journey 1.00j_error_state 0.00j_empty_state 1.00console_clean 0.00v_responsive_375 1.00v_dates_readable 1.00t_scene_binding 1.00x_conservation_residual 1.00r_no_row_loss 1.00p_drag_frames 1.00p_idle_flatness 1.00p_stream_apply 1.00p_under_stream 1.00p_api_latency 1.00p_sync_wall 1.00

Earned score 0.910 · Admission ceiling 0.669 · Final score 0.664

Final score is the lower of earned credit and the admission ceiling. Passing admission adds no points.

Visible: passedMatching: not metGood: not metVisual excellence: not metBackend excellence: passed

Tower structure, currency mapping and scene truth: s_tower_geometry, s_currency_collar (maximum 0.669)

3D interaction and overview legibility: t_pick_buffer, t_stream_diff, q_overview_legibility, q_inspector_framing (maximum 0.709)

Event animation and backend recovery: an earlier admission band is incomplete (maximum 0.899)

Run notes and corrections

This run was local. Goose split the model across two Macs, an M3 Ultra with 96 GB and an M5 Max with 128 GB, linked over Thunderbolt. It ran on the goose 3.0.147 engine with vision on and a 524,288-token context, used 124 of its 150 model calls and compacted once. The tier asks for medium reasoning effort, but that setting doesn't reach a local model. The engine ran with thinking on at its own default, so this score wasn't taken at a pinned effort. We re-scored the saved build on goose 3.0.148, whose scorer can now see live updates read through fetch and notification entries built from div and span elements. Three of the four live-stream checks and both approval checks now pass, and the raw score rose from 0.7643 to 0.9096. The final score only moved from 0.6572 to 0.6644 because the failed tower geometry and currency collar checks hold it under a 0.669 ceiling. The one critical defect left is the model's own. It registered its webhook after the vendor's racing events had already fired, so the daily bucket counts from its first sync are off, with 12,288 of 12,289 payments.

Graded browser recording

Loading duration…

Watch the full graded browser recording at its original speed: the payment field, structure inspection, committed updates and replay. The check results and screenshots on this page provide the wider evidence. Pause or scrub to inspect a view.

Each tower represents a payment: height encodes its amount, cap color its status, and the collar its currency. The selected detailed tower is expected to animate its collar after a committed backend update or replay. These are the task requirements; the check results show what this app actually achieved.

Ready to play0:00 / —:—
Open recording file

Drag the timeline to seek. Keyboard: arrow keys move 5 seconds; Home and End jump to the start and end.

Full graded browser recording: payment field, structure inspection, committed updates and replay

Screenshots

Captured from the built application during browser grading. Captions identify the recorded views and checks; these images do not represent repair rounds.

1First captured render
2Latest captured render
3After sync
4Error state
5Mobile · 375px

Run details

Model
EigenLabs/MiMo-V2.6-Flash-MOPD-MLX-4bit-mtp
Engine events
0
Repair rounds
0
Started
Nov 1, 2026, 11:39 PM
Finished
Nov 2, 2026, 06:28 AM
Call budget
With wrap-up nudge, version 2: as the call budget ran low, goose told the model to start no new work and finish
Re-scored
Nov 2, 2026, 11:11 AM (same build, corrected scorer)

How the benchmark is scored