LeanZero fine-tune, run locally

Mihai-LeanZero/Qwen3.8-27B-Atlassian-v2-goose-Q8-mlx, our fine-tune run locally — 0.0443 on Gauntlet 7.2

Mihai-LeanZero/Qwen3.8-27B-Atlassian-v2-goose-Q8-mlx · scorer sb-7.2

Fine-tuned from qwen/qwen3.8-27b (base model on this benchmark: 0.0915)

Mihai-LeanZero/Qwen3.8-27B-Atlassian-v2-goose-Q8-mlx · single agentOct 5, 2026
Overall
0.0443
Excellent
no
Benchmark
Gauntlet 7.2
Model build
112m 39s
Prompt tok
10.6M
Gen tok
57.4k

Tier breakdown

A · structure & runtime0.84
B · behaviour0.71
C · vendor contract0.88
D · finesse0.70

Scoring detail

How this score was built

Per-check scorer output, as posted by the app. Expand a section to inspect its checks.

Earned credit before admission

(0.88 × 0.3856 core + 0.12 × 0.31 gate × 0.06 excellence) × 0.1296 critical = 0.0443

Critical defects compound a multiplier on the whole score (pre-severity 0.3415):

b_money_rendered 0.00 → ×0.60b_buckets_dst 0.21 → ×0.60j_loads_data 0.00 → ×0.60j_workflow_journey 0.00 → ×0.60

The core (88% of the total) is the weighted mean of the thirteen measured tiers. The last 12% is the excellence slice: it unlocks in proportion to the perfection conditions below (5 of 16 met here), then pays out at the excellence tier's own measured mean. Core 0.3393 + excellence 0.0021.

j_first_use 0.00j_workflow_journey 0.00j_error_state 0.00j_empty_state 1.00console_clean not measuredv_responsive_375 0.00v_dates_readable 0.00t_scene_binding 0.00x_conservation_residual 1.00r_no_row_loss 1.00p_drag_frames 0.00p_idle_flatness 0.00p_stream_apply 0.00p_under_stream 0.00p_api_latency 1.00p_sync_wall 1.00

Earned score 0.044 · Admission ceiling 0.599 · Final score 0.044

Final score is the lower of earned credit and the admission ceiling. Passing admission adds no points.

Visible: not metMatching: not metGood: not metVisual excellence: not metBackend excellence: not met

Visible data-backed 3D: s_visible_surface (maximum 0.599)

Tower structure, currency mapping and scene truth: s_visible_surface, s_tower_geometry, s_currency_collar, t_layout_basis, t_scene_binding, t_height_pixels, t_vs7dbg_truth (maximum 0.599)

3D interaction and overview legibility: t_draw_budget, t_pick_buffer, t_pick_real_pass, t_click_semantics, t_camera_math, t_coast_identity, t_coast_reality, t_labels_culling, t_brush_link, t_stream_diff, q_overview_legibility, q_inspector_framing (maximum 0.699)

Event animation and backend recovery: m_committed_event_replay, r_b6_outbox_atomic, r_b7_partition, r_notifier_exactly_once, r_notification_multiset (maximum 0.799)

Token rates

Measured by the engine itself, one record per completed model call: prefill rate is prompt tokens over time-to-first-token, generation rate is completion tokens over the decode window. Medians per node.

NodeCallsPrompt tokGen tokPrefill tok/sGen tok/s
Mihai13510,581,03557,4035728.51920.3
fleet13510,581,03557,4035728.51920.3

Graded browser recording

Loading duration…

Watch an excerpt of the generated application during browser grading. The check results and screenshots on this page provide the wider evidence. Pause or scrub to inspect a view.

Each tower represents a payment: height encodes its amount, cap color its status, and the collar its currency. The selected detailed tower is expected to animate its collar after a committed backend update or replay. These are the task requirements; the check results show what this app actually achieved.

Ready to play0:00 / —:—
Open recording file

Drag the timeline to seek. Keyboard: arrow keys move 5 seconds; Home and End jump to the start and end.

Graded browser recording re-encoded to 1280x800 at 25 fps to fit 4 MiB, same 446.8 s; graded original sha256 38082c83b901c310fe547ea7e28338e8626bb670e058300f91eb68afd75ae975
Recording integrity

SHA-256: 564401bc5e207f5108f5ba5af21f70044e5dde0d3a2478af1e989b595f9efcb8

Screenshots

Captured from the built application during browser grading. Captions identify the recorded views and checks; these images do not represent repair rounds.

1Initial app view
2Error state
3Payment workflow
4First captured render
5Latest captured render

Run details

Model
Mihai-LeanZero/Qwen3.8-27B-Atlassian-v2-goose-Q8-mlx
Engine events
0
Repair rounds
0
Started
Oct 5, 2026, 01:14 PM
Finished
Oct 5, 2026, 03:17 PM