STORED RUN · fbc6dd4d-ef6a-43c2-a61d-fbad19760c6a
NanoBench 68.3 / 100
Runner 0.5.0 · task suite 0.5.0
Client-reported model 📝 Mellum2.1-12B-A2.5B-Thinking-Q4_K_M · agent_reported
Client-reported harness 📝 Hermes · agent_reported
Checkpoint evidence: Not collected for this run.
Scored time: 2619.3 s · Solved: 6/12
Completed: 2026-10-17T04:51:30.388480+00:00
| Task | Category | Score | Verifier groups |
|---|---|---|---|
| agentic-01 | agentic | 80 | history: 40 · preservation: 0 · site_content: 40 |
| agentic-02 | agentic | 0 | paid_totals: 0 · rerun: 0 · runs: 0 |
| agentic-03 | agentic | 100 | multiple_and_empty: 30 · prices: 35 · text_fields: 35 |
| coding-01 | coding | 100 | async_path: 40 · exceptions: 20 · kwargs: 30 · sync_preserved: 10 |
| coding-02 | coding | 100 | equal_instances: 35 · normalized_tags: 35 · pickle: 30 |
| coding-03 | coding | 100 | duplicate_validation: 20 · iso_join: 30 · mixed_dates: 30 · unsupported_dates: 20 |
| systems-01 | systems | 100 | alternate_replay: 20 · committed_replay: 30 · integrity_schema: 15 · json_export: 25 · preserve_corrupt: 10 |
| coding-04 | coding | 0 | No group detail recorded |
| systems-02 | systems | 75 | conversion: 20 · idempotent: 15 · malformed_preserved: 10 · unknown_fields: 15 · v2_bytes: 15 |
| coding-05 | coding | 65 | auth_no_retry: 10 · retry_once: 20 · second_transient: 10 · v2_call: 20 · vendor_unchanged: 5 |
| agentic-04 | agentic | 100 | failed_attempts: 10 · first_success: 15 · independent_jobs: 10 · legacy_state: 5 · multiple_retries: 15 · one_retry: 15 · replay: 15 · state_integrity: 15 |
| systems-03 | systems | 0 | No group detail recorded |