STORED RUN · 5289ef78-845d-4fb9-9d52-95dd3b9dd90e
NanoBench 55 / 100
Runner 0.5.0 · task suite 0.5.0
Client-reported model 📝 Mellum2.1-12B-A2.5B-Thinking-Q4_K_M · agent_reported
Client-reported harness 📝 OMP · agent_reported
Checkpoint evidence: Not collected for this run.
Scored time: 5063.0 s · Solved: 5/12
Completed: 2026-10-17T04:07:08.733224+00:00
| Task | Category | Score | Verifier groups |
|---|---|---|---|
| agentic-01 | agentic | 0 | history: 0 · preservation: 0 · site_content: 0 |
| agentic-02 | agentic | 0 | paid_totals: 0 · rerun: 0 · runs: 0 |
| agentic-03 | agentic | 100 | multiple_and_empty: 30 · prices: 35 · text_fields: 35 |
| coding-01 | coding | 100 | async_path: 40 · exceptions: 20 · kwargs: 30 · sync_preserved: 10 |
| coding-02 | coding | 100 | equal_instances: 35 · normalized_tags: 35 · pickle: 30 |
| coding-03 | coding | 100 | duplicate_validation: 20 · iso_join: 30 · mixed_dates: 30 · unsupported_dates: 20 |
| systems-01 | systems | 100 | alternate_replay: 20 · committed_replay: 30 · integrity_schema: 15 · json_export: 25 · preserve_corrupt: 10 |
| coding-04 | coding | 25 | existing_commands: 10 · invalid_limit: 15 |
| systems-02 | systems | 45 | conversion: 20 · malformed_preserved: 10 · unknown_fields: 15 |
| coding-05 | coding | 5 | vendor_unchanged: 5 |
| agentic-04 | agentic | 70 | failed_attempts: 10 · first_success: 15 · independent_jobs: 10 · legacy_state: 5 · replay: 15 · state_integrity: 15 |
| systems-03 | systems | 15 | idempotent: 5 · preserve_runtime: 10 |