NANOBENCHFROZEN RESULT v0.5.0

STORED RUN · cfdeebd9-e3b6-4a63-a032-5b3ac18ccff9

NanoBench 54.6 / 100

Runner 0.5.0 · task suite 0.5.0

Client-reported model 📝 LFM2.5-24B-A2B-QAD-Q4_0 · agent_reported

Client-reported harness 📝 Hermes · agent_reported

Checkpoint evidence: Not collected for this run.

Scored time: 2580.9 s · Solved: 4/12

Completed: 2026-10-17T02:42:02.378445+00:00

TaskCategoryScoreVerifier groups
agentic-01agentic100history: 40 · preservation: 20 · site_content: 40
agentic-02agentic40paid_totals: 40 · rerun: 0 · runs: 0
agentic-03agentic0multiple_and_empty: 0 · prices: 0 · text_fields: 0
coding-01coding100async_path: 40 · exceptions: 20 · kwargs: 30 · sync_preserved: 10
coding-02coding0equal_instances: 0 · normalized_tags: 0 · pickle: 0
coding-03coding100duplicate_validation: 20 · iso_join: 30 · mixed_dates: 30 · unsupported_dates: 20
systems-01systems80alternate_replay: 0 · committed_replay: 30 · integrity_schema: 15 · json_export: 25 · preserve_corrupt: 10
coding-04coding25existing_commands: 10 · invalid_limit: 15
systems-02systems45conversion: 20 · malformed_preserved: 10 · unknown_fields: 15
coding-05coding65auth_no_retry: 10 · retry_once: 20 · second_transient: 10 · v2_call: 20 · vendor_unchanged: 5
agentic-04agentic100failed_attempts: 10 · first_success: 15 · independent_jobs: 10 · legacy_state: 5 · multiple_retries: 15 · one_retry: 15 · replay: 15 · state_integrity: 15
systems-03systems0No group detail recorded
Back to historical results