NANOBENCHFROZEN RESULT v0.5.0

STORED RUN · 8f8e5c87-b5dd-4ffe-bf89-6a7501a4b56d

NanoBench 91.7 / 100

Runner 0.5.0 · task suite 0.5.0

Client-reported model 📝 NVIDIA-Nemotron-3.5-Bolt-74B-A9B (BoldingBuilds) · agent_reported

Client-reported harness 📝 Hermes Agent · agent_reported

Checkpoint evidence: Not collected for this run.

Scored time: 2052.1 s · Solved: 9/12

Completed: 2026-10-20T15:48:26.290199+00:00

TaskCategoryScoreVerifier groups
agentic-01agentic100history: 40 · preservation: 20 · site_content: 40
agentic-02agentic100paid_totals: 40 · rerun: 30 · runs: 30
agentic-03agentic100multiple_and_empty: 30 · prices: 35 · text_fields: 35
coding-01coding100async_path: 40 · exceptions: 20 · kwargs: 30 · sync_preserved: 10
coding-02coding100equal_instances: 35 · normalized_tags: 35 · pickle: 30
coding-03coding100duplicate_validation: 20 · iso_join: 30 · mixed_dates: 30 · unsupported_dates: 20
systems-01systems100alternate_replay: 20 · committed_replay: 30 · integrity_schema: 15 · json_export: 25 · preserve_corrupt: 10
coding-04coding25existing_commands: 10 · invalid_limit: 15
systems-02systems90conflict: 5 · conversion: 20 · idempotent: 15 · mixed_schema: 5 · nested_values: 15 · unknown_fields: 15 · v2_bytes: 15
coding-05coding85auth_no_retry: 10 · cli_output: 5 · client_constructor: 15 · retry_once: 20 · second_transient: 10 · v2_call: 20 · vendor_unchanged: 5
agentic-04agentic100failed_attempts: 10 · first_success: 15 · independent_jobs: 10 · legacy_state: 5 · multiple_retries: 15 · one_retry: 15 · replay: 15 · state_integrity: 15
systems-03systems100copy_update_nested: 30 · exclude: 15 · hashes_and_sizes: 10 · idempotent: 5 · manifest_membership: 10 · preserve_runtime: 10 · sorted_paths: 5 · stale_cleanup: 15
Back to historical results