NANOBENCHFROZEN RESULT v0.5.0

STORED RUN · 76c3b307-ede5-4d40-882c-e39f6632826e

NanoBench 92.5 / 100

Runner 0.5.0 · task suite 0.5.0

Client-reported model 📝 polystrata/flint-40b-a2.5b-ud-q3_k_xl · user_reported

Client-reported harness 📝 omp · user_reported

Checkpoint evidence: Not collected for this run.

Scored time: 4120.5 s · Solved: 10/12

Completed: 2026-11-02T17:08:35.448557+00:00

TaskCategoryScoreVerifier groups
agentic-01agentic100history: 40 · preservation: 20 · site_content: 40
agentic-02agentic100paid_totals: 40 · rerun: 30 · runs: 30
agentic-03agentic100multiple_and_empty: 30 · prices: 35 · text_fields: 35
coding-01coding100async_path: 40 · exceptions: 20 · kwargs: 30 · sync_preserved: 10
coding-02coding100equal_instances: 35 · normalized_tags: 35 · pickle: 30
coding-03coding100duplicate_validation: 20 · iso_join: 30 · mixed_dates: 30 · unsupported_dates: 20
systems-01systems100alternate_replay: 20 · committed_replay: 30 · integrity_schema: 15 · json_export: 25 · preserve_corrupt: 10
coding-04coding100empty: 5 · existing_commands: 10 · invalid_limit: 15 · ordering: 20 · output: 10 · preservation: 15 · selection: 25
systems-02systems100conflict: 5 · conversion: 20 · idempotent: 15 · malformed_preserved: 10 · mixed_schema: 5 · nested_values: 15 · unknown_fields: 15 · v2_bytes: 15
coding-05coding85auth_no_retry: 10 · cli_output: 5 · client_constructor: 15 · retry_once: 20 · second_transient: 10 · v2_call: 20 · vendor_unchanged: 5
agentic-04agentic25failed_attempts: 10 · state_integrity: 15
systems-03systems100copy_update_nested: 30 · exclude: 15 · hashes_and_sizes: 10 · idempotent: 5 · manifest_membership: 10 · preserve_runtime: 10 · sorted_paths: 5 · stale_cleanup: 15
Back to historical results