deflate-inflate-streaming-v3
saturatedCurrent calibratedChosen benchmark version- Reference solution (oracle)
- Pass
- No-op resistance check
- Pass
- QA verdict
- taxonomy: Evaluating; QA: QA-D READY (oracle root/uid1000 1, nop 0, alt_combaddr
- Aggregate eligibility
- Eligible version
The task
Excerpt only; not a complete executable task specification. Task ID task_b5802ccdd9e440a4 · version 1. Selection status: not fully recorded.
Results by model and effort
This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.
Current evidence
| Model / effort | Verifier result [95% Wilson] | Diagnostic labels / valid | HARNESS_ERROR · excluded | Outcome classes |
|---|---|---|---|---|
| Claude Opus 5 · default (unverified) | 5/5 · 100.0% [56.6%, 100.0%] | 5 / 5 | 3 | GOOD_FAILURE: 0 BAD_FAILURE: 0 GOOD_SUCCESS: 5 BAD_SUCCESS: 0 |
Legacy evidence
| Model / effort | Verifier result [95% Wilson] | Diagnostic labels / valid | HARNESS_ERROR · excluded | Outcome classes |
|---|
Difficulty, with uncertainty
Selected-best difficulty: 0.0% [0.0%, 43.4%]. This is one minus the best measured current-row pass rate among rows with at least five valid runs.
The maximum is selected from the observed rows, so the estimate is optimistic. Its Wilson interval is not adjusted for model selection. “Hard” requires qualifying GOOD_FAILURE evidence; the threshold flag additionally requires the interval and recorded quality gates to meet the documented rule. This is not independent validation. Threshold flag: no.
Every recorded run
19 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.
| Run / model | Date / source | Reward / eligibility | Diagnostic class / source | Resources | Evidence |
|---|---|---|---|---|---|
trial_26903a9b30fa48e8oracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_4711eda32a0c4518nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_734ee81eb1c94236Claude Opus 5 · default (unverified) | Oct 13, 2026 console | 0 · excludedharness_error | HARNESS_ERROR independent-review | Tokens: 0 Turns: 1 Cost: $0.0000 | Not publicly available |
trial_992f8c35a466427cClaude Opus 5 · default (unverified) | Oct 13, 2026 console | 0 · excludedharness_error | HARNESS_ERROR independent-review | Tokens: 0 Turns: 1 Cost: $0.0000 | Not publicly available |
trial_a24249431cfe4b6bClaude Opus 5 · default (unverified) | Oct 13, 2026 console | 1 · excludedharness_error | HARNESS_ERROR independent-review | Tokens: 82,389 Turns: 22 Cost: $3.9281 | Not publicly available |
trial_5cc1578fb4b2485eClaude Opus 5 · default (unverified) | Oct 13, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_a472d93e587e45bfClaude Opus 5 · default (unverified) | Oct 13, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_e0a2a9ef30a847b9Claude Opus 5 · default (unverified) | Oct 13, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_e695535842024160Claude Opus 5 · default (unverified) | Oct 13, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_8cbe05e8d6074345Claude Opus 5 · default (unverified) | Oct 13, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_c37bad2945dc44c1Claude Opus 5 · default (unverified) | Oct 13, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_024fafb43bb446b9Claude Opus 5 · default (unverified) | Oct 13, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_0ad06b35c5114528Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: 93,935 Turns: 35 Cost: $5.2211 | Not publicly available |
trial_176139ea9c144305Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: 88,167 Turns: 50 Cost: $5.6783 | Not publicly available |
trial_69e122c9682c4973Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: 60,967 Turns: 20 Cost: $2.9363 | Not publicly available |
trial_022bf9c25b1545dcClaude Opus 5 · default (unverified) | Oct 14, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |
trial_24522b6aacda4195Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: 103,897 Turns: 53 Cost: $7.0089 | Not publicly available |
trial_49654fcb31c84a4dClaude Opus 5 · default (unverified) | Oct 14, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: 59,911 Turns: 26 Cost: $3.3379 | Not publicly available |
trial_98303869475c491fClaude Opus 5 · default (unverified) | Oct 14, 2026 console | No reward · excludedno_reward | No diagnostic label No diagnostic source | Tokens: — Turns: — Cost: — | Not publicly available |