Task gallery / Science / STEM / Version 1
Task evidence / console
syncrope/real-tandf-33so2-nu1nu3-coriolis-heldout-highka-lines
contested/defectiveCurrent calibratedOutside aggregate scope- Reference solution (oracle)
- Pass
- No-op resistance check
- Pass
- QA verdict
- taxonomy: Evaluating; QA: Local QA passed + SEE gate 1 PASS (00:55 IST)
- Aggregate eligibility
- Excluded / other version
Quality exclusion
- Known task defect recorded
These per-version observations remain visible, but this version does not contribute to aggregate pass rates.
The task
Where the high-Ka stretching levels sit Our high-resolution infrared group has finished assigning the room-temperature spectrum of a bent symmetric triatomic molecule, point group C2v, in the region of its two stretching fundamentals. The symmetric stretch v1, near 1148 cm-1, gives a b-type band; the antisymmetric stretch v3, near 1356 cm-1, gives an a-type band. From the assigned lines the observers derived the ene…
Excerpt only; not a complete executable task specification. Task ID task_654ebf40c2d44457 · version 1. Selection status: not fully recorded.
Results by model and effort
This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.
Current evidence
| Model / effort | Verifier result [95% Wilson] | Diagnostic labels / valid | HARNESS_ERROR · excluded | Outcome classes |
|---|---|---|---|---|
| Claude Opus 5 · default (unverified) | 2/7 · 28.6% [8.2%, 64.1%] | 7 / 7 | 3 | GOOD_FAILURE: 5 BAD_FAILURE: 0 GOOD_SUCCESS: 2 BAD_SUCCESS: 0 |
Legacy evidence
| Model / effort | Verifier result [95% Wilson] | Diagnostic labels / valid | HARNESS_ERROR · excluded | Outcome classes |
|---|
Every recorded run
24 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.
| Run / model | Date / source | Reward / eligibility | Diagnostic class / source | Resources | Evidence |
|---|---|---|---|---|---|
trial_5a161cccf4254e46oracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_78f9f1a55ff148e7nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_10a2f5772f034057nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_cad5c1cb9a0e4cc2oracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_6a994c6f725f4c45nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_a36e0875a4324c1eoracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_2ab474c979ba4df2nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_6d3d607bf8ea4a4foracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_70fd8ebaa13d4d98oracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_aab27f68da8d41d5nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_526213773c4c48f1nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_84b5d0844b6e4673oracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_bede2ff88e594d34nop@@ | Oct 13, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_fa3d503f8ecb4fc0oracle@@ | Oct 13, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: — Turns: — Cost: — | Not publicly available |
trial_25db71737b02416bClaude Opus 5 · default (unverified) | Oct 14, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: 219,246 Turns: 98 Cost: $18.4580 | Not publicly available |
trial_3dd3a700fcca4b44Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 1 · valid | GOOD_SUCCESS frozen-classifier | Tokens: 276,434 Turns: 155 Cost: $30.8754 | Not publicly available |
trial_5209caf66c7a4111Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: 237,267 Turns: 186 Cost: $26.7609 | Not publicly available |
trial_01e354b78b3c473eClaude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: 14,572 Turns: 6 Cost: $0.6065 | Not publicly available |
trial_0713953e0cad49a5Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · excludedharness_error | HARNESS_ERROR independent-review | Tokens: 0 Turns: 1 Cost: $0.0000 | Not publicly available |
trial_15d82397ef514763Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: 207,758 Turns: 95 Cost: $16.6050 | Not publicly available |
trial_66245215d8e64ea2Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: 67,710 Turns: 31 Cost: $3.7650 | Not publicly available |
trial_6a4f55d026794967Claude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · valid | GOOD_FAILURE frozen-classifier | Tokens: 83,903 Turns: 55 Cost: $6.2481 | Not publicly available |
trial_9a9562f82bf4496dClaude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · excludedharness_error | HARNESS_ERROR independent-review | Tokens: 0 Turns: 1 Cost: $0.0000 | Not publicly available |
trial_a15c96bc94ed4eebClaude Opus 5 · default (unverified) | Oct 14, 2026 console | 0 · excludedharness_error | HARNESS_ERROR independent-review | Tokens: 0 Turns: 1 Cost: $0.0000 | Not publicly available |