Task gallery / Mechanical engineering / Version 1
Task evidence / repo
pipeline-scour-two-thirds-law
legacy-onlyChosen benchmark version- Reference solution (oracle)
- Unverified
- No-op resistance check
- Unverified
- QA verdict
- Not recorded
- Aggregate eligibility
- Eligible version
The task
An instruction excerpt is not available in the public snapshot.
Excerpt only; not a complete executable task specification. Task ID pipeline-scour-two-thirds-law · version 1. Selection status: not fully recorded.
Results by model and effort
This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.
Current evidence
| Model / effort | Verifier result [95% Wilson] | Diagnostic labels / valid | HARNESS_ERROR · excluded | Outcome classes |
|---|
Legacy evidence
| Model / effort | Verifier result [95% Wilson] | Diagnostic labels / valid | HARNESS_ERROR · excluded | Outcome classes |
|---|---|---|---|---|
| Claude Opus 4.8 · default (unverified) | 0/20 · 0.0% [0.0%, 16.1%] | 0 / 20 | 0 | GOOD_FAILURE: 0 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0 |
Every recorded run
20 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.
| Run / model | Date / source | Reward / eligibility | Diagnostic class / source | Resources | Evidence |
|---|---|---|---|---|---|
pipeline-scour-two-thirds-law__49Rs3ZMClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 47,387 Turns: — Cost: $2.1894 | Not publicly available |
pipeline-scour-two-thirds-law__5Rua3UNClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 26,652 Turns: — Cost: $1.1110 | Not publicly available |
pipeline-scour-two-thirds-law__93LYTuRClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 34,983 Turns: — Cost: $1.3164 | Not publicly available |
pipeline-scour-two-thirds-law__JJztipxClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 20,509 Turns: — Cost: $0.8881 | Not publicly available |
pipeline-scour-two-thirds-law__SEkLhwBClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 68,401 Turns: — Cost: $3.9765 | Not publicly available |
pipeline-scour-two-thirds-law__UNNHncMClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 33,267 Turns: — Cost: $1.5013 | Not publicly available |
pipeline-scour-two-thirds-law__iTAGauEClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 28,372 Turns: — Cost: $1.3054 | Not publicly available |
pipeline-scour-two-thirds-law__rDqfHH3Claude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 26,741 Turns: — Cost: $1.1917 | Not publicly available |
pipeline-scour-two-thirds-law__uewrvciClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 39,652 Turns: — Cost: $1.5578 | Not publicly available |
pipeline-scour-two-thirds-law__xTACwTNClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 67,500 Turns: — Cost: $3.4771 | Not publicly available |
pipeline-scour-two-thirds-law__5NyvzJ3Claude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 28,688 Turns: — Cost: $1.3550 | Not publicly available |
pipeline-scour-two-thirds-law__5issySEClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 29,622 Turns: — Cost: $1.2020 | Not publicly available |
pipeline-scour-two-thirds-law__C6K56K8Claude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 29,948 Turns: — Cost: $1.1442 | Not publicly available |
pipeline-scour-two-thirds-law__EPDAhNiClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 54,195 Turns: — Cost: $3.2472 | Not publicly available |
pipeline-scour-two-thirds-law__QMbQP2LClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 19,564 Turns: — Cost: $0.9295 | Not publicly available |
pipeline-scour-two-thirds-law__RoZBWkCClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 27,546 Turns: — Cost: $1.2577 | Not publicly available |
pipeline-scour-two-thirds-law__UBVL3A5Claude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 33,418 Turns: — Cost: $2.3426 | Not publicly available |
pipeline-scour-two-thirds-law__dUMsp62Claude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 42,347 Turns: — Cost: $1.7058 | Not publicly available |
pipeline-scour-two-thirds-law__dgYF28BClaude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 22,979 Turns: — Cost: $1.0850 | Not publicly available |
pipeline-scour-two-thirds-law__m3xwXz5Claude Opus 4.8 · default (unverified) | Not recorded repo | 0 · valid | No diagnostic label derived | Tokens: 23,428 Turns: — Cost: $1.0001 | Not publicly available |