Task gallery / Scientific computing / Version 1
Reference solution (oracle)
Pass
No-op resistance check
Pass
QA verdict
taxonomy: Rejected; QA: QA-H sweep: budget fairness at the 8 h cap (lead chose v
Aggregate eligibility
Excluded / other version
Quality exclusion
  • Known task defect recorded

These per-version observations remain visible, but this version does not contribute to aggregate pass rates.

The task

Marrowfield — the inertia floor the operability review is waiting on Ondine chairs the operability review that sets next winter's inertia floor for the Marrowfield synchronous area, and the interim note she has been handed reads the area's kinetic energy as having risen over the sixteen-month campaign. She wants the trajectory rebuilt from the wide-area records themselves. Load relief arrests a post-contingency decl…

Excerpt only; not a complete executable task specification. Task ID task_5bf47d1535284a34 · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
Claude Opus 5 · default (unverified)3/3 · 100.0% [43.9%, 100.0%] · preliminary3 / 30
GOOD_FAILURE: 0
BAD_FAILURE: 0
GOOD_SUCCESS: 3
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

5 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
trial_08a38e3bd35d49a5
nop@@
Oct 13, 2026
console
0 · validGOOD_FAILURE
frozen-classifier
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_e9d579930c184573
oracle@@
Oct 13, 2026
console
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_079422b31e1b41a5
Claude Opus 5 · default (unverified)
Oct 13, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: 61,367
Turns: 61
Cost: $5.0161
Not publicly available
trial_0ba8d2c9d73d4258
Claude Opus 5 · default (unverified)
Oct 13, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: 84,520
Turns: 56
Cost: $6.0607
Not publicly available
trial_a7548520b1684b62
Claude Opus 5 · default (unverified)
Oct 13, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: 80,386
Turns: 43
Cost: $4.7151
Not publicly available