Task gallery / Scientific computing / Version 1
Reference solution (oracle)
Pass
No-op resistance check
Pass
QA verdict
taxonomy: Evaluating; QA: Local QA passed (QA-E)
Aggregate eligibility
Excluded / other version
Quality exclusion
  • Known task defect recorded

These per-version observations remain visible, but this version does not contribute to aggregate pass rates.

The task

Work order: the missing streak voxels of a platinum catalyst particle under CO We follow how supported platinum catalyst particles change shape and surface strain under reaction gas, using Bragg coherent X-ray diffraction. The particle in this scan is a single platinum crystal a few hundred nanometres across, dewetted onto sapphire, held at 450 C under a flowing CO/argon mixture and rocked through its Pt 002 reflect…

Excerpt only; not a complete executable task specification. Task ID task_3e17a0cc7a1240e4 · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
Claude Opus 5 · default (unverified)3/3 · 100.0% [43.9%, 100.0%] · preliminary3 / 30
GOOD_FAILURE: 0
BAD_FAILURE: 0
GOOD_SUCCESS: 3
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

5 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
trial_89fc4dd140d24225
nop@@
Oct 13, 2026
console
0 · validGOOD_FAILURE
frozen-classifier
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_b997ce4fd2b14f8d
oracle@@
Oct 13, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_5486517720384bd3
Claude Opus 5 · default (unverified)
Oct 14, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: 225,944
Turns: 232
Cost: $30.3112
Not publicly available
trial_d2b085e143e740b0
Claude Opus 5 · default (unverified)
Oct 14, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: 172,538
Turns: 172
Cost: $19.8644
Not publicly available
trial_e20a5c98f6ba45ce
Claude Opus 5 · default (unverified)
Oct 14, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: 138,005
Turns: 147
Cost: $15.5227
Not publicly available