Task gallery / Machine learning / Version 4
Task evidence / delivery

landmark-competing-risk-scorecard

contested/defectiveCurrent calibratedKnown curated cohortOutside aggregate scope
Reference solution (oracle)
Unverified
No-op resistance check
Unverified
QA verdict
EXCLUDE as packaged (reviewer recommendation; owner decision pending)
Aggregate eligibility
Excluded / other version
Quality exclusion
  • Known task defect recorded

These per-version observations remain visible, but this version does not contribute to aggregate pass rates.

The task

An instruction excerpt is not available in the public snapshot.

Excerpt only; not a complete executable task specification. Task ID task_6137c113d11144a3 · version 4. Selection status: known curated delivery cohort.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
Claude Opus 5 · high2/5 · 40.0% [11.8%, 76.9%]5 / 50
GOOD_FAILURE: 3
BAD_FAILURE: 0
GOOD_SUCCESS: 2
BAD_SUCCESS: 0
Tencent HY4 (preview) · think0/8 · 0.0% [0.0%, 32.4%]8 / 80
GOOD_FAILURE: 8
BAD_FAILURE: 0
GOOD_SUCCESS: 0
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

13 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
trial_452ed8bd816b4273
Claude Opus 5 · high		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 21
Cost: —		Not publicly available
trial_68810950e9174e78
Claude Opus 5 · high		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 13
Cost: —		Not publicly available
trial_96ea16bd09f24917
Claude Opus 5 · high		Not recorded
delivery		1 · validGOOD_SUCCESS
independent-review		Tokens: —
Turns: 20
Cost: —		Not publicly available
trial_e5d684a57c224300
Claude Opus 5 · high		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 27
Cost: —		Not publicly available
trial_ef836b7162704462
Claude Opus 5 · high		Not recorded
delivery		1 · validGOOD_SUCCESS
independent-review		Tokens: —
Turns: 31
Cost: —		Not publicly available
trial_0822d5fae75345a8
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 66
Cost: —		Not publicly available
trial_0e69abd15d5f41e4
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 37
Cost: —		Not publicly available
trial_1fff15690ed64b37
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 54
Cost: —		Not publicly available
trial_253afd4cb8fe4ea7
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 47
Cost: —		Not publicly available
trial_255ca88a06b6423e
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 37
Cost: —		Not publicly available
trial_60652a80410e4e57
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 36
Cost: —		Not publicly available
trial_6678f2eba5044276
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 27
Cost: —		Not publicly available
trial_72ef5410557d4ad3
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 30
Cost: —		Not publicly available