Task gallery / Operations / Version 4
Task evidence / delivery

occurrence-reinsurance-recovery-bordereau

contested/defectiveCurrent calibratedKnown curated cohortOutside aggregate scope
Reference solution (oracle)
Unverified
No-op resistance check
Unverified
QA verdict
EXCLUDE (reviewer recommendation; owner decision pending)
Aggregate eligibility
Excluded / other version
Quality exclusion
  • Known task defect recorded
  • Task fault on at least half of labelled current-model failures

These per-version observations remain visible, but this version does not contribute to aggregate pass rates.

The task

An instruction excerpt is not available in the public snapshot.

Excerpt only; not a complete executable task specification. Task ID task_11c1e7d970804362 · version 4. Selection status: known curated delivery cohort.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
Claude Opus 5 · high2/5 · 40.0% [11.8%, 76.9%]5 / 50
GOOD_FAILURE: 0
BAD_FAILURE: 3
GOOD_SUCCESS: 2
BAD_SUCCESS: 0
Tencent HY4 (preview) · think0/8 · 0.0% [0.0%, 32.4%]8 / 80
GOOD_FAILURE: 3
BAD_FAILURE: 5
GOOD_SUCCESS: 0
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

13 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
trial_1bddbaafe9b74647
Claude Opus 5 · high		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 21
Cost: —		Not publicly available
trial_1c05b73d0ccc4f82
Claude Opus 5 · high		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 17
Cost: —		Not publicly available
trial_3c9cb8d971704329
Claude Opus 5 · high		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 15
Cost: —		Not publicly available
trial_9967b847efc144fc
Claude Opus 5 · high		Not recorded
delivery		1 · validGOOD_SUCCESS
independent-review		Tokens: —
Turns: 14
Cost: —		Not publicly available
trial_e87e8c742c324bc4
Claude Opus 5 · high		Not recorded
delivery		1 · validGOOD_SUCCESS
independent-review		Tokens: —
Turns: 15
Cost: —		Not publicly available
trial_14234cb937d94888
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 24
Cost: —		Not publicly available
trial_26ef6c7a82b64384
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 39
Cost: —		Not publicly available
trial_503198e1b58d44b0
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 23
Cost: —		Not publicly available
trial_5bfd270fc7064117
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 23
Cost: —		Not publicly available
trial_7008ac532e324b85
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 29
Cost: —		Not publicly available
trial_8f976bce3eed41ca
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 32
Cost: —		Not publicly available
trial_9f039987606141bb
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validBAD_FAILURE
independent-review		Tokens: —
Turns: 29
Cost: —		Not publicly available
trial_abcc237b14e74d20
Tencent HY4 (preview) · think		Not recorded
delivery		0 · validGOOD_FAILURE
independent-review		Tokens: —
Turns: 19
Cost: —		Not publicly available