Task gallery / Operations / Version 1
Reference solution (oracle)
Pass
No-op resistance check
Pass
QA verdict
Not recorded
Aggregate eligibility
Eligible version

The task

Ceded recovery workpaper Ceded claims accounting needs a recovery report from occurrence losses and treaty terms. Aggregate the claim components, apply treaty participation and track reinstatement premiums and remaining capacity across the treaty period. The /app/repo/reinsurance-books/ job separates occurrences, claims and treaties. Output should retain occurrence and claim identifiers for reconciliation. /app/repo…

Excerpt only; not a complete executable task specification. Task ID task_4e3b020aafeb4d8e · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
Claude Opus 5 · xhigh0/11 / 10
GOOD_FAILURE: 0
BAD_FAILURE: 1
GOOD_SUCCESS: 0
BAD_SUCCESS: 0
Tencent HY4 (preview) · think0/00 / 00
GOOD_FAILURE: 0
BAD_FAILURE: 0
GOOD_SUCCESS: 0
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

8 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
trial_d2b92da808c54d52
Claude Opus 5 · xhigh
Oct 21, 2026
console
0 · validBAD_FAILURE
independent-review
Tokens: 45,694
Turns: 27
Cost: $2.3718
Not publicly available
trial_391a686e5ab04226
Tencent HY4 (preview) · think
Oct 21, 2026
console
0 · excludedsource_evidence_exclusionBAD_FAILURE
independent-review
Tokens: 23,331
Turns: 15
Cost: $1.1338
Not publicly available
occurrence-reinsurance-recovery-bordereau-oracle-1-45d55a79
oracle@@
Oct 21, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
occurrence-reinsurance-recovery-bordereau-nop-446d4794
nop@@
Oct 21, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
occurrence-reinsurance-recovery-bordereau-oracle-2-101d921f
oracle@@
Oct 21, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
occurrence-reinsurance-recovery-bordereau-oracle-1-a19c79a0
oracle@@
Oct 21, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
occurrence-reinsurance-recovery-bordereau-nop-17bb26c8
nop@@
Oct 21, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
occurrence-reinsurance-recovery-bordereau-oracle-2-0173ca2e
oracle@@
Oct 21, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available