etcd-fix-race-berween-read-index-and-lea

Task gallery / Software engineering / Version 2

Reference solution (oracle): Pass
No-op resistance check: Pass
QA verdict: Not recorded
Aggregate eligibility: Eligible version

The task

Some operations in this etcd build return the wrong results Teams using this build of etcd, a distributed key-value store, have started filing reports: a read comes back with a value a later write already replaced, a write the cluster acknowledged is missing from the next read, or a key is returned at the wrong revision. There is no crash and no error message. It compiles cleanly and its own test suite is green, whi…

Excerpt only; not a complete executable task specification. Task ID task_17499976e3a34d09 · version 2. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes
Claude Opus 5 · high	0/5 · 0.0% [0.0%, 43.4%]	5 / 5	0	GOOD_FAILURE: 5 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0
Tencent HY4 (preview) · think	0/8 · 0.0% [0.0%, 32.4%]	8 / 8	0	GOOD_FAILURE: 8 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0

Legacy evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes

Difficulty, with uncertainty

Selected-best difficulty: 100.0% [67.6%, 100.0%]. This is one minus the best measured current-row pass rate among rows with at least five valid runs.

The maximum is selected from the observed rows, so the estimate is optimistic. Its Wilson interval is not adjusted for model selection. “Hard” requires qualifying GOOD_FAILURE evidence; the threshold flag additionally requires the interval and recorded quality gates to meet the documented rule. This is not independent validation. Threshold flag: yes.

Every recorded run

15 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / model	Date / source	Reward / eligibility	Diagnostic class / source	Resources	Evidence
`trial_288fa7da6ced4fe5` nop@@	Oct 21, 2026 console	0 · valid	GOOD_FAILURE frozen-classifier	Tokens: — Turns: — Cost: —	Not publicly available
`trial_5983546767d94ca8` oracle@@	Oct 21, 2026 console	1 · valid	GOOD_SUCCESS frozen-classifier	Tokens: — Turns: — Cost: —	Not publicly available
`trial_613702765aec47f5` Claude Opus 5 · high	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 156,448 Turns: 166 Cost: $22.9274	Not publicly available
`trial_6bc9e5767e6b4b7a` Claude Opus 5 · high	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 136,137 Turns: 142 Cost: $19.3062	Not publicly available
`trial_82d2a88828fc474b` Claude Opus 5 · high	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 126,749 Turns: 105 Cost: $12.7299	Not publicly available
`trial_92755f744d5140c4` Claude Opus 5 · high	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 118,709 Turns: 126 Cost: $15.9257	Not publicly available
`trial_e0528886865545d8` Claude Opus 5 · high	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 103,152 Turns: 155 Cost: $18.9699	Not publicly available
`trial_f754cb6392d24f3a` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 815,339 Turns: 274 Cost: $70.8593	Not publicly available
`trial_061ef65be67b4885` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 361,767 Turns: 198 Cost: $28.0180	Not publicly available
`trial_206c312143194acf` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 906,422 Turns: 483 Cost: $90.2323	Not publicly available
`trial_4477639a83b24db0` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 649,316 Turns: 241 Cost: $65.2437	Not publicly available
`trial_928f9db5b4d0423b` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 299,718 Turns: 157 Cost: $20.1660	Not publicly available
`trial_ae6334caab964adb` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 1,407,241 Turns: 319 Cost: $124.7925	Not publicly available
`trial_da211cd7108848c0` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 789,961 Turns: 168 Cost: $53.3631	Not publicly available
`trial_eded3f2c7a9c4f63` Tencent HY4 (preview) · think	Oct 21, 2026 console	0 · valid	GOOD_FAILURE independent-review	Tokens: 1,502,216 Turns: 268 Cost: $90.8961	Not publicly available