etcd-fix-race-berween-read-index-and-lea

Task gallery / Software engineering / Version 1

Reference solution (oracle): Pass
No-op resistance check: Pass
QA verdict: Not recorded
Aggregate eligibility: Excluded / other version

The task

Some operations in this etcd build return the wrong results Teams using this build of etcd, a distributed key-value store, have started filing reports: a read comes back with a value a later write already replaced, a write the cluster acknowledged is missing from the next read, or a key is returned at the wrong revision. There is no crash and no error message. It compiles cleanly and its own test suite is green, whi…

Excerpt only; not a complete executable task specification. Task ID task_17499976e3a34d09 · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes
Claude Opus 5 · default (unverified)	0/5 · 0.0% [0.0%, 43.4%]	0 / 5	2	GOOD_FAILURE: 0 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0
Claude Opus 5 · high	0/0	0 / 0	0	GOOD_FAILURE: 0 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0

Legacy evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes

Difficulty, with uncertainty

Selected-best difficulty: 100.0% [56.6%, 100.0%]. This is one minus the best measured current-row pass rate among rows with at least five valid runs.

The maximum is selected from the observed rows, so the estimate is optimistic. Its Wilson interval is not adjusted for model selection. “Hard” requires qualifying GOOD_FAILURE evidence; the threshold flag additionally requires the interval and recorded quality gates to meet the documented rule. This is not independent validation. Threshold flag: no.

Every recorded run

17 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / model	Date / source	Reward / eligibility	Diagnostic class / source	Resources	Evidence
`trial_32c943dcf9b2412c` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_7873be4974a94f90` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_d2c08413d2c34002` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_ae8e67475e4e4cd9` oracle@@	Oct 8, 2026 console	1 · excludedsource_evidence_exclusion	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`trial_7049eae512ae4bc4` nop@@	Oct 8, 2026 console	0 · excludedsource_evidence_exclusion	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`trial_ad79f51dfe1f4af4` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	0 · valid	No diagnostic label derived	Tokens: 149,055 Turns: 148 Cost: $20.6070	Not publicly available
`trial_7de3ace0233541c1` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	0 · valid	No diagnostic label derived	Tokens: 208,984 Turns: 204 Cost: $33.7105	Not publicly available
`trial_46964aed48cd4b12` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	0 · valid	No diagnostic label derived	Tokens: 120,601 Turns: 155 Cost: $22.8118	Not publicly available
`trial_338c035c4eaa449c` Claude Opus 5 · default (unverified)	Oct 9, 2026 console	0 · valid	No diagnostic label derived	Tokens: 122,416 Turns: 98 Cost: $12.1022	Not publicly available
`trial_34cb167629c749ca` Claude Opus 5 · default (unverified)	Oct 9, 2026 console	0 · valid	No diagnostic label derived	Tokens: 168,324 Turns: 155 Cost: $23.5183	Not publicly available
`trial_9f0fa3c482944030` Claude Opus 5 · default (unverified)	Oct 12, 2026 console	0 · excludedharness_error	HARNESS_ERROR frozen-classifier	Tokens: 0 Turns: 1 Cost: $0.0000	Not publicly available
`trial_f6597bcf82a44d77` Claude Opus 5 · default (unverified)	Oct 12, 2026 console	0 · excludedharness_error	HARNESS_ERROR frozen-classifier	Tokens: 0 Turns: 1 Cost: $0.0000	Not publicly available
`trial_13cc656f78704bbf` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_916ea940e7bb461a` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_ba9f5c0f3d274d71` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_cf2f40f371b74e1c` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_ef3190d68a0d4946` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available