qdrant-fix-gridstore-has-pointer-lookup

Task gallery / DeepSWE (long-horizon SWE) / Version 1

Reference solution (oracle): Pass
No-op resistance check: Pass
QA verdict: Not recorded
Aggregate eligibility: Excluded / other version

Quality exclusion

Task fault on at least half of labelled current-model failures

These per-version observations remain visible, but this version does not contribute to aggregate pass rates.

The task

Some searches in this Qdrant build return the wrong results Teams using this build of Qdrant have started filing reports: certain queries come back with results that are simply wrong. There is no panic and no error, the request succeeds and the payload it returns is incorrect. The workspace compiles cleanly and cargo test is green, which is exactly how this reached them unnoticed. The reports do have one thing in co…

Excerpt only; not a complete executable task specification. Task ID task_11657b566bd84269 · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes
Claude Opus 5 · default (unverified)	0/3 · 0.0% [0.0%, 56.1%] · preliminary	2 / 3	0	GOOD_FAILURE: 0 BAD_FAILURE: 2 GOOD_SUCCESS: 0 BAD_SUCCESS: 0
Claude Opus 5 · high	0/1	1 / 1	0	GOOD_FAILURE: 1 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0

Legacy evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes

Every recorded run

19 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / model	Date / source	Reward / eligibility	Diagnostic class / source	Resources	Evidence
`trial_0a437698ed7d434b` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_49335edeabc346c0` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_826370415dfa4ff2` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_f0b71517b2c049e9` oracle@@	Oct 8, 2026 console	1 · excludedsource_evidence_exclusion	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`trial_a8b0dda313cf44c6` nop@@	Oct 8, 2026 console	0 · excludedsource_evidence_exclusion	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`trial_1c2cfd174d4d4150` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_ce2ddbbf3ecf467c` Claude Opus 5 · default (unverified)	Oct 9, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: 58,045 Turns: 74 Cost: $6.8824	Not publicly available
`trial_7730c60c2b7b4fdb` Claude Opus 5 · default (unverified)	Oct 9, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_e61cb0ce0c1d4553` Claude Opus 5 · default (unverified)	Oct 9, 2026 console	0 · valid	No diagnostic label derived	Tokens: 58,432 Turns: 58 Cost: $5.3010	Not publicly available
`trial_4920e7e88f104fd9` Claude Opus 5 · default (unverified)	Oct 9, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_3954fad730d24e1e` Claude Opus 5 · default (unverified)	Oct 12, 2026 console	0 · valid	BAD_FAILURE frozen-classifier	Tokens: 63,483 Turns: 79 Cost: $6.8036	Not publicly available
`trial_593433f392254555` Claude Opus 5 · default (unverified)	Oct 12, 2026 console	0 · valid	BAD_FAILURE frozen-classifier	Tokens: 96,461 Turns: 103 Cost: $12.3285	Not publicly available
`trial_03e23d58697e45d1` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_3224b8563aa242fd` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_3929e8f0157a46dd` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_86561c944302473c` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_bc4d1b13b5764c95` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_3a5ba2c5ed6248ae` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_fd4723927b304432` Claude Opus 5 · high	Oct 21, 2026 console	0 · valid	GOOD_FAILURE frozen-classifier	Tokens: 23,447 Turns: 54 Cost: $3.6254	Not publicly available