timescaledb-fix-invalidation-and-batchin

Task gallery / DeepSWE (long-horizon SWE) / Version 1

Reference solution (oracle): Pass
No-op resistance check: Pass
QA verdict: Not recorded
Aggregate eligibility: Eligible version

The task

Some operations in this TimescaleDB build return the wrong results Teams using this build of TimescaleDB, a time-series extension for PostgreSQL, have started filing reports: queries over hypertables return the wrong rows. There is no crash and no error message. It compiles cleanly and its own test suite is green, which is exactly how this reached them unnoticed. The reports cluster around refreshing continuous aggr…

Excerpt only; not a complete executable task specification. Task ID task_0d0eb0d05b024025 · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes
Claude Opus 5 · default (unverified)	2/2	0 / 2	0	GOOD_FAILURE: 0 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0
Claude Opus 5 · high	0/0	0 / 0	0	GOOD_FAILURE: 0 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0

Legacy evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes

Every recorded run

10 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / model	Date / source	Reward / eligibility	Diagnostic class / source	Resources	Evidence
`trial_503ed985003d4cee` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	1 · valid	No diagnostic label derived	Tokens: 257,897 Turns: 281 Cost: $47.2057	Not publicly available
`trial_630d223b38cc4064` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	1 · valid	No diagnostic label derived	Tokens: 188,762 Turns: 148 Cost: $20.4320	Not publicly available
`trial_a2f1810ffe3e486f` Claude Opus 5 · default (unverified)	Oct 8, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_88434955e9ba439e` oracle@@	Oct 8, 2026 console	1 · excludedsource_evidence_exclusion	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`trial_c655010fa173426f` nop@@	Oct 8, 2026 console	0 · excludedsource_evidence_exclusion	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`trial_40608c95567045b1` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_4b4845ed59334751` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_827cf12ccc6f4d76` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_ab476de977bf4b0a` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available
`trial_bc22c453511d4d38` Claude Opus 5 · high	Oct 21, 2026 console	No reward · excludedno_reward	No diagnostic label No diagnostic source	Tokens: — Turns: — Cost: —	Not publicly available