Task gallery / Data processing / data science / Version 1
Reference solution (oracle)
Pass
No-op resistance check
Pass
QA verdict
REJECT (#607)
Aggregate eligibility
Eligible version

The task

Add selective inference for mean changes to the ruptures checkout at /repo. We want to reuse a signal for changepoint detection and inference without treating a detected change as if it had been chosen in advance. Support both squared-error and median absolute-deviation detection. We also need a complete parametric segmentation path for inspecting how the selected model changes. Use the installed CPU dependencies; i…

Excerpt only; not a complete executable task specification. Task ID sfdata2/ruptures-selective-mean · version 1. Selection status: known curated delivery cohort.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

No named-agent evidence is recorded for this task version.

Every recorded run

12 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
ruptures-selective-mean__4maoEuY
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__7EWr5SJ
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__SrDAVSX
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__aVw5Czh
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__gkN5tQq
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__zvV4bBV
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__2PZiCq8
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__Cfb6wr8
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__WrczM59
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__XAd6qfr
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__aLFuQao
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
ruptures-selective-mean__tHkMqqg
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available