datasciresearch/rlm-sandwich-covariance

Task gallery / Data processing / data science / Version 1

Reference solution (oracle): Pass
No-op resistance check: Pass
QA verdict: in-house design (no vendor PR); see docs/reports/datasci-research-v5
Aggregate eligibility: Eligible version

The task

Our users fit RLM with scaleest=HuberScale() to skewed outcomes such as spending and visit counts, often with a spread that grows with the regressors, and the H1/H2/H3 standard errors are well off for them. Please add a sandwich covariance to the statsmodels repo at /app/repo and commit it. Add RLMResults.covparamssandwich(). It should return the large-sample covariance of the coefficients that fit returned, shaped …

Excerpt only; not a complete executable task specification. Task ID sfdata2/rlm-sandwich-covariance · version 1. Selection status: known curated delivery cohort.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes
GPT-6 Astra · medium	2/2	0 / 2	0	GOOD_FAILURE: 0 BAD_FAILURE: 0 GOOD_SUCCESS: 0 BAD_SUCCESS: 0

Legacy evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes

Every recorded run

8 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / model	Date / source	Reward / eligibility	Diagnostic class / source	Resources	Evidence
`rlm-sandwich-covariance__4GfQqMx` nop@@	Oct 22, 2026 delivery	0 · valid	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`rlm-sandwich-covariance__JPQQetJ` nop@@	Oct 22, 2026 delivery	0 · valid	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`rlm-sandwich-covariance__MaKyyg8` oracle@@	Oct 22, 2026 delivery	1 · valid	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`rlm-sandwich-covariance__PcCU5pe` oracle@@	Oct 22, 2026 delivery	1 · valid	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`rlm-sandwich-covariance__gLdcGfB` nop@@	Oct 22, 2026 delivery	0 · valid	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`rlm-sandwich-covariance__vuouajM` oracle@@	Oct 22, 2026 delivery	1 · valid	No diagnostic label derived	Tokens: — Turns: — Cost: —	Not publicly available
`rlm-sandwich-covariance__5PqQtca` GPT-6 Astra · medium	Oct 22, 2026 delivery	1 · valid	No diagnostic label derived	Tokens: 6,959 Turns: 17 Cost: —	Not publicly available
`rlm-sandwich-covariance__WRDRJSu` GPT-6 Astra · medium	Oct 22, 2026 delivery	1 · valid	No diagnostic label derived	Tokens: 5,606 Turns: 16 Cost: —	Not publicly available