Task gallery / Data processing / data science / Version 1
Reference solution (oracle)
Pass
No-op resistance check
Pass
QA verdict
superseded by v2 (h34 clean cohort)
Aggregate eligibility
Eligible version

The task

Please add covgmmaugmented(moments, jacobian, hessian, weights, rcond=1e-12) to statsmodels.stats.sandwichcovariance. We need misspecification-aware covariance estimates and the attainable efficient bound from the augmented moment system. Document the function, preserve existing covariance helpers, and commit the change. Inputs are per-observation moment values g (n,m), their Jacobians G (n,m,p), their Hessians F (n…

Excerpt only; not a complete executable task specification. Task ID sfdata2/augmented-gmm-covariance · version 1. Selection status: known curated delivery cohort.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
GPT-6 Astra · medium1/20 / 21
GOOD_FAILURE: 0
BAD_FAILURE: 0
GOOD_SUCCESS: 0
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

9 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
augmented-gmm-covariance__9JRbU5X
oracle@@
Oct 18, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
augmented-gmm-covariance__AeVKBdZ
nop@@
Oct 18, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
augmented-gmm-covariance__AimLWXy
oracle@@
Oct 18, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
augmented-gmm-covariance__ETCF5be
nop@@
Oct 18, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
augmented-gmm-covariance__KCkmX5D
nop@@
Oct 18, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
augmented-gmm-covariance__adPBNvC
oracle@@
Oct 18, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
augmented-gmm-covariance__LHeU7TB
GPT-6 Astra · medium
Oct 18, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: 40,968
Turns: 107
Cost: —
Not publicly available
augmented-gmm-covariance__uyLJDPK
GPT-6 Astra · medium
Oct 18, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: 29,794
Turns: 67
Cost: —
Not publicly available
augmented-gmm-covariance__vngTxPA
GPT-6 Astra · medium
Oct 18, 2026
delivery
No reward · excludedno_rewardHARNESS_ERROR
derived
Tokens: 16,897
Turns: 34
Cost: —
Not publicly available