Task gallery / Data processing / data science / Version 1
Reference solution (oracle)
Pass
No-op resistance check
Pass
QA verdict
superseded by v2
Aggregate eligibility
Eligible version

The task

Add kernel conditional conformal regression to the nonconformist checkout at /repo. We need the complete regularized kernel quantile solution paths so we can examine smoothness and invert the augmented test-score fit without repeatedly fitting a quantile model on a score grid. Integrate this with the repository's nonconformity scorers and regression workflow. Computation is CPU-only; dependencies are installed and i…

Excerpt only; not a complete executable task specification. Task ID sfdata2/nonconformist-kernel-quantile-path · version 1. Selection status: known curated delivery cohort.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
GPT-6 Astra · medium0/20 / 20
GOOD_FAILURE: 0
BAD_FAILURE: 0
GOOD_SUCCESS: 0
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

32 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
nonconformist-kernel-quantile-pa__7HdWNno
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__9WYKiKk
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__G94PAjN
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__NpYh4oK
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__e3xatt6
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__oVKt9sh
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__2nPC2Lw
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__HT5UFhd
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__KivuoCF
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__VpGPpDf
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__dMrWopq
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__mFZZ6Qc
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__GQbPHcE
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__VMGUqSE
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__fhi43U3
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__uoBMqZK
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__ycXD9Us
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__yuCaPdB
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__AkqizcJ
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__CqEdXxL
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__XRgXPb8
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__d463zKr
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__eSzanra
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__onoT2JD
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__BcmJepg
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__N2Q2Q6o
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__YeWSBjc
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__jj9Vog6
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__sWbMqLS
nop@@
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__vmvsXu2
oracle@@
Oct 20, 2026
delivery
1 · validNo diagnostic label
derived
Tokens: —
Turns: —
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__Yq46fXF
GPT-6 Astra · medium
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: 18,211
Turns: 39
Cost: —
Not publicly available
nonconformist-kernel-quantile-pa__uEPJYNh
GPT-6 Astra · medium
Oct 20, 2026
delivery
0 · validNo diagnostic label
derived
Tokens: 28,295
Turns: 63
Cost: —
Not publicly available