Task gallery / Media / Version 1
Reference solution (oracle)
Pass
No-op resistance check
Fail
QA verdict
taxonomy: Evaluating; QA: QA-I READY
Aggregate eligibility
Excluded / other version
Quality exclusion
  • Known task defect recorded
  • Empty solution passes

These per-version observations remain visible, but this version does not contribute to aggregate pass rates.

The task

The abglyph workspace turns fonts into glyph outlines - Font, OutlinedGlyph, OutlineCurve, Point, PxScale - and ships abglyphrasterizer::Rasterizer, which yields only a raw per-pixel coverage value. There is no colour, pixel buffer, fill-rule choice, affine transform, compositing, gradient, clip, stroking, or glyph cache. Build the missing piece: a new workspace crate abglyphrender in the directory render/ (add rend…

Excerpt only; not a complete executable task specification. Task ID task_480dcb0133ab4166 · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes
Claude Opus 5 · default (unverified)1/11 / 12
GOOD_FAILURE: 0
BAD_FAILURE: 0
GOOD_SUCCESS: 1
BAD_SUCCESS: 0

Legacy evidence

Model / effortVerifier result [95% Wilson]Diagnostic labels / validHARNESS_ERROR · excludedOutcome classes

Every recorded run

8 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / modelDate / sourceReward / eligibilityDiagnostic class / sourceResourcesEvidence
trial_09c8f4d3134c4486
nop@@
Oct 13, 2026
console
1 · validBAD_SUCCESS
frozen-classifier
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_60baea0873c6453e
oracle@@
Oct 13, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_7cd27f77d41741a7
oracle@@
Oct 13, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_acd459aed53a4146
nop@@
Oct 13, 2026
console
0 · validGOOD_FAILURE
frozen-classifier
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_6e94f64a51ee4719
Claude Opus 5 · default (unverified)
Oct 13, 2026
console
0 · excludedharness_errorHARNESS_ERROR
independent-review
Tokens: 0
Turns: 1
Cost: $0.0000
Not publicly available
trial_cd07218ff06b41d8
Claude Opus 5 · default (unverified)
Oct 13, 2026
console
No reward · excludedno_rewardNo diagnostic label
No diagnostic source
Tokens: —
Turns: —
Cost: —
Not publicly available
trial_e3b6f149268f4d39
Claude Opus 5 · default (unverified)
Oct 13, 2026
console
0 · excludedharness_errorHARNESS_ERROR
independent-review
Tokens: 0
Turns: 1
Cost: $0.0000
Not publicly available
trial_d301cd483a5b46a9
Claude Opus 5 · default (unverified)
Oct 14, 2026
console
1 · validGOOD_SUCCESS
frozen-classifier
Tokens: 284,172
Turns: 177
Cost: $32.1590
Not publicly available