syncrope/n3js-rdf-canonicalization

Task gallery / DeepSWE (long-horizon SWE) / Version 1

Reference solution (oracle): Pass
No-op resistance check: Unverified
QA verdict: Not recorded
Aggregate eligibility: Eligible version

The task

N3.js parses, stores, and writes RDF quads, but Store#toCanonical() still throws not implemented and the library cannot compute a canonical form of a dataset. Implement W3C RDF Dataset Canonicalization exactly as specified by RDFC-1.0, the W3C Recommendation of 21 May 2024 ([source link]), including its canonical N-Quads form (Appendix A). The Recommendation is the specification; every behavior be…

Excerpt only; not a complete executable task specification. Task ID task_d483c707635f46fd · version 1. Selection status: not fully recorded.

Results by model and effort

This exact task version only. Every rate is passes / valid runs with a Wilson 95% interval; n≤2 remains counts only. Macro aggregation does not apply within a single task. Baselines are summarized in the quality gates, not ranked. A passed no-op resistance check means that doing nothing did not solve the task.

Current evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes

Legacy evidence

Model / effort	Verifier result [95% Wilson]	Diagnostic labels / valid	HARNESS_ERROR · excluded	Outcome classes
Claude Opus 4.8 · default (unverified)	1/5 · 20.0% [3.6%, 62.4%]	5 / 5	0	GOOD_FAILURE: 3 BAD_FAILURE: 1 GOOD_SUCCESS: 1 BAD_SUCCESS: 0

Every recorded run

6 recorded trials, including controls. Diagnostic labels do not replace verifier reward. Labels and quality checks are source declarations, not independently attested here. Internal evidence remains private; a missing public URL is shown explicitly. Records with invalid or absent rewards are not scored.

Run / model	Date / source	Reward / eligibility	Diagnostic class / source	Resources	Evidence
`trial_0849b1c0b82b4af9` Claude Opus 4.8 · default (unverified)	Aug 29, 2026 console	0 · valid	GOOD_FAILURE frozen-classifier	Tokens: 122,956 Turns: 120 Cost: $12.4286	Not publicly available
`trial_117c64bbced84a57` Claude Opus 4.8 · default (unverified)	Aug 29, 2026 console	0 · valid	BAD_FAILURE frozen-classifier	Tokens: 131,316 Turns: 139 Cost: $15.2597	Not publicly available
`trial_77192974dd2a4950` Claude Opus 4.8 · default (unverified)	Aug 29, 2026 console	1 · valid	GOOD_SUCCESS frozen-classifier	Tokens: 173,729 Turns: 160 Cost: $21.4753	Not publicly available
`trial_8bb633028912413d` Claude Opus 4.8 · default (unverified)	Aug 29, 2026 console	0 · valid	GOOD_FAILURE frozen-classifier	Tokens: 127,719 Turns: 108 Cost: $12.2285	Not publicly available
`trial_bfd7b4d52eb9440f` Claude Opus 4.8 · default (unverified)	Aug 29, 2026 console	0 · valid	GOOD_FAILURE frozen-classifier	Tokens: 160,236 Turns: 142 Cost: $18.1383	Not publicly available
`trial_4c215f1eec5d41dd` oracle@@	Sep 1, 2026 console	1 · valid	GOOD_SUCCESS frozen-classifier	Tokens: — Turns: — Cost: —	Not publicly available