SyncValsverifier → artifact → classifier → verdict
SyncVals · Task

hono-http-cache-rfc9111

Long Horizon0/20 resolved↑ All tasks
pass@10.0%
pass@k0.0% @20
resolved0/20
dominantGOOD_FAILURE
genuinek=20
median runtime29m 20s
During each run the agent saw only the starter workspace; tests/ and solution/ were withheld and restored only for grading. The reference solution/ is shown below for transparency.
Runs (20) , every recorded attempt at this task
AgentModelRewardRuntimeToolsClassification
claude-codeclaude-opus-5✗ failed30m 43s77GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed34m 34s88GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed23m 55s54GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed27m 42s56GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed33m 21s87GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed29m 17s68GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed34m 14s81GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed31m 46s77GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed29m 24s85GOOD_FAILUREview →
claude-codeclaude-opus-5✗ failed33m 21s92GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed26m 44s64GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed2h 31m64GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed28m 19s86GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed32m 49s81GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed23m 44s54GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed27m 51s60GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed23m 36s63GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed31m 26s70GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed25m 13s57GOOD_FAILUREview →
codexgpt-5.6-sol✗ failed27m 37s56GOOD_FAILUREview →
Task files , workspace, grader & reference answer
Select a file
Select a file from the tree to view it.

The task as the agent saw it and the verifier graded it. The reference solution/ is included below for transparency.