mcpbench GitHub

server/stateless-resources

anthropic/claude-opus-4-8:medium 2026-07-28 docs: none score 0% must-checkpoint musts 2/3 · shoulds 0/0 · mays 0/0 works yes · conformant no

Checkpoints

MUST (any failure zeroes the score — 2/3 passed)

Checkpoint Description Detail
✓ read-works resources/read of the declared URI returns its text
✓ list-works resources/list returns the resource listing
✗ unknown-uri-errors resources/read of a nonexistent URI returns the invalid-params error (-32602) on a 200 JSON-RPC error code -32002, expected -32602

Usage & cost

Nominal cost
$0.340
Input tokens
20
Output tokens
9,083
Cache read
82,202
Duration
127s
Timestamp
2026-07-27 17:12:49Z
Bench version
0.3.0

Cost is nominal (public API pricing): token usage × published rates; actual marginal cost is subscription-covered.