mcpbench GitHub

client/oauth-cimd-over-dcr

anthropic/claude-opus-4-8:medium 2025-11-25 docs: full score 0% musts 7/7 · shoulds 0/1 · mays 0/0 works yes · conformant yes

Checkpoints

MUST (any failure zeroes the score — 7/7 passed)

Checkpoint Description
✓ cimd-document-hosted If the CIMD path was taken, the AS fetched the hosted document successfully
✓ cimd-document-shape If the CIMD path was taken, the document carried the required properties
✓ cimd-client-id-match If the CIMD path was taken, the document's client_id matched its URL exactly
✓ pkce S256 code_challenge on authorize; matching code_verifier at token
✓ resource-indicator Included RFC 8707 resource=<canonical server URI> in both requests
✓ bearer-token All post-grant accepted MCP requests carried Authorization: Bearer; the token never appeared in a URL
✓ authorized-tool-call Successfully called get_secret_number once authorized

SHOULD (the score fraction — 0/1 passed)

Checkpoint Description Detail
✗ cimd-preferred The exchanged authorization used a URL client_id, not a DCR-issued id the exchanged authorization's client_id "mcpbench-8337e07ec4aea516" is not a URL with a path component

Usage & cost

Nominal cost
$0.773
Input tokens
54
Output tokens
18,082
Cache read
306,248
Duration
280s
Timestamp
2026-07-18 13:14:11Z
Bench version
0.3.0

Cost is nominal (public API pricing): token usage × published rates; actual marginal cost is subscription-covered.