mcpbench GitHub

client/mrtr-no-state

anthropic/claude-opus-4-8:medium 2026-07-28 docs: none score 100% musts 8/8 · shoulds 0/0 · mays 0/0 works yes · conformant yes

Checkpoints

MUST (any failure zeroes the score — 8/8 passed)

Checkpoint Description
ca-info-called Called get_ca_info
certificate-tool-success Called request_certificate for "demo.example.com"
final-complete The certificate retry carrying inputResponses received the complete result
no-fabricated-request-state The retry did not fabricate a requestState (none was issued)
retry-isolation MRTR fields never leaked onto unrelated requests (e.g. get_ca_info)
absent-result-type-is-complete Treated the resultType-less get_ca_info result as complete (never retried it)
retry-input-correlated The retry carried an accepted ElicitResult for contact (email=ops@example.com)
retry-new-jsonrpc-id The retry used a fresh JSON-RPC id

Usage & cost

Nominal cost
$0.382
Input tokens
40
Output tokens
8,879
Cache read
154,731
Duration
136s
Timestamp
2026-07-18 11:06:15Z
Bench version
0.3.0

Cost is nominal (public API pricing): token usage × published rates; actual marginal cost is subscription-covered.