mcpbench GitHub

client/stateless-sse-response

openai/gpt-5.6-sol:medium 2026-07-28 docs: none score 0% must-checkpoint musts 4/5 · shoulds 0/1 · mays 0/0 works yes · conformant no

Checkpoints

MUST (any failure zeroes the score — 4/5 passed)

Checkpoint Description Detail
tool-call Called slow_word
sse-handled Consumed the event-stream response to completion (no premature client abort)
report-word Called report_word with the word slow_word returned ("hippopotamus")
stateless-meta Every request carried _meta protocolVersion, clientInfo, and clientCapabilities tools/list request _meta missing io.modelcontextprotocol/protocolVersion
mcp-name-header Mcp-Name header mirrored params.name on tools/call requests

SHOULD (the score fraction — 0/1 passed)

Checkpoint Description Detail
clientinfo-every-request Included clientInfo in _meta on every request tools/list request _meta missing clientInfo name/version

Usage & cost

Nominal cost
$0.176
Input tokens
17,572
Output tokens
2,646
Cache read
17,920
Duration
87s
Timestamp
2026-07-18 11:13:39Z
Bench version
0.3.0

Cost is nominal (public API pricing): token usage × published rates; actual marginal cost is subscription-covered.