mcpbench GitHub

client/stateless-prompts

moonshotai/kimi-k2.7-code 2026-07-28 docs: none score 0% task-failure musts 5/8 · shoulds 0/2 · mays 0/0 works no · conformant no

Checkpoints

MUST (any failure zeroes the score — 5/8 passed)

Checkpoint Description Detail
report-content Called report with the exact prompt message text tools/call for "report" was never sent
prompts-get-args Sent prompts/get with name release_notes and arguments {version: "2.4.1"}
prompts-list-first A successful prompts/list preceded the successful prompts/get
stateless-meta Every request carried _meta protocolVersion and clientCapabilities prompts/list request _meta missing io.modelcontextprotocol/protocolVersion
mcp-method-header Mcp-Method header mirrored the JSON-RPC method on every request
mcp-name-header-prompt Mcp-Name header mirrored params.name on prompts/get requests
version-header-match MCP-Protocol-Version header present and matching the _meta value
accept-header Every accepted POST carried Accept: application/json, text/event-stream POST /mcp Accept "application/json" does not list both application/json and text/event-stream

SHOULD (the score fraction — 0/2 passed)

Checkpoint Description Detail
clientinfo-every-request Included clientInfo in _meta on every request prompts/list request _meta missing clientInfo name/version
no-legacy-lifecycle Never sent a legacy initialize request or an Mcp-Session-Id header sent a legacy initialize request; this revision has no handshake

Usage & cost

Nominal cost
$0.026
Input tokens
1,688
Output tokens
5,872
Cache read
68,480
Duration
139s
Timestamp
2026-07-18 16:51:37Z
Bench version
0.3.0

Cost is nominal (public API pricing): token usage × published rates; actual marginal cost is subscription-covered.