mcpbench GitHub

client/drop-stream-mid-call

openai/gpt-5.6-terra:medium 2025-11-25 docs: full score 0% must-checkpoint musts 1/3 · shoulds 0/1 · mays 0/0 works yes · conformant no

Checkpoints

MUST (any failure zeroes the score — 1/3 passed)

Checkpoint Description Detail
tool-call Called generate_report
reconnect-get After the dropped stream, reconnected via GET and received an event stream after the dropped stream, no GET reconnect received an event stream
retry-delay Waited at least the server's SSE retry interval before reconnecting after the dropped stream, no GET reconnect received an event stream

SHOULD (the score fraction — 0/1 passed)

Checkpoint Description Detail
last-event-id The reconnect GET carried Last-Event-ID with the last received event id after the dropped stream, no GET reconnect received an event stream

Usage & cost

Nominal cost
$0.190
Input tokens
22,566
Output tokens
4,931
Cache read
238,080
Duration
126s
Timestamp
2026-07-17 23:09:26Z
Bench version
0.3.0

Cost is nominal (public API pricing): token usage × published rates; actual marginal cost is subscription-covered.