Files
Agent-Workbench/docs/messages-m-evidence/development/initial-regression.log
T

60 lines
5.5 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
✔ identity distinguishes missing, invalid, mixed, exact and explicitly declared aliases without guessing (1.1899ms)
✔ chat-completions JSON rejects a different model before tool dispatch, retaining source and reported usage (2410.0353ms)
✔ chat-completions SSE rejects a different model before tool dispatch, retaining source and reported usage (1832.1492ms)
✔ responses JSON rejects a different model before tool dispatch, retaining source and reported usage (2114.8292ms)
✔ responses SSE rejects a different model before tool dispatch, retaining source and reported usage (1966.0531ms)
✔ record policy accepts missing identity but keeps it explicit, and strict declared mapping is frozen in the consumption (2.0347ms)
✔ mixed streamed identities cannot pass strict mode, and interrupted streams retain observed identifiers without authenticating them (1.5708ms)
✔ identity refusal never fails over to another pool member and raw response model cannot leak known credentials (2045.8864ms)
✔ strict refusal remains visible even when the same original response exhausts the budget (2006.2433ms)
✔ strict identity crosses the controlled engine bridge with its original source and zero tool dispatch (11411.0691ms)
✔ frozen direct connection policy and delivery reports preserve response identity without filling historical gaps (2647.6513ms)
✔ saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance (1177.4117ms)
✔ owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched (1132.0898ms)
✔ Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes (3265.297ms)
✔ mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools (3822.3256ms)
▶ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
✔ Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" (2178.3361ms)
✔ Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal (2051.5484ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal (1604.752ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte (1321.7878ms)
✔ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool (7157.3552ms)
▶ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
✔ chat-completions (1415.8671ms)
✔ responses (1367.4864ms)
✔ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay (2783.7407ms)
✔ wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint (0.1895ms)
✔ connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions (499.1573ms)
✔ HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8 (2316.2161ms)
✔ terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once (3633.3617ms)
✔ reported SSE usage survives rejected required arguments "" without dispatching any tool (1492.5112ms)
✔ reported SSE usage survives rejected required arguments "{\"path\":" without dispatching any tool (1182.0086ms)
✔ reported SSE usage survives rejected required arguments "null" without dispatching any tool (1235.6693ms)
✔ a stream without DONE retains reported usage but cannot adapt or execute even an optional tool (1289.1869ms)
✔ a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens (1518.3697ms)
✔ real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage (2272.4199ms)
✔ Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair (2026.1464ms)
✔ incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools (1415.81ms)
✔ stopping an active HTTP stream closes only original request and keeps partial text without executing tools (1320.5973ms)
✔ explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt (581.3611ms)
✔ coalesced initial SSE events publish the latest partial state even when the upstream stays idle (1513.5792ms)
✔ stream timeout closes the original HTTP response, preserves redacted capture and never retries (861.5278ms)
✔ stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over (1027.5337ms)
✔ SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch (1.3354ms)
▶ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
✔ reject 0 (0.3689ms)
✔ reject 1 (0.2764ms)
✔ reject 2 (0.2227ms)
✔ reject 3 (5.2073ms)
✔ reject 4 (0.1789ms)
✔ reject 5 (0.1875ms)
✔ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data (7.2245ms)
ℹ tests 48
ℹ suites 0
ℹ pass 48
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 43995.5843