71 lines
7.2 KiB
Plaintext
71 lines
7.2 KiB
Plaintext
✔ a question about the previous workbench error receives local error context and current change states (2572.0986ms)
|
||
✔ a transient model failure after an approved command retries only the model request (3613.6709ms)
|
||
✔ exhausted model retries preserve tool results, and explicit resume adds no new user turn or replay (3626.3978ms)
|
||
✔ stopping during model backoff cancels further requests and clears the running request state (1781.9182ms)
|
||
✔ HTTP authentication errors are classified, redacted and never automatically retried (21.0006ms)
|
||
✔ temporary HTTP service errors retry and recover with recorded attempt counts (20.4214ms)
|
||
✔ invalid and oversized protocol responses fail once with a useful response-format diagnosis (3.9159ms)
|
||
✔ HTTP rate limits expose their source and obey the service retry interval before recovery (1016.1704ms)
|
||
✔ Windows commands preserve Chinese through a PowerShell pipeline into Node (1072.6146ms)
|
||
✔ Windows shell syntax errors stay readable and native command exit codes are retained (1457.3246ms)
|
||
✔ review and completed states do not turn a generic continue click into a new model request (888.6061ms)
|
||
✔ old session data receives a truthful historical connection diagnosis without rewriting history (564.2336ms)
|
||
✔ model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart (1470.5084ms)
|
||
✔ config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts (1171.4104ms)
|
||
✔ real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity (4000.4454ms)
|
||
✔ pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests (5179.6987ms)
|
||
✔ 401 blocks the credential revision; updating the key restores availability without leaking error echoes (1754.9103ms)
|
||
✔ queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request (1277.136ms)
|
||
✔ compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model (2529.498ms)
|
||
✔ model registry disk failures restore routing, pool profiles and credential references without partial updates (1011.5669ms)
|
||
✔ model selection and saved configuration commit together and failures preserve the original mode and endpoint (1006.0569ms)
|
||
✔ configuration imports roll back the entire batch and retain one usable preview after validation or commit failure (674.2603ms)
|
||
✔ saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance (1090.6984ms)
|
||
✔ owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched (1548.632ms)
|
||
✔ Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes (2755.3635ms)
|
||
✔ mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools (3770.6098ms)
|
||
▶ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
|
||
✔ Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" (1949.4119ms)
|
||
✔ Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal (2082.742ms)
|
||
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal (2016.589ms)
|
||
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte (1919.9253ms)
|
||
✔ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool (7969.4088ms)
|
||
▶ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
|
||
✔ chat-completions (1824.526ms)
|
||
✔ responses (2252.4703ms)
|
||
✔ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay (4077.3534ms)
|
||
✔ wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint (0.1564ms)
|
||
✔ connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions (862.7606ms)
|
||
✔ capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run (2017.5982ms)
|
||
✔ all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger (1570.3869ms)
|
||
✔ explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes (1059.7389ms)
|
||
✔ plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support (1192.9938ms)
|
||
✔ a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object (1022.9602ms)
|
||
✔ a stop from the event loop interrupts immediate model replies before later tools (1620.311ms)
|
||
✔ a stop after the first tool preserves a complete interrupted multi-call protocol group (2388.9177ms)
|
||
✔ the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands (6014.3933ms)
|
||
✔ denial prevents command execution and produces a paired denied result (2269.3286ms)
|
||
✔ stopping during approval interrupts pending calls without executing or replaying them (2111.8268ms)
|
||
✔ stopping a running fixture command terminates its own process tree and retains uncertain state (2361.3446ms)
|
||
✔ command output decodes split UTF-8 and excludes the workbench key from child environment (1288.7983ms)
|
||
✔ model-list testing uses a tentative key without changing the saved connection and redacts service errors (12.439ms)
|
||
✔ truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities (4150.4139ms)
|
||
✔ request projection keeps exact tool pairs and complete recent user instructions while preserving disk history (1713.3195ms)
|
||
✔ operational questions are diagnostic while explicit repair requests remain execution instructions (1.0512ms)
|
||
✔ file delivery requires a positive instruction, not saved evidence or a prohibited write (1.2058ms)
|
||
✔ an unsubstantiated text claim cannot complete a requested file delivery (1601.8128ms)
|
||
✔ HTML without tests ends at reviewed file delivery and never offers automatic rechecking (2770.1918ms)
|
||
✔ diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools (4569.8906ms)
|
||
✔ review continuation is a system action and adds no testing demand or fake user instruction (3182.5911ms)
|
||
✔ a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools (1482.0105ms)
|
||
✔ a budget pause becomes visible only after its input snapshot can be sealed with the original Run (1270.4707ms)
|
||
✔ alternating duplicate file reads and listing files still pauses without treating new pages as duplicates (11266.4412ms)
|
||
ℹ tests 60
|
||
ℹ suites 0
|
||
ℹ pass 60
|
||
ℹ fail 0
|
||
ℹ cancelled 0
|
||
ℹ skipped 0
|
||
ℹ todo 0
|
||
ℹ duration_ms 65317.1144
|