392 lines
16 KiB
Plaintext
392 lines
16 KiB
Plaintext
TAP version 13
|
|
# Subtest: saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
|
|
ok 1 - saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
|
|
---
|
|
duration_ms: 1169.9329
|
|
type: 'test'
|
|
...
|
|
# Subtest: owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
|
|
ok 2 - owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
|
|
---
|
|
duration_ms: 1191.9222
|
|
type: 'test'
|
|
...
|
|
# Subtest: Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
|
|
ok 3 - Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
|
|
---
|
|
duration_ms: 3328.6473
|
|
type: 'test'
|
|
...
|
|
# Subtest: mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
|
|
ok 4 - mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
|
|
---
|
|
duration_ms: 3198.2166
|
|
type: 'test'
|
|
...
|
|
# Subtest: Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
|
|
# Subtest: Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
|
|
ok 1 - Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
|
|
---
|
|
duration_ms: 1945.7381
|
|
type: 'test'
|
|
...
|
|
# Subtest: Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
|
|
ok 2 - Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
|
|
---
|
|
duration_ms: 1898.2085
|
|
type: 'test'
|
|
...
|
|
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
|
|
ok 3 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
|
|
---
|
|
duration_ms: 2129.524
|
|
type: 'test'
|
|
...
|
|
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
|
|
ok 4 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
|
|
---
|
|
duration_ms: 2298.0245
|
|
type: 'test'
|
|
...
|
|
1..4
|
|
ok 5 - Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
|
|
---
|
|
duration_ms: 8272.4565
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
|
|
# Subtest: chat-completions
|
|
ok 1 - chat-completions
|
|
---
|
|
duration_ms: 2367.4265
|
|
type: 'test'
|
|
...
|
|
# Subtest: responses
|
|
ok 2 - responses
|
|
---
|
|
duration_ms: 2220.8173
|
|
type: 'test'
|
|
...
|
|
1..2
|
|
ok 6 - invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
|
|
---
|
|
duration_ms: 4588.8043
|
|
type: 'test'
|
|
...
|
|
# Subtest: wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
|
|
ok 7 - wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
|
|
---
|
|
duration_ms: 0.2724
|
|
type: 'test'
|
|
...
|
|
# Subtest: connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
|
|
ok 8 - connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
|
|
---
|
|
duration_ms: 752.9669
|
|
type: 'test'
|
|
...
|
|
# Subtest: capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
|
|
ok 9 - capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
|
|
---
|
|
duration_ms: 2138.2404
|
|
type: 'test'
|
|
...
|
|
# Subtest: all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
|
|
ok 10 - all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
|
|
---
|
|
duration_ms: 1634.5191
|
|
type: 'test'
|
|
...
|
|
# Subtest: explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
|
|
ok 11 - explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
|
|
---
|
|
duration_ms: 1031.2653
|
|
type: 'test'
|
|
...
|
|
# Subtest: plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
|
|
ok 12 - plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
|
|
---
|
|
duration_ms: 1138.142
|
|
type: 'test'
|
|
...
|
|
# Subtest: a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
|
|
ok 13 - a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
|
|
---
|
|
duration_ms: 980.1488
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
|
|
ok 14 - HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
|
|
---
|
|
duration_ms: 2571.9546
|
|
type: 'test'
|
|
...
|
|
# Subtest: terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
|
|
ok 15 - terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
|
|
---
|
|
duration_ms: 3967.703
|
|
type: 'test'
|
|
...
|
|
# Subtest: reported SSE usage survives rejected required arguments "" without dispatching any tool
|
|
ok 16 - reported SSE usage survives rejected required arguments "" without dispatching any tool
|
|
---
|
|
duration_ms: 2280.8923
|
|
type: 'test'
|
|
...
|
|
# Subtest: reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
|
|
ok 17 - reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
|
|
---
|
|
duration_ms: 2218.4006
|
|
type: 'test'
|
|
...
|
|
# Subtest: reported SSE usage survives rejected required arguments "null" without dispatching any tool
|
|
ok 18 - reported SSE usage survives rejected required arguments "null" without dispatching any tool
|
|
---
|
|
duration_ms: 2396.8366
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
|
|
ok 19 - a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
|
|
---
|
|
duration_ms: 2295.2007
|
|
type: 'test'
|
|
...
|
|
# Subtest: a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
|
|
ok 20 - a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
|
|
---
|
|
duration_ms: 2401.3005
|
|
type: 'test'
|
|
...
|
|
# Subtest: real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
|
|
ok 21 - real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
|
|
---
|
|
duration_ms: 3615.354
|
|
type: 'test'
|
|
...
|
|
# Subtest: Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
|
|
ok 22 - Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
|
|
---
|
|
duration_ms: 3653.5117
|
|
type: 'test'
|
|
...
|
|
# Subtest: incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
|
|
ok 23 - incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
|
|
---
|
|
duration_ms: 2519.6873
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping an active HTTP stream closes only original request and keeps partial text without executing tools
|
|
ok 24 - stopping an active HTTP stream closes only original request and keeps partial text without executing tools
|
|
---
|
|
duration_ms: 1940.904
|
|
type: 'test'
|
|
...
|
|
# Subtest: explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
|
|
ok 25 - explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
|
|
---
|
|
duration_ms: 834.7554
|
|
type: 'test'
|
|
...
|
|
# Subtest: coalesced initial SSE events publish the latest partial state even when the upstream stays idle
|
|
ok 26 - coalesced initial SSE events publish the latest partial state even when the upstream stays idle
|
|
---
|
|
duration_ms: 1482.3906
|
|
type: 'test'
|
|
...
|
|
# Subtest: stream timeout closes the original HTTP response, preserves redacted capture and never retries
|
|
ok 27 - stream timeout closes the original HTTP response, preserves redacted capture and never retries
|
|
---
|
|
duration_ms: 839.601
|
|
type: 'test'
|
|
...
|
|
# Subtest: stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
|
|
ok 28 - stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
|
|
---
|
|
duration_ms: 1184.8134
|
|
type: 'test'
|
|
...
|
|
# Subtest: SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
|
|
ok 29 - SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
|
|
---
|
|
duration_ms: 0.76
|
|
type: 'test'
|
|
...
|
|
# Subtest: stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
|
|
# Subtest: reject 0
|
|
ok 1 - reject 0
|
|
---
|
|
duration_ms: 0.1763
|
|
type: 'test'
|
|
...
|
|
# Subtest: reject 1
|
|
ok 2 - reject 1
|
|
---
|
|
duration_ms: 0.1359
|
|
type: 'test'
|
|
...
|
|
# Subtest: reject 2
|
|
ok 3 - reject 2
|
|
---
|
|
duration_ms: 0.2266
|
|
type: 'test'
|
|
...
|
|
# Subtest: reject 3
|
|
ok 4 - reject 3
|
|
---
|
|
duration_ms: 5.2546
|
|
type: 'test'
|
|
...
|
|
# Subtest: reject 4
|
|
ok 5 - reject 4
|
|
---
|
|
duration_ms: 0.2165
|
|
type: 'test'
|
|
...
|
|
# Subtest: reject 5
|
|
ok 6 - reject 5
|
|
---
|
|
duration_ms: 0.1831
|
|
type: 'test'
|
|
...
|
|
1..6
|
|
ok 30 - stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
|
|
---
|
|
duration_ms: 6.7446
|
|
type: 'test'
|
|
...
|
|
# Subtest: older configurations receive bounded wait defaults without changing the original object
|
|
ok 31 - older configurations receive bounded wait defaults without changing the original object
|
|
---
|
|
duration_ms: 1.1781
|
|
type: 'test'
|
|
...
|
|
# Subtest: active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
|
|
ok 32 - active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
|
|
---
|
|
duration_ms: 0.9609
|
|
type: 'test'
|
|
...
|
|
# Subtest: silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
|
|
ok 33 - silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
|
|
---
|
|
duration_ms: 1.3404
|
|
type: 'test'
|
|
...
|
|
# Subtest: waiting for headers is bounded independently of stream-idle time
|
|
ok 34 - waiting for headers is bounded independently of stream-idle time
|
|
---
|
|
duration_ms: 0.2279
|
|
type: 'test'
|
|
...
|
|
# Subtest: wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
|
|
ok 35 - wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
|
|
---
|
|
duration_ms: 1481.1121
|
|
type: 'test'
|
|
...
|
|
# Subtest: paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
|
|
ok 36 - paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
|
|
---
|
|
duration_ms: 4835.8951
|
|
type: 'test'
|
|
...
|
|
# Subtest: inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
|
|
ok 37 - inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
|
|
---
|
|
duration_ms: 843.1842
|
|
type: 'test'
|
|
...
|
|
# Subtest: exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
|
|
ok 38 - exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
|
|
---
|
|
duration_ms: 753.5311
|
|
type: 'test'
|
|
...
|
|
# Subtest: several patches are matched against one original snapshot in any input order and keep LF
|
|
ok 39 - several patches are matched against one original snapshot in any input order and keep LF
|
|
---
|
|
duration_ms: 776.9026
|
|
type: 'test'
|
|
...
|
|
# Subtest: mixed line endings require exact anchors and preserve untouched formatting
|
|
ok 40 - mixed line endings require exact anchors and preserve untouched formatting
|
|
---
|
|
duration_ms: 1069.5023
|
|
type: 'test'
|
|
...
|
|
# Subtest: ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
|
|
ok 41 - ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
|
|
---
|
|
duration_ms: 765.0983
|
|
type: 'test'
|
|
...
|
|
# Subtest: stale original hashes and changes before apply preserve owner edits and mark conflicts
|
|
ok 42 - stale original hashes and changes before apply preserve owner edits and mark conflicts
|
|
---
|
|
duration_ms: 827.5723
|
|
type: 'test'
|
|
...
|
|
# Subtest: no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
|
|
ok 43 - no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
|
|
---
|
|
duration_ms: 715.5198
|
|
type: 'test'
|
|
...
|
|
# Subtest: real owned Vite starts only after approval, records OS ownership and live changes, and stops its tree
|
|
ok 44 - real owned Vite starts only after approval, records OS ownership and live changes, and stops its tree
|
|
---
|
|
duration_ms: 12735.2896
|
|
type: 'test'
|
|
...
|
|
# Subtest: occupied ports and approval-time conflicts never take over an unrelated listener
|
|
ok 45 - occupied ports and approval-time conflicts never take over an unrelated listener
|
|
---
|
|
duration_ms: 9305.1178
|
|
type: 'test'
|
|
...
|
|
# Subtest: background preview final-log failure retains unknown evidence without an unhandled startup promise
|
|
ok 46 - background preview final-log failure retains unknown evidence without an unhandled startup promise
|
|
---
|
|
duration_ms: 10697.6668
|
|
type: 'test'
|
|
...
|
|
# Subtest: stale source, tampered plans, wrong ownership and arbitrary scripts cannot dispatch a preview
|
|
ok 47 - stale source, tampered plans, wrong ownership and arbitrary scripts cannot dispatch a preview
|
|
---
|
|
duration_ms: 8936.0894
|
|
type: 'test'
|
|
...
|
|
# Subtest: restart retains original unknown preview, blocks mutation, reconciles absent identity without replay
|
|
ok 48 - restart retains original unknown preview, blocks mutation, reconciles absent identity without replay
|
|
---
|
|
duration_ms: 8870.3831
|
|
type: 'test'
|
|
...
|
|
# Subtest: an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
|
|
ok 49 - an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
|
|
---
|
|
duration_ms: 750.0214
|
|
type: 'test'
|
|
...
|
|
# Subtest: real npm tests and build do not inherit arbitrary host credentials or Node injection settings
|
|
ok 50 - real npm tests and build do not inherit arbitrary host credentials or Node injection settings
|
|
---
|
|
duration_ms: 1887.8408
|
|
type: 'test'
|
|
...
|
|
# Subtest: real Python tests and compilation keep their sealed inputs without host credentials
|
|
ok 51 - real Python tests and compilation keep their sealed inputs without host credentials
|
|
---
|
|
duration_ms: 2003.1296
|
|
type: 'test'
|
|
...
|
|
1..51
|
|
# tests 63
|
|
# suites 0
|
|
# pass 63
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 85691.8577
|