Files
Agent-Workbench/docs/release-efficiency-1.23-evidence/inherited-source/tests-06.tap
T
2026-11-02 11:58:42 +08:00

392 lines
16 KiB
Plaintext

TAP version 13
# Subtest: saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
ok 1 - saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
---
duration_ms: 1169.9329
type: 'test'
...
# Subtest: owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
ok 2 - owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
---
duration_ms: 1191.9222
type: 'test'
...
# Subtest: Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
ok 3 - Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
---
duration_ms: 3328.6473
type: 'test'
...
# Subtest: mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
ok 4 - mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
---
duration_ms: 3198.2166
type: 'test'
...
# Subtest: Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
# Subtest: Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
ok 1 - Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
---
duration_ms: 1945.7381
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
ok 2 - Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
---
duration_ms: 1898.2085
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
ok 3 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
---
duration_ms: 2129.524
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
ok 4 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
---
duration_ms: 2298.0245
type: 'test'
...
1..4
ok 5 - Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
---
duration_ms: 8272.4565
type: 'test'
...
# Subtest: invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
# Subtest: chat-completions
ok 1 - chat-completions
---
duration_ms: 2367.4265
type: 'test'
...
# Subtest: responses
ok 2 - responses
---
duration_ms: 2220.8173
type: 'test'
...
1..2
ok 6 - invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
---
duration_ms: 4588.8043
type: 'test'
...
# Subtest: wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
ok 7 - wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
---
duration_ms: 0.2724
type: 'test'
...
# Subtest: connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
ok 8 - connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
---
duration_ms: 752.9669
type: 'test'
...
# Subtest: capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
ok 9 - capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
---
duration_ms: 2138.2404
type: 'test'
...
# Subtest: all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
ok 10 - all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
---
duration_ms: 1634.5191
type: 'test'
...
# Subtest: explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
ok 11 - explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
---
duration_ms: 1031.2653
type: 'test'
...
# Subtest: plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
ok 12 - plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
---
duration_ms: 1138.142
type: 'test'
...
# Subtest: a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
ok 13 - a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
---
duration_ms: 980.1488
type: 'test'
...
# Subtest: HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
ok 14 - HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
---
duration_ms: 2571.9546
type: 'test'
...
# Subtest: terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
ok 15 - terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
---
duration_ms: 3967.703
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "" without dispatching any tool
ok 16 - reported SSE usage survives rejected required arguments "" without dispatching any tool
---
duration_ms: 2280.8923
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
ok 17 - reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
---
duration_ms: 2218.4006
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "null" without dispatching any tool
ok 18 - reported SSE usage survives rejected required arguments "null" without dispatching any tool
---
duration_ms: 2396.8366
type: 'test'
...
# Subtest: a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
ok 19 - a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
---
duration_ms: 2295.2007
type: 'test'
...
# Subtest: a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
ok 20 - a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
---
duration_ms: 2401.3005
type: 'test'
...
# Subtest: real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
ok 21 - real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
---
duration_ms: 3615.354
type: 'test'
...
# Subtest: Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
ok 22 - Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
---
duration_ms: 3653.5117
type: 'test'
...
# Subtest: incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
ok 23 - incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
---
duration_ms: 2519.6873
type: 'test'
...
# Subtest: stopping an active HTTP stream closes only original request and keeps partial text without executing tools
ok 24 - stopping an active HTTP stream closes only original request and keeps partial text without executing tools
---
duration_ms: 1940.904
type: 'test'
...
# Subtest: explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
ok 25 - explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
---
duration_ms: 834.7554
type: 'test'
...
# Subtest: coalesced initial SSE events publish the latest partial state even when the upstream stays idle
ok 26 - coalesced initial SSE events publish the latest partial state even when the upstream stays idle
---
duration_ms: 1482.3906
type: 'test'
...
# Subtest: stream timeout closes the original HTTP response, preserves redacted capture and never retries
ok 27 - stream timeout closes the original HTTP response, preserves redacted capture and never retries
---
duration_ms: 839.601
type: 'test'
...
# Subtest: stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
ok 28 - stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
---
duration_ms: 1184.8134
type: 'test'
...
# Subtest: SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
ok 29 - SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
---
duration_ms: 0.76
type: 'test'
...
# Subtest: stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
# Subtest: reject 0
ok 1 - reject 0
---
duration_ms: 0.1763
type: 'test'
...
# Subtest: reject 1
ok 2 - reject 1
---
duration_ms: 0.1359
type: 'test'
...
# Subtest: reject 2
ok 3 - reject 2
---
duration_ms: 0.2266
type: 'test'
...
# Subtest: reject 3
ok 4 - reject 3
---
duration_ms: 5.2546
type: 'test'
...
# Subtest: reject 4
ok 5 - reject 4
---
duration_ms: 0.2165
type: 'test'
...
# Subtest: reject 5
ok 6 - reject 5
---
duration_ms: 0.1831
type: 'test'
...
1..6
ok 30 - stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
---
duration_ms: 6.7446
type: 'test'
...
# Subtest: older configurations receive bounded wait defaults without changing the original object
ok 31 - older configurations receive bounded wait defaults without changing the original object
---
duration_ms: 1.1781
type: 'test'
...
# Subtest: active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
ok 32 - active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
---
duration_ms: 0.9609
type: 'test'
...
# Subtest: silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
ok 33 - silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
---
duration_ms: 1.3404
type: 'test'
...
# Subtest: waiting for headers is bounded independently of stream-idle time
ok 34 - waiting for headers is bounded independently of stream-idle time
---
duration_ms: 0.2279
type: 'test'
...
# Subtest: wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
ok 35 - wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
---
duration_ms: 1481.1121
type: 'test'
...
# Subtest: paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
ok 36 - paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
---
duration_ms: 4835.8951
type: 'test'
...
# Subtest: inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
ok 37 - inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
---
duration_ms: 843.1842
type: 'test'
...
# Subtest: exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
ok 38 - exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
---
duration_ms: 753.5311
type: 'test'
...
# Subtest: several patches are matched against one original snapshot in any input order and keep LF
ok 39 - several patches are matched against one original snapshot in any input order and keep LF
---
duration_ms: 776.9026
type: 'test'
...
# Subtest: mixed line endings require exact anchors and preserve untouched formatting
ok 40 - mixed line endings require exact anchors and preserve untouched formatting
---
duration_ms: 1069.5023
type: 'test'
...
# Subtest: ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
ok 41 - ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
---
duration_ms: 765.0983
type: 'test'
...
# Subtest: stale original hashes and changes before apply preserve owner edits and mark conflicts
ok 42 - stale original hashes and changes before apply preserve owner edits and mark conflicts
---
duration_ms: 827.5723
type: 'test'
...
# Subtest: no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
ok 43 - no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
---
duration_ms: 715.5198
type: 'test'
...
# Subtest: real owned Vite starts only after approval, records OS ownership and live changes, and stops its tree
ok 44 - real owned Vite starts only after approval, records OS ownership and live changes, and stops its tree
---
duration_ms: 12735.2896
type: 'test'
...
# Subtest: occupied ports and approval-time conflicts never take over an unrelated listener
ok 45 - occupied ports and approval-time conflicts never take over an unrelated listener
---
duration_ms: 9305.1178
type: 'test'
...
# Subtest: background preview final-log failure retains unknown evidence without an unhandled startup promise
ok 46 - background preview final-log failure retains unknown evidence without an unhandled startup promise
---
duration_ms: 10697.6668
type: 'test'
...
# Subtest: stale source, tampered plans, wrong ownership and arbitrary scripts cannot dispatch a preview
ok 47 - stale source, tampered plans, wrong ownership and arbitrary scripts cannot dispatch a preview
---
duration_ms: 8936.0894
type: 'test'
...
# Subtest: restart retains original unknown preview, blocks mutation, reconciles absent identity without replay
ok 48 - restart retains original unknown preview, blocks mutation, reconciles absent identity without replay
---
duration_ms: 8870.3831
type: 'test'
...
# Subtest: an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
ok 49 - an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
---
duration_ms: 750.0214
type: 'test'
...
# Subtest: real npm tests and build do not inherit arbitrary host credentials or Node injection settings
ok 50 - real npm tests and build do not inherit arbitrary host credentials or Node injection settings
---
duration_ms: 1887.8408
type: 'test'
...
# Subtest: real Python tests and compilation keep their sealed inputs without host credentials
ok 51 - real Python tests and compilation keep their sealed inputs without host credentials
---
duration_ms: 2003.1296
type: 'test'
...
1..51
# tests 63
# suites 0
# pass 63
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 85691.8577