Files
Agent-Workbench/docs/reproducible-env-release-evidence/source/tests-06.tap
T

340 lines
13 KiB
Plaintext

TAP version 13
# Subtest: HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
ok 1 - HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
---
duration_ms: 2712.0152
type: 'test'
...
# Subtest: terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
ok 2 - terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
---
duration_ms: 4797.2592
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "" without dispatching any tool
ok 3 - reported SSE usage survives rejected required arguments "" without dispatching any tool
---
duration_ms: 3023.0035
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
ok 4 - reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
---
duration_ms: 2584.542
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "null" without dispatching any tool
ok 5 - reported SSE usage survives rejected required arguments "null" without dispatching any tool
---
duration_ms: 2585.5439
type: 'test'
...
# Subtest: a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
ok 6 - a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
---
duration_ms: 2185.444
type: 'test'
...
# Subtest: a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
ok 7 - a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
---
duration_ms: 2517.2829
type: 'test'
...
# Subtest: real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
ok 8 - real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
---
duration_ms: 4364.6922
type: 'test'
...
# Subtest: Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
ok 9 - Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
---
duration_ms: 7315.9043
type: 'test'
...
# Subtest: incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
ok 10 - incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
---
duration_ms: 2953.8569
type: 'test'
...
# Subtest: stopping an active HTTP stream closes only original request and keeps partial text without executing tools
ok 11 - stopping an active HTTP stream closes only original request and keeps partial text without executing tools
---
duration_ms: 2398.6336
type: 'test'
...
# Subtest: explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
ok 12 - explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
---
duration_ms: 1244.4957
type: 'test'
...
# Subtest: coalesced initial SSE events publish the latest partial state even when the upstream stays idle
ok 13 - coalesced initial SSE events publish the latest partial state even when the upstream stays idle
---
duration_ms: 2336.4688
type: 'test'
...
# Subtest: stream timeout closes the original HTTP response, preserves redacted capture and never retries
ok 14 - stream timeout closes the original HTTP response, preserves redacted capture and never retries
---
duration_ms: 1080.3687
type: 'test'
...
# Subtest: stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
ok 15 - stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
---
duration_ms: 1813.4125
type: 'test'
...
# Subtest: SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
ok 16 - SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
---
duration_ms: 0.8014
type: 'test'
...
# Subtest: stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
# Subtest: reject 0
ok 1 - reject 0
---
duration_ms: 0.1773
type: 'test'
...
# Subtest: reject 1
ok 2 - reject 1
---
duration_ms: 0.1766
type: 'test'
...
# Subtest: reject 2
ok 3 - reject 2
---
duration_ms: 0.1667
type: 'test'
...
# Subtest: reject 3
ok 4 - reject 3
---
duration_ms: 5.4682
type: 'test'
...
# Subtest: reject 4
ok 5 - reject 4
---
duration_ms: 0.1506
type: 'test'
...
# Subtest: reject 5
ok 6 - reject 5
---
duration_ms: 0.147
type: 'test'
...
1..6
ok 17 - stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
---
duration_ms: 6.779
type: 'test'
...
# Subtest: older configurations receive bounded wait defaults without changing the original object
ok 18 - older configurations receive bounded wait defaults without changing the original object
---
duration_ms: 1.0359
type: 'test'
...
# Subtest: active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
ok 19 - active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
---
duration_ms: 0.9248
type: 'test'
...
# Subtest: silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
ok 20 - silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
---
duration_ms: 1.3987
type: 'test'
...
# Subtest: waiting for headers is bounded independently of stream-idle time
ok 21 - waiting for headers is bounded independently of stream-idle time
---
duration_ms: 0.2373
type: 'test'
...
# Subtest: wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
ok 22 - wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
---
duration_ms: 1285.8808
type: 'test'
...
# Subtest: paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
ok 23 - paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
---
duration_ms: 5143.7307
type: 'test'
...
# Subtest: inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
ok 24 - inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
---
duration_ms: 1093.7936
type: 'test'
...
# Subtest: exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
ok 25 - exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
---
duration_ms: 1259.3572
type: 'test'
...
# Subtest: several patches are matched against one original snapshot in any input order and keep LF
ok 26 - several patches are matched against one original snapshot in any input order and keep LF
---
duration_ms: 1103.8253
type: 'test'
...
# Subtest: mixed line endings require exact anchors and preserve untouched formatting
ok 27 - mixed line endings require exact anchors and preserve untouched formatting
---
duration_ms: 1142.0359
type: 'test'
...
# Subtest: ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
ok 28 - ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
---
duration_ms: 777.9602
type: 'test'
...
# Subtest: stale original hashes and changes before apply preserve owner edits and mark conflicts
ok 29 - stale original hashes and changes before apply preserve owner edits and mark conflicts
---
duration_ms: 937.0725
type: 'test'
...
# Subtest: no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
ok 30 - no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
---
duration_ms: 1106.111
type: 'test'
...
# Subtest: an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
ok 31 - an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
---
duration_ms: 1219.8154
type: 'test'
...
# Subtest: real npm tests and build do not inherit arbitrary host credentials or Node injection settings
ok 32 - real npm tests and build do not inherit arbitrary host credentials or Node injection settings
---
duration_ms: 2835.7518
type: 'test'
...
# Subtest: real Python tests and compilation keep their sealed inputs without host credentials
ok 33 - real Python tests and compilation keep their sealed inputs without host credentials
---
duration_ms: 2758.2009
type: 'test'
...
# Subtest: a process exiting between the Windows snapshot and owner query is absent only after a fresh query
ok 34 - a process exiting between the Windows snapshot and owner query is absent only after a fresh query
---
duration_ms: 2076.3717
type: 'test'
...
# Subtest: owner observation errors remain errors while a process is present, replaced, or cannot be rechecked
ok 35 - owner observation errors remain errors while a process is present, replaced, or cannot be rechecked
---
duration_ms: 2016.9692
type: 'test'
...
# Subtest: cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
ok 36 - cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
---
duration_ms: 5605.4846
type: 'test'
...
# Subtest: cache enablement and derived reuse survive a real host restart without becoming task recovery state
ok 37 - cache enablement and derived reuse survive a real host restart without becoming task recovery state
---
duration_ms: 5501.7505
type: 'test'
...
# Subtest: persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
ok 38 - persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
---
duration_ms: 1451.7698
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'main.ts', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'value.ts', LF will be replaced by CRLF the next time Git touches it
# Subtest: same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
ok 39 - same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
---
duration_ms: 1164.6565
type: 'test'
...
# Switched to a new branch 'other'
# Subtest: branch and commit changes invalidate even byte-identical sources
ok 40 - branch and commit changes invalidate even byte-identical sources
---
duration_ms: 2974.5156
type: 'test'
...
# Subtest: corrupt, malformed and schema-invalid records fall back to fresh parsing
ok 41 - corrupt, malformed and schema-invalid records fall back to fresh parsing
---
duration_ms: 1150.3234
type: 'test'
...
# Subtest: disable and clear persist without touching sources, sessions, configuration or original artifacts
ok 42 - disable and clear persist without touching sources, sessions, configuration or original artifacts
---
duration_ms: 1102.7914
type: 'test'
...
# Subtest: cache capacity bounds disk and memory by bytes and LRU project count
ok 43 - cache capacity bounds disk and memory by bytes and LRU project count
---
duration_ms: 911.6572
type: 'test'
...
# Subtest: incomplete scans do not load or save cached entries; unavailable files leave the current result scope
ok 44 - incomplete scans do not load or save cached entries; unavailable files leave the current result scope
---
duration_ms: 1065.5942
type: 'test'
...
# Subtest: project and cache junctions cannot expose or delete an outside directory
ok 45 - project and cache junctions cannot expose or delete an outside directory
---
duration_ms: 666.3987
type: 'test'
...
# Subtest: concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
ok 46 - concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
---
duration_ms: 941.8394
type: 'test'
...
# Subtest: file access mode changes invalidate parsed material even when bytes are unchanged
ok 47 - file access mode changes invalidate parsed material even when bytes are unchanged
---
duration_ms: 668.2493
type: 'test'
...
# Subtest: tracked directory replaced by a junction invalidates access scope and never uses its old cache
ok 48 - tracked directory replaced by a junction invalidates access scope and never uses its old cache
---
duration_ms: 2290.0769
type: 'test'
...
1..48
# tests 54
# suites 0
# pass 54
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 50987.2241