305 lines
13 KiB
Plaintext
305 lines
13 KiB
Plaintext
TAP version 13
|
|
# Subtest: host challenge proof rejects a stale challenge, changed identity and changed signature
|
|
ok 1 - host challenge proof rejects a stale challenge, changed identity and changed signature
|
|
---
|
|
duration_ms: 1.1348
|
|
type: 'test'
|
|
...
|
|
# Subtest: stop confirmation binds the original instance, creation and loaded runtime
|
|
ok 2 - stop confirmation binds the original instance, creation and loaded runtime
|
|
---
|
|
duration_ms: 0.1247
|
|
type: 'test'
|
|
...
|
|
# Subtest: state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
|
|
ok 3 - state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
|
|
---
|
|
duration_ms: 1133.2191
|
|
type: 'test'
|
|
...
|
|
# Subtest: failed registration publishes no initialized memory and can complete after its actual inputs are supplied
|
|
ok 4 - failed registration publishes no initialized memory and can complete after its actual inputs are supplied
|
|
---
|
|
duration_ms: 2526.6054
|
|
type: 'test'
|
|
...
|
|
# Subtest: host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
|
|
ok 5 - host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
|
|
---
|
|
duration_ms: 1.9739
|
|
type: 'test'
|
|
...
|
|
# Subtest: host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
|
|
ok 6 - host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
|
|
---
|
|
duration_ms: 818.2146
|
|
type: 'test'
|
|
...
|
|
# Subtest: a question about the previous workbench error receives local error context and current change states
|
|
ok 7 - a question about the previous workbench error receives local error context and current change states
|
|
---
|
|
duration_ms: 2213.6377
|
|
type: 'test'
|
|
...
|
|
# Subtest: a transient model failure after an approved command retries only the model request
|
|
ok 8 - a transient model failure after an approved command retries only the model request
|
|
---
|
|
duration_ms: 2266.197
|
|
type: 'test'
|
|
...
|
|
# Subtest: exhausted model retries preserve tool results, and explicit resume adds no new user turn or replay
|
|
ok 9 - exhausted model retries preserve tool results, and explicit resume adds no new user turn or replay
|
|
---
|
|
duration_ms: 3657.3963
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping during model backoff cancels further requests and clears the running request state
|
|
ok 10 - stopping during model backoff cancels further requests and clears the running request state
|
|
---
|
|
duration_ms: 1798.9338
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTTP authentication errors are classified, redacted and never automatically retried
|
|
ok 11 - HTTP authentication errors are classified, redacted and never automatically retried
|
|
---
|
|
duration_ms: 21.9978
|
|
type: 'test'
|
|
...
|
|
# Subtest: temporary HTTP service errors retry and recover with recorded attempt counts
|
|
ok 12 - temporary HTTP service errors retry and recover with recorded attempt counts
|
|
---
|
|
duration_ms: 8.2405
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid and oversized protocol responses fail once with a useful response-format diagnosis
|
|
ok 13 - invalid and oversized protocol responses fail once with a useful response-format diagnosis
|
|
---
|
|
duration_ms: 4.0449
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTTP rate limits expose their source and obey the service retry interval before recovery
|
|
ok 14 - HTTP rate limits expose their source and obey the service retry interval before recovery
|
|
---
|
|
duration_ms: 1010.8285
|
|
type: 'test'
|
|
...
|
|
# Subtest: Windows commands preserve Chinese through a PowerShell pipeline into Node
|
|
ok 15 - Windows commands preserve Chinese through a PowerShell pipeline into Node
|
|
---
|
|
duration_ms: 1003.6617
|
|
type: 'test'
|
|
...
|
|
# Subtest: Windows shell syntax errors stay readable and native command exit codes are retained
|
|
ok 16 - Windows shell syntax errors stay readable and native command exit codes are retained
|
|
---
|
|
duration_ms: 971.0757
|
|
type: 'test'
|
|
...
|
|
# Subtest: review and completed states do not turn a generic continue click into a new model request
|
|
ok 17 - review and completed states do not turn a generic continue click into a new model request
|
|
---
|
|
duration_ms: 852.3601
|
|
type: 'test'
|
|
...
|
|
# Subtest: old session data receives a truthful historical connection diagnosis without rewriting history
|
|
ok 18 - old session data receives a truthful historical connection diagnosis without rewriting history
|
|
---
|
|
duration_ms: 1178.3301
|
|
type: 'test'
|
|
...
|
|
# Subtest: model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
|
|
ok 19 - model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
|
|
---
|
|
duration_ms: 1356.0532
|
|
type: 'test'
|
|
...
|
|
# Subtest: config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
|
|
ok 20 - config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
|
|
---
|
|
duration_ms: 1132.7334
|
|
type: 'test'
|
|
...
|
|
# Subtest: real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
|
|
ok 21 - real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
|
|
---
|
|
duration_ms: 3159.0983
|
|
type: 'test'
|
|
...
|
|
# Subtest: pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
|
|
ok 22 - pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
|
|
---
|
|
duration_ms: 4730.0215
|
|
type: 'test'
|
|
...
|
|
# Subtest: 401 blocks the credential revision; updating the key restores availability without leaking error echoes
|
|
ok 23 - 401 blocks the credential revision; updating the key restores availability without leaking error echoes
|
|
---
|
|
duration_ms: 2035.7928
|
|
type: 'test'
|
|
...
|
|
# Subtest: queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
|
|
ok 24 - queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
|
|
---
|
|
duration_ms: 1053.5497
|
|
type: 'test'
|
|
...
|
|
# Subtest: compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
|
|
ok 25 - compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
|
|
---
|
|
duration_ms: 2488.7937
|
|
type: 'test'
|
|
...
|
|
# Subtest: model registry disk failures restore routing, pool profiles and credential references without partial updates
|
|
ok 26 - model registry disk failures restore routing, pool profiles and credential references without partial updates
|
|
---
|
|
duration_ms: 924.9926
|
|
type: 'test'
|
|
...
|
|
# Subtest: model selection and saved configuration commit together and failures preserve the original mode and endpoint
|
|
ok 27 - model selection and saved configuration commit together and failures preserve the original mode and endpoint
|
|
---
|
|
duration_ms: 896.6963
|
|
type: 'test'
|
|
...
|
|
# Subtest: configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
|
|
ok 28 - configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
|
|
---
|
|
duration_ms: 903.5305
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop from the event loop interrupts immediate model replies before later tools
|
|
ok 29 - a stop from the event loop interrupts immediate model replies before later tools
|
|
---
|
|
duration_ms: 1924.7977
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
ok 30 - a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
---
|
|
duration_ms: 2188.5101
|
|
type: 'test'
|
|
...
|
|
# Subtest: the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
ok 31 - the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
---
|
|
duration_ms: 5677.1928
|
|
type: 'test'
|
|
...
|
|
# Subtest: denial prevents command execution and produces a paired denied result
|
|
ok 32 - denial prevents command execution and produces a paired denied result
|
|
---
|
|
duration_ms: 1786.9452
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping during approval interrupts pending calls without executing or replaying them
|
|
ok 33 - stopping during approval interrupts pending calls without executing or replaying them
|
|
---
|
|
duration_ms: 1887.1945
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
ok 34 - stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
---
|
|
duration_ms: 1887.357
|
|
type: 'test'
|
|
...
|
|
# Subtest: command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
ok 35 - command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
---
|
|
duration_ms: 1547.6495
|
|
type: 'test'
|
|
...
|
|
# Subtest: model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
ok 36 - model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
---
|
|
duration_ms: 6.3458
|
|
type: 'test'
|
|
...
|
|
# Subtest: truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
ok 37 - truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
---
|
|
duration_ms: 2889.131
|
|
type: 'test'
|
|
...
|
|
# Subtest: request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
ok 38 - request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
---
|
|
duration_ms: 2106.8141
|
|
type: 'test'
|
|
...
|
|
# Subtest: a live SQLite host with the actual 1.9 artifact object upgrades, keeps its original blobs and verifies real browser PNG bytes
|
|
ok 39 - a live SQLite host with the actual 1.9 artifact object upgrades, keeps its original blobs and verifies real browser PNG bytes
|
|
---
|
|
duration_ms: 4369.1298
|
|
type: 'test'
|
|
...
|
|
# Subtest: failed upgrade restores the original artifact object, provider and request handler
|
|
ok 40 - failed upgrade restores the original artifact object, provider and request handler
|
|
---
|
|
duration_ms: 1701.0943
|
|
type: 'test'
|
|
...
|
|
# Subtest: claiming the same runtime owner twice preserves its original metadata and every database row
|
|
ok 41 - claiming the same runtime owner twice preserves its original metadata and every database row
|
|
---
|
|
duration_ms: 897.1056
|
|
type: 'test'
|
|
...
|
|
# Subtest: sessions without controlled-engine history retain their prior export shape and never expose another session record
|
|
ok 42 - sessions without controlled-engine history retain their prior export shape and never expose another session record
|
|
---
|
|
duration_ms: 1193.7581
|
|
type: 'test'
|
|
...
|
|
# Subtest: live workers, controlled drivers, or MCP operations refuse an upgrade before changing handlers, managers or database rows
|
|
ok 43 - live workers, controlled drivers, or MCP operations refuse an upgrade before changing handlers, managers or database rows
|
|
---
|
|
duration_ms: 969.9211
|
|
type: 'test'
|
|
...
|
|
# Subtest: an idle upgrade loads the newly introduced engine record map, resets obsolete managers and preserves original rows, sessions and provider objects
|
|
ok 44 - an idle upgrade loads the newly introduced engine record map, resets obsolete managers and preserves original rows, sessions and provider objects
|
|
---
|
|
duration_ms: 1010.0131
|
|
type: 'test'
|
|
...
|
|
# Subtest: an installation failure restores old managers, original record maps, handlers and all existing database rows
|
|
ok 45 - an installation failure restores old managers, original record maps, handlers and all existing database rows
|
|
---
|
|
duration_ms: 1579.1
|
|
type: 'test'
|
|
...
|
|
# Subtest: the owned controlled driver remains an active session and project even after outer task activity has ended
|
|
ok 46 - the owned controlled driver remains an active session and project even after outer task activity has ended
|
|
---
|
|
duration_ms: 1174.6617
|
|
type: 'test'
|
|
...
|
|
# Subtest: release and upgrade help or invalid arguments have no file or network setup side effects in an independent directory
|
|
ok 47 - release and upgrade help or invalid arguments have no file or network setup side effects in an independent directory
|
|
---
|
|
duration_ms: 1018.0031
|
|
type: 'test'
|
|
...
|
|
# Subtest: hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
|
|
ok 48 - hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
|
|
---
|
|
duration_ms: 674.2535
|
|
type: 'test'
|
|
...
|
|
# Subtest: hot upgrade refuses active probes and restores retained model methods if installation fails
|
|
ok 49 - hot upgrade refuses active probes and restores retained model methods if installation fails
|
|
---
|
|
duration_ms: 511.5755
|
|
type: 'test'
|
|
...
|
|
1..49
|
|
# tests 49
|
|
# suites 0
|
|
# pass 49
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 38427.6009
|