449 lines
19 KiB
Plaintext
449 lines
19 KiB
Plaintext
TAP version 13
|
|
# Subtest: context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
|
|
ok 1 - context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
|
|
---
|
|
duration_ms: 6979.2145
|
|
type: 'test'
|
|
...
|
|
# Subtest: delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
|
|
ok 2 - delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
|
|
---
|
|
duration_ms: 6591.8051
|
|
type: 'test'
|
|
...
|
|
# Subtest: direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
|
|
ok 3 - direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
|
|
---
|
|
duration_ms: 4399.5529
|
|
type: 'test'
|
|
...
|
|
# Subtest: one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
|
|
ok 4 - one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
|
|
---
|
|
duration_ms: 9874.473
|
|
type: 'test'
|
|
...
|
|
# Subtest: tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
|
|
ok 5 - tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
|
|
---
|
|
duration_ms: 1299.4618
|
|
type: 'test'
|
|
...
|
|
# Subtest: oversized required user instructions pause intact and can be explicitly resumed after increasing the window
|
|
ok 6 - oversized required user instructions pause intact and can be explicitly resumed after increasing the window
|
|
---
|
|
duration_ms: 4689.411
|
|
type: 'test'
|
|
...
|
|
# Subtest: all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
|
|
ok 7 - all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
|
|
---
|
|
duration_ms: 2610.6107
|
|
type: 'test'
|
|
...
|
|
# Subtest: a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
|
|
ok 8 - a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
|
|
---
|
|
duration_ms: 2030.5824
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid orphan result is rejected before archive or network preparation
|
|
ok 9 - invalid orphan result is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 2130.4313
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid missing result is rejected before archive or network preparation
|
|
ok 10 - invalid missing result is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 1198.205
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid wrong result is rejected before archive or network preparation
|
|
ok 11 - invalid wrong result is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 1038.1541
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid duplicate call is rejected before archive or network preparation
|
|
ok 12 - invalid duplicate call is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 935.658
|
|
type: 'test'
|
|
...
|
|
# Subtest: a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
|
|
ok 13 - a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
|
|
---
|
|
duration_ms: 2738.6507
|
|
type: 'test'
|
|
...
|
|
# Subtest: changed or missing archived evidence stops reuse and is never silently recreated
|
|
ok 14 - changed or missing archived evidence stops reuse and is never silently recreated
|
|
---
|
|
duration_ms: 1605.4898
|
|
type: 'test'
|
|
...
|
|
# Subtest: transaction failure prevents publishing a plan and any corresponding model request
|
|
ok 15 - transaction failure prevents publishing a plan and any corresponding model request
|
|
---
|
|
duration_ms: 1501.351
|
|
type: 'test'
|
|
...
|
|
# Subtest: the Provider rejects body mutation after a sealed plan before calling HTTP
|
|
ok 16 - the Provider rejects body mutation after a sealed plan before calling HTTP
|
|
---
|
|
duration_ms: 1480.4372
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
|
|
ok 17 - HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
|
|
---
|
|
duration_ms: 15469.3642
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real process exit after plan persistence marks interruption and never issues an automatic model request
|
|
ok 18 - a real process exit after plan persistence marks interruption and never issues an automatic model request
|
|
---
|
|
duration_ms: 3014.5258
|
|
type: 'test'
|
|
...
|
|
# Subtest: deep Windows data directories keep REA output within the external path allowance and retain owned evidence
|
|
ok 19 - deep Windows data directories keep REA output within the external path allowance and retain owned evidence
|
|
---
|
|
duration_ms: 4960.972
|
|
type: 'test'
|
|
...
|
|
# Subtest: user research registration creates an owned Task without model requests and seals the exact artifact identity
|
|
ok 20 - user research registration creates an owned Task without model requests and seals the exact artifact identity
|
|
---
|
|
duration_ms: 2171.0417
|
|
type: 'test'
|
|
...
|
|
# Subtest: complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
|
|
ok 21 - complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
|
|
---
|
|
duration_ms: 4638.1718
|
|
type: 'test'
|
|
...
|
|
# Subtest: artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
|
|
ok 22 - artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
|
|
---
|
|
duration_ms: 4903.7932
|
|
type: 'test'
|
|
...
|
|
# Subtest: owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
|
|
ok 23 - owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
|
|
---
|
|
duration_ms: 2724.4005
|
|
type: 'test'
|
|
...
|
|
# Subtest: a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
|
|
ok 24 - a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
|
|
---
|
|
duration_ms: 2407.4991
|
|
type: 'test'
|
|
...
|
|
# Subtest: corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
|
|
ok 25 - corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
|
|
---
|
|
duration_ms: 2866.9697
|
|
type: 'test'
|
|
...
|
|
# Subtest: research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
|
|
ok 26 - research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
|
|
---
|
|
duration_ms: 1604.9994
|
|
type: 'test'
|
|
...
|
|
# Subtest: research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
|
|
ok 27 - research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
|
|
---
|
|
duration_ms: 10816.4026
|
|
type: 'test'
|
|
...
|
|
# Subtest: file identity rejects directory and invalid formats without running a target
|
|
ok 28 - file identity rejects directory and invalid formats without running a target
|
|
---
|
|
duration_ms: 1431.3101
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop from the event loop interrupts immediate model replies before later tools
|
|
ok 29 - a stop from the event loop interrupts immediate model replies before later tools
|
|
---
|
|
duration_ms: 3586.7298
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
ok 30 - a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
---
|
|
duration_ms: 6016.5335
|
|
type: 'test'
|
|
...
|
|
# Subtest: the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
ok 31 - the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
---
|
|
duration_ms: 11563.1147
|
|
type: 'test'
|
|
...
|
|
# Subtest: denial prevents command execution and produces a paired denied result
|
|
ok 32 - denial prevents command execution and produces a paired denied result
|
|
---
|
|
duration_ms: 4410.841
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping during approval interrupts pending calls without executing or replaying them
|
|
ok 33 - stopping during approval interrupts pending calls without executing or replaying them
|
|
---
|
|
duration_ms: 4111.4136
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
ok 34 - stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
---
|
|
duration_ms: 5154.0147
|
|
type: 'test'
|
|
...
|
|
# Subtest: command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
ok 35 - command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
---
|
|
duration_ms: 2396.1243
|
|
type: 'test'
|
|
...
|
|
# Subtest: model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
ok 36 - model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
---
|
|
duration_ms: 6.931
|
|
type: 'test'
|
|
...
|
|
# Subtest: truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
ok 37 - truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
---
|
|
duration_ms: 9436.0079
|
|
type: 'test'
|
|
...
|
|
# Subtest: request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
ok 38 - request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
---
|
|
duration_ms: 3262.5649
|
|
type: 'test'
|
|
...
|
|
# Subtest: local skill revisions require explicit enable, retain original text, survive restart and stay within the selected project
|
|
ok 39 - local skill revisions require explicit enable, retain original text, survive restart and stay within the selected project
|
|
---
|
|
duration_ms: 3189.3453
|
|
type: 'test'
|
|
...
|
|
# Subtest: registration rejects non-SKILL paths, oversized/non-UTF8 files, duplicate sources and wrong field shapes without running project code
|
|
ok 40 - registration rejects non-SKILL paths, oversized/non-UTF8 files, duplicate sources and wrong field shapes without running project code
|
|
---
|
|
duration_ms: 2250.6319
|
|
type: 'test'
|
|
...
|
|
# Subtest: actual HTTP models receive only enabled current-project metadata, then a redacted owned skill page with complete tool pairing
|
|
ok 41 - actual HTTP models receive only enabled current-project metadata, then a redacted owned skill page with complete tool pairing
|
|
---
|
|
duration_ms: 6709.3384
|
|
type: 'test'
|
|
...
|
|
# Subtest: source edits after a catalog request prevent the read and appear as changed on the next request without replay
|
|
ok 42 - source edits after a catalog request prevent the read and appear as changed on the next request without replay
|
|
---
|
|
duration_ms: 5463.3195
|
|
type: 'test'
|
|
...
|
|
# Subtest: disabled and foreign skills cannot be read by guessing their IDs from another project
|
|
ok 43 - disabled and foreign skills cannot be read by guessing their IDs from another project
|
|
---
|
|
duration_ms: 5765.4489
|
|
type: 'test'
|
|
...
|
|
# Subtest: skill catalog takes remaining escaped JSON budget and cannot evict the user goal or current code
|
|
ok 44 - skill catalog takes remaining escaped JSON budget and cannot evict the user goal or current code
|
|
---
|
|
duration_ms: 3104.2986
|
|
type: 'test'
|
|
...
|
|
# Subtest: multilingual skill body pages fit actual tool JSON bytes and every page uses the same immutable artifact
|
|
ok 45 - multilingual skill body pages fit actual tool JSON bytes and every page uses the same immutable artifact
|
|
---
|
|
duration_ms: 9088.1257
|
|
type: 'test'
|
|
...
|
|
# Subtest: registry failures roll back enable and refresh state; corrupted snapshots block requests before network
|
|
ok 46 - registry failures roll back enable and refresh state; corrupted snapshots block requests before network
|
|
---
|
|
duration_ms: 5213.7016
|
|
type: 'test'
|
|
...
|
|
# Subtest: saved skill catalogs retain SHA-bound historical evidence and reject corrupt catalog blobs
|
|
ok 47 - saved skill catalogs retain SHA-bound historical evidence and reject corrupt catalog blobs
|
|
---
|
|
duration_ms: 5191.6416
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTTP skill administration enforces project scope, revision checks and idle mutation without model calls
|
|
ok 48 - HTTP skill administration enforces project scope, revision checks and idle mutation without model calls
|
|
---
|
|
duration_ms: 4251.6034
|
|
type: 'test'
|
|
...
|
|
# Subtest: JSON state keeps an atomic backup and preserves corrupt primary files
|
|
ok 49 - JSON state keeps an atomic backup and preserves corrupt primary files
|
|
---
|
|
duration_ms: 1318.2144
|
|
type: 'test'
|
|
...
|
|
# Subtest: tool-pair recovery fills missing results and drops orphan or duplicate results
|
|
ok 50 - tool-pair recovery fills missing results and drops orphan or duplicate results
|
|
---
|
|
duration_ms: 0.3387
|
|
type: 'test'
|
|
...
|
|
# Subtest: restart pauses unfinished work, retains proposals and never replays a command
|
|
ok 51 - restart pauses unfinished work, retains proposals and never replays a command
|
|
---
|
|
duration_ms: 585.1737
|
|
type: 'test'
|
|
...
|
|
# Subtest: public snapshots carry increasing revisions without the private provider transcript or config key
|
|
ok 52 - public snapshots carry increasing revisions without the private provider transcript or config key
|
|
---
|
|
duration_ms: 1195.0877
|
|
type: 'test'
|
|
...
|
|
# Subtest: a checkpoint seals all task requirements and original results without a model request and explicit continuation keeps the same Task without replay
|
|
ok 53 - a checkpoint seals all task requirements and original results without a model request and explicit continuation keeps the same Task without replay
|
|
---
|
|
duration_ms: 4789.465
|
|
type: 'test'
|
|
...
|
|
# Subtest: checkpoint sources, requirements, plan and original tool changes block continuation and leave original checkpoint bytes intact
|
|
ok 54 - checkpoint sources, requirements, plan and original tool changes block continuation and leave original checkpoint bytes intact
|
|
---
|
|
duration_ms: 3351.9649
|
|
type: 'test'
|
|
...
|
|
# Subtest: unknown tool effects and pending proposals stay blocked in recovery packages rather than being changed into completed work
|
|
ok 55 - unknown tool effects and pending proposals stay blocked in recovery packages rather than being changed into completed work
|
|
---
|
|
duration_ms: 3978.55
|
|
type: 'test'
|
|
...
|
|
# Subtest: checkpoint and referenced result corruption are rejected before dispatch and historical blobs are never rebuilt
|
|
ok 56 - checkpoint and referenced result corruption are rejected before dispatch and historical blobs are never rebuilt
|
|
---
|
|
duration_ms: 5004.9002
|
|
type: 'test'
|
|
...
|
|
# Subtest: checkpoint ownership, exact confirmation and concurrent operations reject foreign or stale resumes
|
|
ok 57 - checkpoint ownership, exact confirmation and concurrent operations reject foreign or stale resumes
|
|
---
|
|
duration_ms: 5063.6418
|
|
type: 'test'
|
|
...
|
|
# Subtest: Git identity changes and altered plan proofs cannot be accepted as the sealed recovery state
|
|
ok 58 - Git identity changes and altered plan proofs cannot be accepted as the sealed recovery state
|
|
---
|
|
duration_ms: 4009.5449
|
|
type: 'test'
|
|
...
|
|
# Subtest: checkpoint records survive SQLite reopen and do not trigger automatic model or tool replay
|
|
ok 59 - checkpoint records survive SQLite reopen and do not trigger automatic model or tool replay
|
|
---
|
|
duration_ms: 3703.297
|
|
type: 'test'
|
|
...
|
|
# Subtest: incomplete scans and in-progress project activity refuse checkpoint creation while private credentials are redacted from saved requirements
|
|
ok 60 - incomplete scans and in-progress project activity refuse checkpoint creation while private credentials are redacted from saved requirements
|
|
---
|
|
duration_ms: 3716.5907
|
|
type: 'test'
|
|
...
|
|
# Subtest: oversized recovery evidence is refused before reading or publishing the checkpoint
|
|
ok 61 - oversized recovery evidence is refused before reading or publishing the checkpoint
|
|
---
|
|
duration_ms: 3905.6266
|
|
type: 'test'
|
|
...
|
|
# Subtest: compiled checkpoint HTTP APIs bind current Task/Run, isolate sessions and only resume on an explicit matching confirmation
|
|
ok 62 - compiled checkpoint HTTP APIs bind current Task/Run, isolate sessions and only resume on an explicit matching confirmation
|
|
---
|
|
duration_ms: 7681.1358
|
|
type: 'test'
|
|
...
|
|
# Subtest: actual process exit before checkpoint commit retains only durable records without replay
|
|
ok 63 - actual process exit before checkpoint commit retains only durable records without replay
|
|
---
|
|
duration_ms: 2660.8924
|
|
type: 'test'
|
|
...
|
|
# Subtest: actual process exit after checkpoint commit retains only durable records without replay
|
|
ok 64 - actual process exit after checkpoint commit retains only durable records without replay
|
|
---
|
|
duration_ms: 2714.611
|
|
type: 'test'
|
|
...
|
|
# Subtest: operational questions are diagnostic while explicit repair requests remain execution instructions
|
|
ok 65 - operational questions are diagnostic while explicit repair requests remain execution instructions
|
|
---
|
|
duration_ms: 1.016
|
|
type: 'test'
|
|
...
|
|
# Subtest: file delivery requires a positive instruction, not saved evidence or a prohibited write
|
|
ok 66 - file delivery requires a positive instruction, not saved evidence or a prohibited write
|
|
---
|
|
duration_ms: 1.2634
|
|
type: 'test'
|
|
...
|
|
# Subtest: an unsubstantiated text claim cannot complete a requested file delivery
|
|
ok 67 - an unsubstantiated text claim cannot complete a requested file delivery
|
|
---
|
|
duration_ms: 1700.4651
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTML without tests ends at reviewed file delivery and never offers automatic rechecking
|
|
ok 68 - HTML without tests ends at reviewed file delivery and never offers automatic rechecking
|
|
---
|
|
duration_ms: 2355.539
|
|
type: 'test'
|
|
...
|
|
# Subtest: diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
|
|
ok 69 - diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
|
|
---
|
|
duration_ms: 3925.0045
|
|
type: 'test'
|
|
...
|
|
# Subtest: review continuation is a system action and adds no testing demand or fake user instruction
|
|
ok 70 - review continuation is a system action and adds no testing demand or fake user instruction
|
|
---
|
|
duration_ms: 3387.3903
|
|
type: 'test'
|
|
...
|
|
# Subtest: a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
|
|
ok 71 - a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
|
|
---
|
|
duration_ms: 2582.8708
|
|
type: 'test'
|
|
...
|
|
# Subtest: a budget pause becomes visible only after its input snapshot can be sealed with the original Run
|
|
ok 72 - a budget pause becomes visible only after its input snapshot can be sealed with the original Run
|
|
---
|
|
duration_ms: 3704.0271
|
|
type: 'test'
|
|
...
|
|
# Subtest: alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
|
|
ok 73 - alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
|
|
---
|
|
duration_ms: 21535.2027
|
|
type: 'test'
|
|
...
|
|
1..73
|
|
# tests 73
|
|
# suites 0
|
|
# pass 73
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 156381.4526
|