Files
Agent-Workbench/docs/task-control-j-release-evidence/0146-task-control-i-targeted-regression.tap
T
2026-11-01 16:35:58 +08:00

215 lines
9.2 KiB
Plaintext

TAP version 13
# Subtest: batch APIs enforce ownership and review fingerprints, apply once, and persist the completed batch across restart
ok 1 - batch APIs enforce ownership and review fingerprints, apply once, and persist the completed batch across restart
---
duration_ms: 6573.9285
type: 'test'
...
# Subtest: delivery reports bind actual batch identity and reject corrupted snapshot evidence without changing project files
ok 2 - delivery reports bind actual batch identity and reject corrupted snapshot evidence without changing project files
---
duration_ms: 3616.5694
type: 'test'
...
# Subtest: a compatible model can seal proposals through the real HTTP loop while application stays behind user review
ok 3 - a compatible model can seal proposals through the real HTTP loop while application stays behind user review
---
duration_ms: 5021.3545
type: 'test'
...
# Subtest: a step-limited sealed batch applies and continues the same Task into actual checks without replaying saved tools
ok 4 - a step-limited sealed batch applies and continues the same Task into actual checks without replaying saved tools
---
duration_ms: 18009.5825
type: 'test'
...
# Subtest: applied batches cannot turn cancellation, other budgets, restart or unknown commands into a review continuation
ok 5 - applied batches cannot turn cancellation, other budgets, restart or unknown commands into a review continuation
---
duration_ms: 3790.9371
type: 'test'
...
# Subtest: a rebuilt source archive binds actual generated client assets and retains its original running identity after disk changes
ok 6 - a rebuilt source archive binds actual generated client assets and retains its original running identity after disk changes
---
duration_ms: 2254.0274
type: 'test'
...
# Subtest: host challenge proof rejects a stale challenge, changed identity and changed signature
ok 7 - host challenge proof rejects a stale challenge, changed identity and changed signature
---
duration_ms: 0.7575
type: 'test'
...
# Subtest: stop confirmation binds the original instance, creation and loaded runtime
ok 8 - stop confirmation binds the original instance, creation and loaded runtime
---
duration_ms: 0.1289
type: 'test'
...
# Subtest: state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
ok 9 - state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
---
duration_ms: 810.5638
type: 'test'
...
# Subtest: failed registration publishes no initialized memory and can complete after its actual inputs are supplied
ok 10 - failed registration publishes no initialized memory and can complete after its actual inputs are supplied
---
duration_ms: 2643.0087
type: 'test'
...
# Subtest: host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
ok 11 - host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
---
duration_ms: 1.1261
type: 'test'
...
# Subtest: host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
ok 12 - host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
---
duration_ms: 937.8771
type: 'test'
...
# Subtest: owned startup retries only read-only observation after a slow health response and attests the same original child
ok 13 - owned startup retries only read-only observation after a slow health response and attests the same original child
---
duration_ms: 3970.0028
type: 'test'
...
# Subtest: unverified startup expires with its original live child and never treats timeout or an unrelated health PID as proof
ok 14 - unverified startup expires with its original live child and never treats timeout or an unrelated health PID as proof
---
duration_ms: 5044.1698
type: 'test'
...
# Subtest: a process exiting between the Windows snapshot and owner query is absent only after a fresh query
ok 15 - a process exiting between the Windows snapshot and owner query is absent only after a fresh query
---
duration_ms: 1538.7408
type: 'test'
...
# Subtest: owner observation errors remain errors while a process is present, replaced, or cannot be rechecked
ok 16 - owner observation errors remain errors while a process is present, replaced, or cannot be rechecked
---
duration_ms: 1555.5954
type: 'test'
...
# Subtest: a stop from the event loop interrupts immediate model replies before later tools
ok 17 - a stop from the event loop interrupts immediate model replies before later tools
---
duration_ms: 3786.0288
type: 'test'
...
# Subtest: a stop after the first tool preserves a complete interrupted multi-call protocol group
ok 18 - a stop after the first tool preserves a complete interrupted multi-call protocol group
---
duration_ms: 3342.0696
type: 'test'
...
# Subtest: the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
ok 19 - the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
---
duration_ms: 7516.9448
type: 'test'
...
# Subtest: denial prevents command execution and produces a paired denied result
ok 20 - denial prevents command execution and produces a paired denied result
---
duration_ms: 3499.6678
type: 'test'
...
# Subtest: stopping during approval interrupts pending calls without executing or replaying them
ok 21 - stopping during approval interrupts pending calls without executing or replaying them
---
duration_ms: 3635.6839
type: 'test'
...
# Subtest: stopping a running fixture command terminates its own process tree and retains uncertain state
ok 22 - stopping a running fixture command terminates its own process tree and retains uncertain state
---
duration_ms: 3493.2185
type: 'test'
...
# Subtest: command output decodes split UTF-8 and excludes the workbench key from child environment
ok 23 - command output decodes split UTF-8 and excludes the workbench key from child environment
---
duration_ms: 2223.987
type: 'test'
...
# Subtest: model-list testing uses a tentative key without changing the saved connection and redacts service errors
ok 24 - model-list testing uses a tentative key without changing the saved connection and redacts service errors
---
duration_ms: 5.6242
type: 'test'
...
# Subtest: truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
ok 25 - truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
---
duration_ms: 5205.3575
type: 'test'
...
# Subtest: request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
ok 26 - request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
---
duration_ms: 3784.5944
type: 'test'
...
# Subtest: operational questions are diagnostic while explicit repair requests remain execution instructions
ok 27 - operational questions are diagnostic while explicit repair requests remain execution instructions
---
duration_ms: 1.036
type: 'test'
...
# Subtest: an unsubstantiated text claim cannot complete a requested file delivery
ok 28 - an unsubstantiated text claim cannot complete a requested file delivery
---
duration_ms: 2717.2621
type: 'test'
...
# Subtest: HTML without tests ends at reviewed file delivery and never offers automatic rechecking
ok 29 - HTML without tests ends at reviewed file delivery and never offers automatic rechecking
---
duration_ms: 4537.0513
type: 'test'
...
# Subtest: diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
ok 30 - diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
---
duration_ms: 6889.3827
type: 'test'
...
# Subtest: review continuation is a system action and adds no testing demand or fake user instruction
ok 31 - review continuation is a system action and adds no testing demand or fake user instruction
---
duration_ms: 5546.7107
type: 'test'
...
# Subtest: a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
ok 32 - a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
---
duration_ms: 4190.7094
type: 'test'
...
# Subtest: a budget pause becomes visible only after its input snapshot can be sealed with the original Run
ok 33 - a budget pause becomes visible only after its input snapshot can be sealed with the original Run
---
duration_ms: 4530.0886
type: 'test'
...
# Subtest: alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
ok 34 - alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
---
duration_ms: 27579.0433
type: 'test'
...
1..34
# tests 34
# suites 0
# pass 34
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 93328.8148