Files
Agent-Workbench/docs/task-control-j-release-evidence/0035-task-control-diagnostic-tools-fixed-regression.tap
T
2026-11-01 16:35:58 +08:00

239 lines
10 KiB
Plaintext

TAP version 13
# Subtest: engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
ok 1 - engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
---
duration_ms: 1168.8295
type: 'test'
...
# Subtest: owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
ok 2 - owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
---
duration_ms: 2713.631
type: 'test'
...
# Subtest: an invalid startup nonce is rejected before initialize and preserves the process close and partial report
ok 3 - an invalid startup nonce is rejected before initialize and preserves the process close and partial report
---
duration_ms: 2550.8781
type: 'test'
...
# Subtest: SDK identity and session directory mismatches retain raw responses and never become verified
ok 4 - SDK identity and session directory mismatches retain raw responses and never become verified
---
duration_ms: 6868.6013
type: 'test'
...
# Subtest: cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
ok 5 - cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
---
duration_ms: 2430.1772
type: 'test'
...
# Subtest: cancel before readiness sends no protocol request and a user retry creates a different process and record
ok 6 - cancel before readiness sends no protocol request and a user retry creates a different process and record
---
duration_ms: 3457.3875
type: 'test'
...
# Subtest: source or scratch changes and unexpected model traffic fail after preserving the actual observed result
ok 7 - source or scratch changes and unexpected model traffic fail after preserving the actual observed result
---
duration_ms: 7784.2558
type: 'test'
...
# Subtest: unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
ok 8 - unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
---
duration_ms: 4473.7652
type: 'test'
...
# Subtest: engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
ok 9 - engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
---
duration_ms: 2506.6125
type: 'test'
...
# Subtest: foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
ok 10 - foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
---
duration_ms: 1939.7975
type: 'test'
...
# Subtest: restart never replays an active engine check or stops a historical PID, and keeps prior task state
ok 11 - restart never replays an active engine check or stops a historical PID, and keeps prior task state
---
duration_ms: 2631.3402
type: 'test'
...
# Subtest: model argument validation and runtime activity do not grant external engine prompt or project execution
ok 12 - model argument validation and runtime activity do not grant external engine prompt or project execution
---
duration_ms: 957.3131
type: 'test'
...
# Subtest: a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
ok 13 - a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
---
duration_ms: 4498.0523
type: 'test'
...
# Subtest: proposals preserve project bytes until review; apply backs up the exact original bytes
ok 14 - proposals preserve project bytes until review; apply backs up the exact original bytes
---
duration_ms: 1062.9809
type: 'test'
...
# Subtest: new nested files are created only on apply and unchanged content creates no proposal
ok 15 - new nested files are created only on apply and unchanged content creates no proposal
---
duration_ms: 1026.8567
type: 'test'
...
# Subtest: stale reads and changed baselines are rejected without overwriting external edits
ok 16 - stale reads and changed baselines are rejected without overwriting external edits
---
duration_ms: 824.1633
type: 'test'
...
# Subtest: file paths reject traversal, absolute paths, credentials and outside junctions
ok 17 - file paths reject traversal, absolute paths, credentials and outside junctions
---
duration_ms: 653.2889
type: 'test'
...
# Subtest: read and search expose bounded text scopes and reject non UTF-8 / oversized files
ok 18 - read and search expose bounded text scopes and reject non UTF-8 / oversized files
---
duration_ms: 1476.8025
type: 'test'
...
# Subtest: project-local junctions cannot expose or create protected Git and credential files
ok 19 - project-local junctions cannot expose or create protected Git and credential files
---
duration_ms: 1111.4799
type: 'test'
...
# Subtest: Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
ok 20 - Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
---
duration_ms: 1115.3924
type: 'test'
...
# Subtest: deep Windows data directories keep REA output within the external path allowance and retain owned evidence
ok 21 - deep Windows data directories keep REA output within the external path allowance and retain owned evidence
---
duration_ms: 3257.4001
type: 'test'
...
# Subtest: user research registration creates an owned Task without model requests and seals the exact artifact identity
ok 22 - user research registration creates an owned Task without model requests and seals the exact artifact identity
---
duration_ms: 1625.8755
type: 'test'
...
# Subtest: complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
ok 23 - complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
---
duration_ms: 3108.1624
type: 'test'
...
# Subtest: artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
ok 24 - artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
---
duration_ms: 4786.434
type: 'test'
...
# Subtest: owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
ok 25 - owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
---
duration_ms: 3101.7906
type: 'test'
...
# Subtest: a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
ok 26 - a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
---
duration_ms: 2761.6788
type: 'test'
...
# Subtest: corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
ok 27 - corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
---
duration_ms: 3043.8897
type: 'test'
...
# Subtest: research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
ok 28 - research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
---
duration_ms: 1437.7189
type: 'test'
...
# Subtest: research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
ok 29 - research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
---
duration_ms: 9109.8709
type: 'test'
...
# Subtest: file identity rejects directory and invalid formats without running a target
ok 30 - file identity rejects directory and invalid formats without running a target
---
duration_ms: 1355.3407
type: 'test'
...
# Subtest: operational questions are diagnostic while explicit repair requests remain execution instructions
ok 31 - operational questions are diagnostic while explicit repair requests remain execution instructions
---
duration_ms: 1.7313
type: 'test'
...
# Subtest: an unsubstantiated text claim cannot complete a requested file delivery
ok 32 - an unsubstantiated text claim cannot complete a requested file delivery
---
duration_ms: 1801.3203
type: 'test'
...
# Subtest: HTML without tests ends at reviewed file delivery and never offers automatic rechecking
ok 33 - HTML without tests ends at reviewed file delivery and never offers automatic rechecking
---
duration_ms: 3637.8796
type: 'test'
...
# Subtest: diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
ok 34 - diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
---
duration_ms: 4038.1003
type: 'test'
...
# Subtest: review continuation is a system action and adds no testing demand or fake user instruction
ok 35 - review continuation is a system action and adds no testing demand or fake user instruction
---
duration_ms: 2453.1791
type: 'test'
...
# Subtest: a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
ok 36 - a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
---
duration_ms: 2232.1225
type: 'test'
...
# Subtest: a budget pause becomes visible only after its input snapshot can be sealed with the original Run
ok 37 - a budget pause becomes visible only after its input snapshot can be sealed with the original Run
---
duration_ms: 1594.8494
type: 'test'
...
# Subtest: alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
ok 38 - alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
---
duration_ms: 20336.5577
type: 'test'
...
1..38
# tests 38
# suites 0
# pass 38
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 77336.0984