239 lines
10 KiB
Plaintext
239 lines
10 KiB
Plaintext
TAP version 13
|
|
# Subtest: engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
|
|
ok 1 - engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
|
|
---
|
|
duration_ms: 1168.8295
|
|
type: 'test'
|
|
...
|
|
# Subtest: owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
|
|
ok 2 - owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
|
|
---
|
|
duration_ms: 2713.631
|
|
type: 'test'
|
|
...
|
|
# Subtest: an invalid startup nonce is rejected before initialize and preserves the process close and partial report
|
|
ok 3 - an invalid startup nonce is rejected before initialize and preserves the process close and partial report
|
|
---
|
|
duration_ms: 2550.8781
|
|
type: 'test'
|
|
...
|
|
# Subtest: SDK identity and session directory mismatches retain raw responses and never become verified
|
|
ok 4 - SDK identity and session directory mismatches retain raw responses and never become verified
|
|
---
|
|
duration_ms: 6868.6013
|
|
type: 'test'
|
|
...
|
|
# Subtest: cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
|
|
ok 5 - cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
|
|
---
|
|
duration_ms: 2430.1772
|
|
type: 'test'
|
|
...
|
|
# Subtest: cancel before readiness sends no protocol request and a user retry creates a different process and record
|
|
ok 6 - cancel before readiness sends no protocol request and a user retry creates a different process and record
|
|
---
|
|
duration_ms: 3457.3875
|
|
type: 'test'
|
|
...
|
|
# Subtest: source or scratch changes and unexpected model traffic fail after preserving the actual observed result
|
|
ok 7 - source or scratch changes and unexpected model traffic fail after preserving the actual observed result
|
|
---
|
|
duration_ms: 7784.2558
|
|
type: 'test'
|
|
...
|
|
# Subtest: unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
|
|
ok 8 - unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
|
|
---
|
|
duration_ms: 4473.7652
|
|
type: 'test'
|
|
...
|
|
# Subtest: engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
|
|
ok 9 - engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
|
|
---
|
|
duration_ms: 2506.6125
|
|
type: 'test'
|
|
...
|
|
# Subtest: foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
|
|
ok 10 - foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
|
|
---
|
|
duration_ms: 1939.7975
|
|
type: 'test'
|
|
...
|
|
# Subtest: restart never replays an active engine check or stops a historical PID, and keeps prior task state
|
|
ok 11 - restart never replays an active engine check or stops a historical PID, and keeps prior task state
|
|
---
|
|
duration_ms: 2631.3402
|
|
type: 'test'
|
|
...
|
|
# Subtest: model argument validation and runtime activity do not grant external engine prompt or project execution
|
|
ok 12 - model argument validation and runtime activity do not grant external engine prompt or project execution
|
|
---
|
|
duration_ms: 957.3131
|
|
type: 'test'
|
|
...
|
|
# Subtest: a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
|
|
ok 13 - a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
|
|
---
|
|
duration_ms: 4498.0523
|
|
type: 'test'
|
|
...
|
|
# Subtest: proposals preserve project bytes until review; apply backs up the exact original bytes
|
|
ok 14 - proposals preserve project bytes until review; apply backs up the exact original bytes
|
|
---
|
|
duration_ms: 1062.9809
|
|
type: 'test'
|
|
...
|
|
# Subtest: new nested files are created only on apply and unchanged content creates no proposal
|
|
ok 15 - new nested files are created only on apply and unchanged content creates no proposal
|
|
---
|
|
duration_ms: 1026.8567
|
|
type: 'test'
|
|
...
|
|
# Subtest: stale reads and changed baselines are rejected without overwriting external edits
|
|
ok 16 - stale reads and changed baselines are rejected without overwriting external edits
|
|
---
|
|
duration_ms: 824.1633
|
|
type: 'test'
|
|
...
|
|
# Subtest: file paths reject traversal, absolute paths, credentials and outside junctions
|
|
ok 17 - file paths reject traversal, absolute paths, credentials and outside junctions
|
|
---
|
|
duration_ms: 653.2889
|
|
type: 'test'
|
|
...
|
|
# Subtest: read and search expose bounded text scopes and reject non UTF-8 / oversized files
|
|
ok 18 - read and search expose bounded text scopes and reject non UTF-8 / oversized files
|
|
---
|
|
duration_ms: 1476.8025
|
|
type: 'test'
|
|
...
|
|
# Subtest: project-local junctions cannot expose or create protected Git and credential files
|
|
ok 19 - project-local junctions cannot expose or create protected Git and credential files
|
|
---
|
|
duration_ms: 1111.4799
|
|
type: 'test'
|
|
...
|
|
# Subtest: Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
|
|
ok 20 - Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
|
|
---
|
|
duration_ms: 1115.3924
|
|
type: 'test'
|
|
...
|
|
# Subtest: deep Windows data directories keep REA output within the external path allowance and retain owned evidence
|
|
ok 21 - deep Windows data directories keep REA output within the external path allowance and retain owned evidence
|
|
---
|
|
duration_ms: 3257.4001
|
|
type: 'test'
|
|
...
|
|
# Subtest: user research registration creates an owned Task without model requests and seals the exact artifact identity
|
|
ok 22 - user research registration creates an owned Task without model requests and seals the exact artifact identity
|
|
---
|
|
duration_ms: 1625.8755
|
|
type: 'test'
|
|
...
|
|
# Subtest: complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
|
|
ok 23 - complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
|
|
---
|
|
duration_ms: 3108.1624
|
|
type: 'test'
|
|
...
|
|
# Subtest: artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
|
|
ok 24 - artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
|
|
---
|
|
duration_ms: 4786.434
|
|
type: 'test'
|
|
...
|
|
# Subtest: owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
|
|
ok 25 - owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
|
|
---
|
|
duration_ms: 3101.7906
|
|
type: 'test'
|
|
...
|
|
# Subtest: a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
|
|
ok 26 - a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
|
|
---
|
|
duration_ms: 2761.6788
|
|
type: 'test'
|
|
...
|
|
# Subtest: corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
|
|
ok 27 - corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
|
|
---
|
|
duration_ms: 3043.8897
|
|
type: 'test'
|
|
...
|
|
# Subtest: research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
|
|
ok 28 - research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
|
|
---
|
|
duration_ms: 1437.7189
|
|
type: 'test'
|
|
...
|
|
# Subtest: research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
|
|
ok 29 - research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
|
|
---
|
|
duration_ms: 9109.8709
|
|
type: 'test'
|
|
...
|
|
# Subtest: file identity rejects directory and invalid formats without running a target
|
|
ok 30 - file identity rejects directory and invalid formats without running a target
|
|
---
|
|
duration_ms: 1355.3407
|
|
type: 'test'
|
|
...
|
|
# Subtest: operational questions are diagnostic while explicit repair requests remain execution instructions
|
|
ok 31 - operational questions are diagnostic while explicit repair requests remain execution instructions
|
|
---
|
|
duration_ms: 1.7313
|
|
type: 'test'
|
|
...
|
|
# Subtest: an unsubstantiated text claim cannot complete a requested file delivery
|
|
ok 32 - an unsubstantiated text claim cannot complete a requested file delivery
|
|
---
|
|
duration_ms: 1801.3203
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTML without tests ends at reviewed file delivery and never offers automatic rechecking
|
|
ok 33 - HTML without tests ends at reviewed file delivery and never offers automatic rechecking
|
|
---
|
|
duration_ms: 3637.8796
|
|
type: 'test'
|
|
...
|
|
# Subtest: diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
|
|
ok 34 - diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
|
|
---
|
|
duration_ms: 4038.1003
|
|
type: 'test'
|
|
...
|
|
# Subtest: review continuation is a system action and adds no testing demand or fake user instruction
|
|
ok 35 - review continuation is a system action and adds no testing demand or fake user instruction
|
|
---
|
|
duration_ms: 2453.1791
|
|
type: 'test'
|
|
...
|
|
# Subtest: a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
|
|
ok 36 - a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
|
|
---
|
|
duration_ms: 2232.1225
|
|
type: 'test'
|
|
...
|
|
# Subtest: a budget pause becomes visible only after its input snapshot can be sealed with the original Run
|
|
ok 37 - a budget pause becomes visible only after its input snapshot can be sealed with the original Run
|
|
---
|
|
duration_ms: 1594.8494
|
|
type: 'test'
|
|
...
|
|
# Subtest: alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
|
|
ok 38 - alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
|
|
---
|
|
duration_ms: 20336.5577
|
|
type: 'test'
|
|
...
|
|
1..38
|
|
# tests 38
|
|
# suites 0
|
|
# pass 38
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 77336.0984
|