209 lines
9.2 KiB
Plaintext
209 lines
9.2 KiB
Plaintext
TAP version 13
|
|
# Subtest: engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
|
|
ok 1 - engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
|
|
---
|
|
duration_ms: 1572.3025
|
|
type: 'test'
|
|
...
|
|
# Subtest: owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
|
|
ok 2 - owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
|
|
---
|
|
duration_ms: 2190.5202
|
|
type: 'test'
|
|
...
|
|
# Subtest: an invalid startup nonce is rejected before initialize and preserves the process close and partial report
|
|
ok 3 - an invalid startup nonce is rejected before initialize and preserves the process close and partial report
|
|
---
|
|
duration_ms: 1533.2212
|
|
type: 'test'
|
|
...
|
|
# Subtest: SDK identity and session directory mismatches retain raw responses and never become verified
|
|
ok 4 - SDK identity and session directory mismatches retain raw responses and never become verified
|
|
---
|
|
duration_ms: 5009.9958
|
|
type: 'test'
|
|
...
|
|
# Subtest: cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
|
|
ok 5 - cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
|
|
---
|
|
duration_ms: 1567.6336
|
|
type: 'test'
|
|
...
|
|
# Subtest: cancel before readiness sends no protocol request and a user retry creates a different process and record
|
|
ok 6 - cancel before readiness sends no protocol request and a user retry creates a different process and record
|
|
---
|
|
duration_ms: 1973.2373
|
|
type: 'test'
|
|
...
|
|
# Subtest: source or scratch changes and unexpected model traffic fail after preserving the actual observed result
|
|
ok 7 - source or scratch changes and unexpected model traffic fail after preserving the actual observed result
|
|
---
|
|
duration_ms: 4875.9553
|
|
type: 'test'
|
|
...
|
|
# Subtest: unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
|
|
ok 8 - unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
|
|
---
|
|
duration_ms: 2762.6046
|
|
type: 'test'
|
|
...
|
|
# Subtest: engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
|
|
ok 9 - engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
|
|
---
|
|
duration_ms: 1291.8626
|
|
type: 'test'
|
|
...
|
|
# Subtest: foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
|
|
ok 10 - foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
|
|
---
|
|
duration_ms: 1638.7162
|
|
type: 'test'
|
|
...
|
|
# Subtest: restart never replays an active engine check or stops a historical PID, and keeps prior task state
|
|
ok 11 - restart never replays an active engine check or stops a historical PID, and keeps prior task state
|
|
---
|
|
duration_ms: 1835.1335
|
|
type: 'test'
|
|
...
|
|
# Subtest: model argument validation and runtime activity do not grant external engine prompt or project execution
|
|
ok 12 - model argument validation and runtime activity do not grant external engine prompt or project execution
|
|
---
|
|
duration_ms: 859.7965
|
|
type: 'test'
|
|
...
|
|
# Subtest: a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
|
|
ok 13 - a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
|
|
---
|
|
duration_ms: 2534.6201
|
|
type: 'test'
|
|
...
|
|
# Subtest: two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
|
|
ok 14 - two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
|
|
---
|
|
duration_ms: 1352.5938
|
|
type: 'test'
|
|
...
|
|
# Subtest: incomplete, unsupported, relative and oversized sources cannot enable the experiment
|
|
ok 15 - incomplete, unsupported, relative and oversized sources cannot enable the experiment
|
|
---
|
|
duration_ms: 1055.5124
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
|
|
ok 16 - invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
|
|
---
|
|
duration_ms: 2631.8242
|
|
type: 'test'
|
|
...
|
|
# Subtest: source edits between detection and plan are rejected without creating a parent Task
|
|
ok 17 - source edits between detection and plan are rejected without creating a parent Task
|
|
---
|
|
duration_ms: 2176.0754
|
|
type: 'test'
|
|
...
|
|
# Subtest: source edits after sealing cannot launch a child and do not reset its cumulative budget
|
|
ok 18 - source edits after sealing cannot launch a child and do not reset its cumulative budget
|
|
---
|
|
duration_ms: 7867.1715
|
|
type: 'test'
|
|
...
|
|
# Subtest: literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
|
|
ok 19 - literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
|
|
---
|
|
duration_ms: 24017.2698
|
|
type: 'test'
|
|
...
|
|
# Subtest: source changes after a model response stop before any native tool is accepted, retaining the actual usage once
|
|
ok 20 - source changes after a model response stop before any native tool is accepted, retaining the actual usage once
|
|
---
|
|
duration_ms: 8227.9167
|
|
type: 'test'
|
|
...
|
|
# Subtest: source changes while approval is pending invalidate the old permission before an engineering check starts
|
|
ok 21 - source changes while approval is pending invalidate the old permission before an engineering check starts
|
|
---
|
|
duration_ms: 10703.9141
|
|
type: 'test'
|
|
...
|
|
# Subtest: altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
|
|
ok 22 - altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
|
|
---
|
|
duration_ms: 1732.6069
|
|
type: 'test'
|
|
...
|
|
# Subtest: the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
|
|
ok 23 - the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
|
|
---
|
|
duration_ms: 1660.4912
|
|
type: 'test'
|
|
...
|
|
# Subtest: a missing or duplicated experimental section in the actual input is rejected before any model dispatch
|
|
ok 24 - a missing or duplicated experimental section in the actual input is rejected before any model dispatch
|
|
---
|
|
duration_ms: 15484.8148
|
|
type: 'test'
|
|
...
|
|
# Subtest: experimental prompt overhead still participates in the original complete-input budget guard
|
|
ok 25 - experimental prompt overhead still participates in the original complete-input budget guard
|
|
---
|
|
duration_ms: 7530.951
|
|
type: 'test'
|
|
...
|
|
# Subtest: source detection HTTP remains local-authenticated and read-only with no configured model requests
|
|
ok 26 - source detection HTTP remains local-authenticated and read-only with no configured model requests
|
|
---
|
|
duration_ms: 1733.9798
|
|
type: 'test'
|
|
...
|
|
# Subtest: an installed app outside the source drive resolves registered SDK and Purge through actual input verification
|
|
ok 27 - an installed app outside the source drive resolves registered SDK and Purge through actual input verification
|
|
---
|
|
duration_ms: 826.6132
|
|
type: 'test'
|
|
...
|
|
# Subtest: standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
|
|
ok 28 - standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
|
|
---
|
|
duration_ms: 732.9515
|
|
type: 'test'
|
|
...
|
|
# Subtest: registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
|
|
ok 29 - registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
|
|
---
|
|
duration_ms: 932.5346
|
|
type: 'test'
|
|
...
|
|
# Subtest: unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
|
|
ok 30 - unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
|
|
---
|
|
duration_ms: 700.5717
|
|
type: 'test'
|
|
...
|
|
# Subtest: oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
|
|
ok 31 - oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
|
|
---
|
|
duration_ms: 652.1831
|
|
type: 'test'
|
|
...
|
|
# Subtest: a linked registry directory is rejected without reading or deleting its external source
|
|
ok 32 - a linked registry directory is rejected without reading or deleting its external source
|
|
---
|
|
duration_ms: 647.4719
|
|
type: 'test'
|
|
...
|
|
# Subtest: matching research declarations do not replace actual installed version and critical-source checks
|
|
ok 33 - matching research declarations do not replace actual installed version and critical-source checks
|
|
---
|
|
duration_ms: 767.5801
|
|
type: 'test'
|
|
...
|
|
1..33
|
|
# tests 33
|
|
# suites 0
|
|
# pass 33
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 86302.5805
|