479 lines
21 KiB
Plaintext
479 lines
21 KiB
Plaintext
TAP version 13
|
|
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
|
|
ok 1 - Python static inspection does not import project code or probe a project interpreter before approval
|
|
---
|
|
duration_ms: 1208.0021
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
|
|
ok 2 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
|
|
---
|
|
duration_ms: 4431.7799
|
|
type: 'test'
|
|
...
|
|
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
|
|
ok 3 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
|
|
---
|
|
duration_ms: 2748.0539
|
|
type: 'test'
|
|
...
|
|
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
|
|
ok 4 - unittest empty, skipped, expected failure and class initialization errors never verify a task
|
|
---
|
|
duration_ms: 7585.4417
|
|
type: 'test'
|
|
...
|
|
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
|
|
ok 5 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
|
|
---
|
|
duration_ms: 2699.2979
|
|
type: 'test'
|
|
...
|
|
# Subtest: compilation reads actual Python source bytes without executing top-level project code
|
|
ok 6 - compilation reads actual Python source bytes without executing top-level project code
|
|
---
|
|
duration_ms: 2968.3246
|
|
type: 'test'
|
|
...
|
|
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
|
|
ok 7 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
|
|
---
|
|
duration_ms: 2232.4597
|
|
type: 'test'
|
|
...
|
|
# Subtest: changed project interpreters and forged Python plan bindings execute no check
|
|
ok 8 - changed project interpreters and forged Python plan bindings execute no check
|
|
---
|
|
duration_ms: 1220.5056
|
|
type: 'test'
|
|
...
|
|
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
|
|
ok 9 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
|
|
---
|
|
duration_ms: 1097.1932
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
|
|
ok 10 - stopping a real Python check terminates its child and keeps the completed result as cancelled
|
|
---
|
|
duration_ms: 1344.538
|
|
type: 'test'
|
|
...
|
|
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
|
|
ok 11 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
|
|
---
|
|
duration_ms: 12075.3595
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
|
|
ok 12 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
|
|
---
|
|
duration_ms: 10133.0573
|
|
type: 'test'
|
|
...
|
|
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
|
|
ok 13 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
|
|
---
|
|
duration_ms: 2238.9395
|
|
type: 'test'
|
|
...
|
|
# Subtest: continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
|
|
ok 14 - continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
|
|
---
|
|
duration_ms: 2.0127
|
|
type: 'test'
|
|
...
|
|
# Subtest: a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
|
|
ok 15 - a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
|
|
---
|
|
duration_ms: 0.6415
|
|
type: 'test'
|
|
...
|
|
# Subtest: budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
|
|
ok 16 - budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
|
|
---
|
|
duration_ms: 9.2556
|
|
type: 'test'
|
|
...
|
|
# Subtest: known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
|
|
ok 17 - known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
|
|
---
|
|
duration_ms: 0.3657
|
|
type: 'test'
|
|
...
|
|
# Subtest: actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
|
|
ok 18 - actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
|
|
---
|
|
duration_ms: 4262.0716
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
|
|
ok 19 - a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
|
|
---
|
|
duration_ms: 4979.689
|
|
type: 'test'
|
|
...
|
|
# Subtest: actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
|
|
ok 20 - actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
|
|
---
|
|
duration_ms: 5200.0823
|
|
type: 'test'
|
|
...
|
|
# Subtest: an installed app outside the source drive resolves registered SDK and Purge through actual input verification
|
|
ok 21 - an installed app outside the source drive resolves registered SDK and Purge through actual input verification
|
|
---
|
|
duration_ms: 657.9235
|
|
type: 'test'
|
|
...
|
|
# Subtest: standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
|
|
ok 22 - standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
|
|
---
|
|
duration_ms: 733.8023
|
|
type: 'test'
|
|
...
|
|
# Subtest: registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
|
|
ok 23 - registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
|
|
---
|
|
duration_ms: 963.7749
|
|
type: 'test'
|
|
...
|
|
# Subtest: unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
|
|
ok 24 - unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
|
|
---
|
|
duration_ms: 652.3366
|
|
type: 'test'
|
|
...
|
|
# Subtest: oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
|
|
ok 25 - oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
|
|
---
|
|
duration_ms: 633.8488
|
|
type: 'test'
|
|
...
|
|
# Subtest: a linked registry directory is rejected without reading or deleting its external source
|
|
ok 26 - a linked registry directory is rejected without reading or deleting its external source
|
|
---
|
|
duration_ms: 614.3625
|
|
type: 'test'
|
|
...
|
|
# Subtest: matching research declarations do not replace actual installed version and critical-source checks
|
|
ok 27 - matching research declarations do not replace actual installed version and critical-source checks
|
|
---
|
|
duration_ms: 827.2431
|
|
type: 'test'
|
|
...
|
|
# Subtest: runtime guides map archived evidence while all original reports and successful/failed source bytes remain independently verifiable
|
|
ok 28 - runtime guides map archived evidence while all original reports and successful/failed source bytes remain independently verifiable
|
|
---
|
|
duration_ms: 747.1152
|
|
type: 'test'
|
|
...
|
|
# Subtest: missing required research reports fail packaging rather than creating a successful placeholder
|
|
ok 29 - missing required research reports fail packaging rather than creating a successful placeholder
|
|
---
|
|
duration_ms: 569.4512
|
|
type: 'test'
|
|
...
|
|
# Subtest: full verification reports only verified bytes, complete declared scope and actual directory inventory; changed/deleted files still fail
|
|
ok 30 - full verification reports only verified bytes, complete declared scope and actual directory inventory; changed/deleted files still fail
|
|
---
|
|
duration_ms: 1514.3185
|
|
type: 'test'
|
|
...
|
|
# Subtest: preflight and activation continue one monotonic operation bound to installer hash; terminal replay and changed origin are rejected
|
|
ok 31 - preflight and activation continue one monotonic operation bound to installer hash; terminal replay and changed origin are rejected
|
|
---
|
|
duration_ms: 8795.3749
|
|
type: 'test'
|
|
...
|
|
# Subtest: preflight failures and fixed-candidate mismatches retain the actual reason without publishing a pointer
|
|
ok 32 - preflight failures and fixed-candidate mismatches retain the actual reason without publishing a pointer
|
|
---
|
|
duration_ms: 5385.8928
|
|
type: 'test'
|
|
...
|
|
# Subtest: cancel finishes only the original ready preparation, preserves data and pointer and refuses replay
|
|
ok 33 - cancel finishes only the original ready preparation, preserves data and pointer and refuses replay
|
|
---
|
|
duration_ms: 7041.2283
|
|
type: 'test'
|
|
...
|
|
# Subtest: the installation lock rejects concurrent same-id operations before they can overwrite original progress
|
|
ok 34 - the installation lock rejects concurrent same-id operations before they can overwrite original progress
|
|
---
|
|
duration_ms: 4439.4798
|
|
type: 'test'
|
|
...
|
|
# Subtest: original post-publication failure is linked to its rollback receipt and every original byte survives
|
|
ok 35 - original post-publication failure is linked to its rollback receipt and every original byte survives
|
|
---
|
|
duration_ms: 5296.0956
|
|
type: 'test'
|
|
...
|
|
# Subtest: a candidate mutation at the publication boundary still fails even after an earlier successful full validation
|
|
ok 36 - a candidate mutation at the publication boundary still fails even after an earlier successful full validation
|
|
---
|
|
duration_ms: 9926.5909
|
|
type: 'test'
|
|
...
|
|
# Subtest: public progress marks a lost process unknown without editing its original record or claiming completion
|
|
ok 37 - public progress marks a lost process unknown without editing its original record or claiming completion
|
|
---
|
|
duration_ms: 6460.3948
|
|
type: 'test'
|
|
...
|
|
# Subtest: throwing console/UI progress observers cannot decide the installation result
|
|
ok 38 - throwing console/UI progress observers cannot decide the installation result
|
|
---
|
|
duration_ms: 5317.7031
|
|
type: 'test'
|
|
...
|
|
# Subtest: a progress-only write failure after committed publication returns the authoritative receipt and a warning
|
|
ok 39 - a progress-only write failure after committed publication returns the authoritative receipt and a warning
|
|
---
|
|
duration_ms: 5026.4295
|
|
type: 'test'
|
|
...
|
|
# Subtest: browser and MCP approvals use actual tool categories; mobile exposes only category while keeping original fingerprint
|
|
ok 40 - browser and MCP approvals use actual tool categories; mobile exposes only category while keeping original fingerprint
|
|
---
|
|
duration_ms: 697.1223
|
|
type: 'test'
|
|
...
|
|
# Subtest: context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
|
|
ok 41 - context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
|
|
---
|
|
duration_ms: 3422.9848
|
|
type: 'test'
|
|
...
|
|
# Subtest: delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
|
|
ok 42 - delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
|
|
---
|
|
duration_ms: 1595.8311
|
|
type: 'test'
|
|
...
|
|
# Subtest: direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
|
|
ok 43 - direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
|
|
---
|
|
duration_ms: 1737.739
|
|
type: 'test'
|
|
...
|
|
# Subtest: one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
|
|
ok 44 - one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
|
|
---
|
|
duration_ms: 3190.6446
|
|
type: 'test'
|
|
...
|
|
# Subtest: tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
|
|
ok 45 - tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
|
|
---
|
|
duration_ms: 768.5291
|
|
type: 'test'
|
|
...
|
|
# Subtest: oversized required user instructions pause intact and can be explicitly resumed after increasing the window
|
|
ok 46 - oversized required user instructions pause intact and can be explicitly resumed after increasing the window
|
|
---
|
|
duration_ms: 1576.23
|
|
type: 'test'
|
|
...
|
|
# Subtest: all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
|
|
ok 47 - all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
|
|
---
|
|
duration_ms: 1020.2031
|
|
type: 'test'
|
|
...
|
|
# Subtest: a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
|
|
ok 48 - a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
|
|
---
|
|
duration_ms: 678.7419
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid orphan result is rejected before archive or network preparation
|
|
ok 49 - invalid orphan result is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 508.5923
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid missing result is rejected before archive or network preparation
|
|
ok 50 - invalid missing result is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 691.1746
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid wrong result is rejected before archive or network preparation
|
|
ok 51 - invalid wrong result is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 654.7451
|
|
type: 'test'
|
|
...
|
|
# Subtest: invalid duplicate call is rejected before archive or network preparation
|
|
ok 52 - invalid duplicate call is rejected before archive or network preparation
|
|
---
|
|
duration_ms: 631.5505
|
|
type: 'test'
|
|
...
|
|
# Subtest: a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
|
|
ok 53 - a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
|
|
---
|
|
duration_ms: 1624.9381
|
|
type: 'test'
|
|
...
|
|
# Subtest: changed or missing archived evidence stops reuse and is never silently recreated
|
|
ok 54 - changed or missing archived evidence stops reuse and is never silently recreated
|
|
---
|
|
duration_ms: 844.8799
|
|
type: 'test'
|
|
...
|
|
# Subtest: transaction failure prevents publishing a plan and any corresponding model request
|
|
ok 55 - transaction failure prevents publishing a plan and any corresponding model request
|
|
---
|
|
duration_ms: 785.5128
|
|
type: 'test'
|
|
...
|
|
# Subtest: the Provider rejects body mutation after a sealed plan before calling HTTP
|
|
ok 56 - the Provider rejects body mutation after a sealed plan before calling HTTP
|
|
---
|
|
duration_ms: 577.3281
|
|
type: 'test'
|
|
...
|
|
# Subtest: HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
|
|
ok 57 - HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
|
|
---
|
|
duration_ms: 6600.8714
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real process exit after plan persistence marks interruption and never issues an automatic model request
|
|
ok 58 - a real process exit after plan persistence marks interruption and never issues an automatic model request
|
|
---
|
|
duration_ms: 1377.281
|
|
type: 'test'
|
|
...
|
|
# Subtest: deep Windows data directories keep REA output within the external path allowance and retain owned evidence
|
|
ok 59 - deep Windows data directories keep REA output within the external path allowance and retain owned evidence
|
|
---
|
|
duration_ms: 2716.8153
|
|
type: 'test'
|
|
...
|
|
# Subtest: user research registration creates an owned Task without model requests and seals the exact artifact identity
|
|
ok 60 - user research registration creates an owned Task without model requests and seals the exact artifact identity
|
|
---
|
|
duration_ms: 1055.5013
|
|
type: 'test'
|
|
...
|
|
# Subtest: complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
|
|
ok 61 - complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
|
|
---
|
|
duration_ms: 2389.244
|
|
type: 'test'
|
|
...
|
|
# Subtest: artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
|
|
ok 62 - artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
|
|
---
|
|
duration_ms: 3037.3021
|
|
type: 'test'
|
|
...
|
|
# Subtest: owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
|
|
ok 63 - owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
|
|
---
|
|
duration_ms: 2052.5522
|
|
type: 'test'
|
|
...
|
|
# Subtest: a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
|
|
ok 64 - a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
|
|
---
|
|
duration_ms: 1832.1506
|
|
type: 'test'
|
|
...
|
|
# Subtest: corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
|
|
ok 65 - corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
|
|
---
|
|
duration_ms: 2217.4646
|
|
type: 'test'
|
|
...
|
|
# Subtest: research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
|
|
ok 66 - research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
|
|
---
|
|
duration_ms: 1456.4266
|
|
type: 'test'
|
|
...
|
|
# Subtest: research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
|
|
ok 67 - research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
|
|
---
|
|
duration_ms: 6379.4887
|
|
type: 'test'
|
|
...
|
|
# Subtest: file identity rejects directory and invalid formats without running a target
|
|
ok 68 - file identity rejects directory and invalid formats without running a target
|
|
---
|
|
duration_ms: 513.0559
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop from the event loop interrupts immediate model replies before later tools
|
|
ok 69 - a stop from the event loop interrupts immediate model replies before later tools
|
|
---
|
|
duration_ms: 1872.9213
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
ok 70 - a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
---
|
|
duration_ms: 2479.6062
|
|
type: 'test'
|
|
...
|
|
# Subtest: the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
ok 71 - the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
---
|
|
duration_ms: 6259.9311
|
|
type: 'test'
|
|
...
|
|
# Subtest: denial prevents command execution and produces a paired denied result
|
|
ok 72 - denial prevents command execution and produces a paired denied result
|
|
---
|
|
duration_ms: 2182.6253
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping during approval interrupts pending calls without executing or replaying them
|
|
ok 73 - stopping during approval interrupts pending calls without executing or replaying them
|
|
---
|
|
duration_ms: 1839.6519
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
ok 74 - stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
---
|
|
duration_ms: 2322.6331
|
|
type: 'test'
|
|
...
|
|
# Subtest: command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
ok 75 - command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
---
|
|
duration_ms: 1104.1345
|
|
type: 'test'
|
|
...
|
|
# Subtest: model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
ok 76 - model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
---
|
|
duration_ms: 6.0918
|
|
type: 'test'
|
|
...
|
|
# Subtest: truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
ok 77 - truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
---
|
|
duration_ms: 2974.6685
|
|
type: 'test'
|
|
...
|
|
# Subtest: request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
ok 78 - request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
---
|
|
duration_ms: 1572.7617
|
|
type: 'test'
|
|
...
|
|
1..78
|
|
# tests 78
|
|
# suites 0
|
|
# pass 78
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 104409.0152
|