491 lines
20 KiB
Plaintext
491 lines
20 KiB
Plaintext
TAP version 13
|
|
# Subtest: the bundled local service enforces host, origin, token and JSON object contracts
|
|
ok 1 - the bundled local service enforces host, origin, token and JSON object contracts
|
|
---
|
|
duration_ms: 1140.4923
|
|
type: 'test'
|
|
...
|
|
# Subtest: an in-flight connection probe prevents configuration changes and another probe until its actual result returns
|
|
ok 2 - an in-flight connection probe prevents configuration changes and another probe until its actual result returns
|
|
---
|
|
duration_ms: 1150.652
|
|
type: 'test'
|
|
...
|
|
# Subtest: API review applies verified content, detects conflicts, exports sessions and keeps keys in memory
|
|
ok 3 - API review applies verified content, detects conflicts, exports sessions and keeps keys in memory
|
|
---
|
|
duration_ms: 2027.8642
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real bundle restart preserves proposals, interrupts old approvals and requests fresh consent on resume
|
|
ok 4 - a real bundle restart preserves proposals, interrupts old approvals and requests fresh consent on resume
|
|
---
|
|
duration_ms: 7285.0082
|
|
type: 'test'
|
|
...
|
|
# Subtest: runtime diagnostics and model-response validation use actual records and preserve the saved connection
|
|
ok 5 - runtime diagnostics and model-response validation use actual records and preserve the saved connection
|
|
---
|
|
duration_ms: 1269.4122
|
|
type: 'test'
|
|
...
|
|
# Subtest: persistent event replay is read-only and keeps run/artifact identity across reconnects
|
|
ok 6 - persistent event replay is read-only and keeps run/artifact identity across reconnects
|
|
---
|
|
duration_ms: 6534.977
|
|
type: 'test'
|
|
...
|
|
# Subtest: engineering inspection preserves a dirty Git baseline and treats project rules as data
|
|
ok 7 - engineering inspection preserves a dirty Git baseline and treats project rules as data
|
|
---
|
|
duration_ms: 2489.6531
|
|
type: 'test'
|
|
...
|
|
# Subtest: real npm tests and build produce counted results, log artifacts and persistent verification
|
|
ok 8 - real npm tests and build produce counted results, log artifacts and persistent verification
|
|
---
|
|
duration_ms: 2266.4572
|
|
type: 'test'
|
|
...
|
|
# Subtest: an actual failing test retains the nonzero exit code and failed count
|
|
ok 9 - an actual failing test retains the nonzero exit code and failed count
|
|
---
|
|
duration_ms: 2121.7752
|
|
type: 'test'
|
|
...
|
|
# Subtest: zero tests, skipped tests and unrecognized stdout cannot become verification passes
|
|
ok 10 - zero tests, skipped tests and unrecognized stdout cannot become verification passes
|
|
---
|
|
duration_ms: 7113.8357
|
|
type: 'test'
|
|
...
|
|
# Subtest: a successful build with no selected tests does not verify the task
|
|
ok 11 - a successful build with no selected tests does not verify the task
|
|
---
|
|
duration_ms: 1743.1807
|
|
type: 'test'
|
|
...
|
|
# Subtest: stale check plans and forged script names execute no project commands
|
|
ok 12 - stale check plans and forged script names execute no project commands
|
|
---
|
|
duration_ms: 1443.4315
|
|
type: 'test'
|
|
...
|
|
# Subtest: applying a later proposal invalidates the prior passed engineering snapshot
|
|
ok 13 - applying a later proposal invalidates the prior passed engineering snapshot
|
|
---
|
|
duration_ms: 2744.2162
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping an actual check terminates its child process and blocks concurrent jobs
|
|
ok 14 - stopping an actual check terminates its child process and blocks concurrent jobs
|
|
---
|
|
duration_ms: 1834.6345
|
|
type: 'test'
|
|
...
|
|
# Subtest: check timeout records a failure with its actual termination result
|
|
ok 15 - check timeout records a failure with its actual termination result
|
|
---
|
|
duration_ms: 2097.9352
|
|
type: 'test'
|
|
...
|
|
# Subtest: source edits during a successful check make the result stale
|
|
ok 16 - source edits during a successful check make the result stale
|
|
---
|
|
duration_ms: 3248.9389
|
|
type: 'test'
|
|
...
|
|
# Subtest: bounded large logs retain the test footer and readable artifact instead of inventing counts
|
|
ok 17 - bounded large logs retain the test footer and readable artifact instead of inventing counts
|
|
---
|
|
duration_ms: 2239.0116
|
|
type: 'test'
|
|
...
|
|
# Subtest: model-selected checks require a run-bound decision and denial creates no check job
|
|
ok 18 - model-selected checks require a run-bound decision and denial creates no check job
|
|
---
|
|
duration_ms: 3607.9929
|
|
type: 'test'
|
|
...
|
|
# Subtest: check APIs expose owned plans and jobs and preserve the authoritative results across restart
|
|
ok 19 - check APIs expose owned plans and jobs and preserve the authoritative results across restart
|
|
---
|
|
duration_ms: 4102.6016
|
|
type: 'test'
|
|
...
|
|
# Subtest: reviewed changes continue the original task without reopening a generic completed run
|
|
ok 20 - reviewed changes continue the original task without reopening a generic completed run
|
|
---
|
|
duration_ms: 3861.4867
|
|
type: 'test'
|
|
...
|
|
# Subtest: concurrent review-continuation API requests accept one run and retain the goal after restart
|
|
ok 21 - concurrent review-continuation API requests accept one run and retain the goal after restart
|
|
---
|
|
duration_ms: 7416.1113
|
|
type: 'test'
|
|
...
|
|
# Subtest: the model reads owned failure logs without running the check again
|
|
ok 22 - the model reads owned failure logs without running the check again
|
|
---
|
|
duration_ms: 4454.8987
|
|
type: 'test'
|
|
...
|
|
# Subtest: process exit at check queued preserves results and never replays commands
|
|
ok 23 - process exit at check queued preserves results and never replays commands
|
|
---
|
|
duration_ms: 1548.6213
|
|
type: 'test'
|
|
...
|
|
# Subtest: process exit at check result_committed preserves results and never replays commands
|
|
ok 24 - process exit at check result_committed preserves results and never replays commands
|
|
---
|
|
duration_ms: 2832.095
|
|
type: 'test'
|
|
...
|
|
# Subtest: model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
|
|
ok 25 - model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
|
|
---
|
|
duration_ms: 4625.6807
|
|
type: 'test'
|
|
...
|
|
# Subtest: bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
|
|
ok 26 - bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
|
|
---
|
|
duration_ms: 2189.429
|
|
type: 'test'
|
|
...
|
|
# Subtest: code tool arguments reject malformed ownership-independent inputs before side effects
|
|
ok 27 - code tool arguments reject malformed ownership-independent inputs before side effects
|
|
---
|
|
duration_ms: 0.4268
|
|
type: 'test'
|
|
...
|
|
# Subtest: proposals preserve project bytes until review; apply backs up the exact original bytes
|
|
ok 28 - proposals preserve project bytes until review; apply backs up the exact original bytes
|
|
---
|
|
duration_ms: 861.7613
|
|
type: 'test'
|
|
...
|
|
# Subtest: new nested files are created only on apply and unchanged content creates no proposal
|
|
ok 29 - new nested files are created only on apply and unchanged content creates no proposal
|
|
---
|
|
duration_ms: 1087.478
|
|
type: 'test'
|
|
...
|
|
# Subtest: stale reads and changed baselines are rejected without overwriting external edits
|
|
ok 30 - stale reads and changed baselines are rejected without overwriting external edits
|
|
---
|
|
duration_ms: 746.7513
|
|
type: 'test'
|
|
...
|
|
# Subtest: file paths reject traversal, absolute paths, credentials and outside junctions
|
|
ok 31 - file paths reject traversal, absolute paths, credentials and outside junctions
|
|
---
|
|
duration_ms: 699.1052
|
|
type: 'test'
|
|
...
|
|
# Subtest: read and search expose bounded text scopes and reject non UTF-8 / oversized files
|
|
ok 32 - read and search expose bounded text scopes and reject non UTF-8 / oversized files
|
|
---
|
|
duration_ms: 812.157
|
|
type: 'test'
|
|
...
|
|
# Subtest: project-local junctions cannot expose or create protected Git and credential files
|
|
ok 33 - project-local junctions cannot expose or create protected Git and credential files
|
|
---
|
|
duration_ms: 804.7499
|
|
type: 'test'
|
|
...
|
|
# Subtest: Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
|
|
ok 34 - Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
|
|
---
|
|
duration_ms: 796.5457
|
|
type: 'test'
|
|
...
|
|
# Subtest: model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
|
|
ok 35 - model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
|
|
---
|
|
duration_ms: 1482.7296
|
|
type: 'test'
|
|
...
|
|
# Subtest: config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
|
|
ok 36 - config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
|
|
---
|
|
duration_ms: 1057.5669
|
|
type: 'test'
|
|
...
|
|
# Subtest: real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
|
|
ok 37 - real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
|
|
---
|
|
duration_ms: 2746.5494
|
|
type: 'test'
|
|
...
|
|
# Subtest: pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
|
|
ok 38 - pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
|
|
---
|
|
duration_ms: 6161.3018
|
|
type: 'test'
|
|
...
|
|
# Subtest: 401 blocks the credential revision; updating the key restores availability without leaking error echoes
|
|
ok 39 - 401 blocks the credential revision; updating the key restores availability without leaking error echoes
|
|
---
|
|
duration_ms: 2059.4583
|
|
type: 'test'
|
|
...
|
|
# Subtest: queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
|
|
ok 40 - queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
|
|
---
|
|
duration_ms: 1265.7207
|
|
type: 'test'
|
|
...
|
|
# Subtest: compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
|
|
ok 41 - compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
|
|
---
|
|
duration_ms: 1422.0311
|
|
type: 'test'
|
|
...
|
|
# Subtest: model registry disk failures restore routing, pool profiles and credential references without partial updates
|
|
ok 42 - model registry disk failures restore routing, pool profiles and credential references without partial updates
|
|
---
|
|
duration_ms: 1023.5952
|
|
type: 'test'
|
|
...
|
|
# Subtest: model selection and saved configuration commit together and failures preserve the original mode and endpoint
|
|
ok 43 - model selection and saved configuration commit together and failures preserve the original mode and endpoint
|
|
---
|
|
duration_ms: 1023.7873
|
|
type: 'test'
|
|
...
|
|
# Subtest: configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
|
|
ok 44 - configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
|
|
---
|
|
duration_ms: 683.1714
|
|
type: 'test'
|
|
...
|
|
# Subtest: exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
|
|
ok 45 - exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
|
|
---
|
|
duration_ms: 855.5786
|
|
type: 'test'
|
|
...
|
|
# Subtest: several patches are matched against one original snapshot in any input order and keep LF
|
|
ok 46 - several patches are matched against one original snapshot in any input order and keep LF
|
|
---
|
|
duration_ms: 914.334
|
|
type: 'test'
|
|
...
|
|
# Subtest: mixed line endings require exact anchors and preserve untouched formatting
|
|
ok 47 - mixed line endings require exact anchors and preserve untouched formatting
|
|
---
|
|
duration_ms: 802.8502
|
|
type: 'test'
|
|
...
|
|
# Subtest: ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
|
|
ok 48 - ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
|
|
---
|
|
duration_ms: 973.8542
|
|
type: 'test'
|
|
...
|
|
# Subtest: stale original hashes and changes before apply preserve owner edits and mark conflicts
|
|
ok 49 - stale original hashes and changes before apply preserve owner edits and mark conflicts
|
|
---
|
|
duration_ms: 1050.0935
|
|
type: 'test'
|
|
...
|
|
# Subtest: no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
|
|
ok 50 - no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
|
|
---
|
|
duration_ms: 675.0859
|
|
type: 'test'
|
|
...
|
|
# Subtest: an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
|
|
ok 51 - an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
|
|
---
|
|
duration_ms: 1124.9693
|
|
type: 'test'
|
|
...
|
|
# Subtest: real npm tests and build do not inherit arbitrary host credentials or Node injection settings
|
|
ok 52 - real npm tests and build do not inherit arbitrary host credentials or Node injection settings
|
|
---
|
|
duration_ms: 2274.3652
|
|
type: 'test'
|
|
...
|
|
# Subtest: real Python tests and compilation keep their sealed inputs without host credentials
|
|
ok 53 - real Python tests and compilation keep their sealed inputs without host credentials
|
|
---
|
|
duration_ms: 2404.7429
|
|
type: 'test'
|
|
...
|
|
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
|
|
ok 54 - Python static inspection does not import project code or probe a project interpreter before approval
|
|
---
|
|
duration_ms: 1216.2853
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
|
|
ok 55 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
|
|
---
|
|
duration_ms: 4902.4376
|
|
type: 'test'
|
|
...
|
|
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
|
|
ok 56 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
|
|
---
|
|
duration_ms: 3427.6883
|
|
type: 'test'
|
|
...
|
|
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
|
|
ok 57 - unittest empty, skipped, expected failure and class initialization errors never verify a task
|
|
---
|
|
duration_ms: 8458.5265
|
|
type: 'test'
|
|
...
|
|
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
|
|
ok 58 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
|
|
---
|
|
duration_ms: 3386.228
|
|
type: 'test'
|
|
...
|
|
# Subtest: compilation reads actual Python source bytes without executing top-level project code
|
|
ok 59 - compilation reads actual Python source bytes without executing top-level project code
|
|
---
|
|
duration_ms: 3085.9532
|
|
type: 'test'
|
|
...
|
|
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
|
|
ok 60 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
|
|
---
|
|
duration_ms: 2593.428
|
|
type: 'test'
|
|
...
|
|
# Subtest: changed project interpreters and forged Python plan bindings execute no check
|
|
ok 61 - changed project interpreters and forged Python plan bindings execute no check
|
|
---
|
|
duration_ms: 1784.3921
|
|
type: 'test'
|
|
...
|
|
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
|
|
ok 62 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
|
|
---
|
|
duration_ms: 1434.1686
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
|
|
ok 63 - stopping a real Python check terminates its child and keeps the completed result as cancelled
|
|
---
|
|
duration_ms: 2354.4609
|
|
type: 'test'
|
|
...
|
|
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
|
|
ok 64 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
|
|
---
|
|
duration_ms: 13021.3619
|
|
type: 'test'
|
|
...
|
|
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
|
|
ok 65 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
|
|
---
|
|
duration_ms: 5243.031
|
|
type: 'test'
|
|
...
|
|
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
|
|
ok 66 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
|
|
---
|
|
duration_ms: 2624.9358
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop from the event loop interrupts immediate model replies before later tools
|
|
ok 67 - a stop from the event loop interrupts immediate model replies before later tools
|
|
---
|
|
duration_ms: 1907.2383
|
|
type: 'test'
|
|
...
|
|
# Subtest: a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
ok 68 - a stop after the first tool preserves a complete interrupted multi-call protocol group
|
|
---
|
|
duration_ms: 1833.902
|
|
type: 'test'
|
|
...
|
|
# Subtest: the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
ok 69 - the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
|
|
---
|
|
duration_ms: 5221.645
|
|
type: 'test'
|
|
...
|
|
# Subtest: denial prevents command execution and produces a paired denied result
|
|
ok 70 - denial prevents command execution and produces a paired denied result
|
|
---
|
|
duration_ms: 1901.2261
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping during approval interrupts pending calls without executing or replaying them
|
|
ok 71 - stopping during approval interrupts pending calls without executing or replaying them
|
|
---
|
|
duration_ms: 1527.4161
|
|
type: 'test'
|
|
...
|
|
# Subtest: stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
ok 72 - stopping a running fixture command terminates its own process tree and retains uncertain state
|
|
---
|
|
duration_ms: 2435.5711
|
|
type: 'test'
|
|
...
|
|
# Subtest: command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
ok 73 - command output decodes split UTF-8 and excludes the workbench key from child environment
|
|
---
|
|
duration_ms: 1223.7402
|
|
type: 'test'
|
|
...
|
|
# Subtest: model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
ok 74 - model-list testing uses a tentative key without changing the saved connection and redacts service errors
|
|
---
|
|
duration_ms: 6.7258
|
|
type: 'test'
|
|
...
|
|
# Subtest: truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
ok 75 - truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
|
|
---
|
|
duration_ms: 2285.6172
|
|
type: 'test'
|
|
...
|
|
# Subtest: request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
ok 76 - request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
|
|
---
|
|
duration_ms: 1324.0526
|
|
type: 'test'
|
|
...
|
|
# Subtest: hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
|
|
ok 77 - hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
|
|
---
|
|
duration_ms: 745.7607
|
|
type: 'test'
|
|
...
|
|
# Subtest: hot upgrade refuses active probes and restores retained model methods if installation fails
|
|
ok 78 - hot upgrade refuses active probes and restores retained model methods if installation fails
|
|
---
|
|
duration_ms: 694.9354
|
|
type: 'test'
|
|
...
|
|
# Subtest: a directly started compiled host upgrades twice with the same PID, sessions, applied bytes and volatile provider
|
|
ok 79 - a directly started compiled host upgrades twice with the same PID, sessions, applied bytes and volatile provider
|
|
---
|
|
duration_ms: 2795.3936
|
|
type: 'test'
|
|
...
|
|
# Subtest: the running 0.1.0 process upgrades in place and retains its project, session, files and volatile model connection
|
|
ok 80 - the running 0.1.0 process upgrades in place and retains its project, session, files and volatile model connection
|
|
---
|
|
duration_ms: 9319.3218
|
|
type: 'test'
|
|
...
|
|
1..80
|
|
# tests 80
|
|
# suites 0
|
|
# pass 80
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 110897.8839
|