Files
Agent-Workbench/docs/reproducible-env-release-evidence/source/tests-02.tap
T

572 lines
24 KiB
Plaintext

TAP version 13
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'src/two.mjs', LF will be replaced by CRLF the next time Git touches it
# Subtest: sealed batches preserve bytes until review, then apply and explicitly restore BOM/CRLF/new files
ok 1 - sealed batches preserve bytes until review, then apply and explicitly restore BOM/CRLF/new files
---
duration_ms: 2662.0959
type: 'test'
...
# Switched to a new branch 'owner-branch'
# Subtest: a conflict in the last file or Git branch prevents writing every file in the batch
ok 2 - a conflict in the last file or Git branch prevents writing every file in the batch
---
duration_ms: 3642.2879
type: 'test'
...
# Subtest: duplicate canonical paths, ancestor collisions, links, dependencies and Windows aliases never form a batch
ok 3 - duplicate canonical paths, ancestor collisions, links, dependencies and Windows aliases never form a batch
---
duration_ms: 1337.8821
type: 'test'
...
# Subtest: fingerprints, changed proposals and corrupt snapshot artifacts cannot write or restore any target
ok 4 - fingerprints, changed proposals and corrupt snapshot artifacts cannot write or restore any target
---
duration_ms: 2250.0299
type: 'test'
...
# Subtest: a failure after replacement restores only batch bytes and never retries an old application
ok 5 - a failure after replacement restores only batch bytes and never retries an old application
---
duration_ms: 1565.8353
type: 'test'
...
# Subtest: rollback preserves owner edits, blocks other project writers, and explicit acknowledgement releases recovery
ok 6 - rollback preserves owner edits, blocks other project writers, and explicit acknowledgement releases recovery
---
duration_ms: 2119.0759
type: 'test'
...
# Subtest: an unattempted owner-created file identical to a suggestion remains external and is never removed
ok 7 - an unattempted owner-created file identical to a suggestion remains external and is never removed
---
duration_ms: 1811.783
type: 'test'
...
# Subtest: active batch requests are serialized and cancellation leaves a verifiable ended batch
ok 8 - active batch requests are serialized and cancellation leaves a verifiable ended batch
---
duration_ms: 1386.1308
type: 'test'
...
# Subtest: batch application and rollback preserve unrelated Git index and worktree bytes
ok 9 - batch application and rollback preserve unrelated Git index and worktree bytes
---
duration_ms: 3666.1371
type: 'test'
...
# Subtest: recovery reuses exact staged bytes but retains a conflicting temporary file for owner inspection
ok 10 - recovery reuses exact staged bytes but retains a conflicting temporary file for owner inspection
---
duration_ms: 2874.1122
type: 'test'
...
# Subtest: one Task can seal pending proposals from earlier Runs while snapshots retain each source Run
ok 11 - one Task can seal pending proposals from earlier Runs while snapshots retain each source Run
---
duration_ms: 2127.1305
type: 'test'
...
# Subtest: engineering inspection preserves a dirty Git baseline and treats project rules as data
ok 12 - engineering inspection preserves a dirty Git baseline and treats project rules as data
---
duration_ms: 2792.2616
type: 'test'
...
# Subtest: real npm tests and build produce counted results, log artifacts and persistent verification
ok 13 - real npm tests and build produce counted results, log artifacts and persistent verification
---
duration_ms: 2936.6106
type: 'test'
...
# Subtest: an actual failing test retains the nonzero exit code and failed count
ok 14 - an actual failing test retains the nonzero exit code and failed count
---
duration_ms: 2415.5405
type: 'test'
...
# Subtest: unchanged automatic checks return original failure evidence, while explicit user reruns and changed source still execute
ok 15 - unchanged automatic checks return original failure evidence, while explicit user reruns and changed source still execute
---
duration_ms: 4605.5965
type: 'test'
...
# Subtest: agent loops cannot hide identical failing checks behind new plan IDs or unrelated reads
ok 16 - agent loops cannot hide identical failing checks behind new plan IDs or unrelated reads
---
duration_ms: 9236.5695
type: 'test'
...
# Subtest: zero tests, skipped tests and unrecognized stdout cannot become verification passes
ok 17 - zero tests, skipped tests and unrecognized stdout cannot become verification passes
---
duration_ms: 8776.8585
type: 'test'
...
# Subtest: a successful build with no selected tests does not verify the task
ok 18 - a successful build with no selected tests does not verify the task
---
duration_ms: 2236.3746
type: 'test'
...
# Subtest: stale check plans and forged script names execute no project commands
ok 19 - stale check plans and forged script names execute no project commands
---
duration_ms: 1308.4404
type: 'test'
...
# Subtest: applying a later proposal invalidates the prior passed engineering snapshot
ok 20 - applying a later proposal invalidates the prior passed engineering snapshot
---
duration_ms: 2965.4742
type: 'test'
...
# Subtest: stopping an actual check terminates its child process and blocks concurrent jobs
ok 21 - stopping an actual check terminates its child process and blocks concurrent jobs
---
duration_ms: 2509.2194
type: 'test'
...
# Subtest: check timeout records a failure with its actual termination result
ok 22 - check timeout records a failure with its actual termination result
---
duration_ms: 3049.0347
type: 'test'
...
# Subtest: source edits during a successful check make the result stale
ok 23 - source edits during a successful check make the result stale
---
duration_ms: 3422.796
type: 'test'
...
# Subtest: bounded large logs retain the test footer and readable artifact instead of inventing counts
ok 24 - bounded large logs retain the test footer and readable artifact instead of inventing counts
---
duration_ms: 2255.0116
type: 'test'
...
# Subtest: model-selected checks require a run-bound decision and denial creates no check job
ok 25 - model-selected checks require a run-bound decision and denial creates no check job
---
duration_ms: 3939.2995
type: 'test'
...
# Subtest: check APIs expose owned plans and jobs and preserve the authoritative results across restart
ok 26 - check APIs expose owned plans and jobs and preserve the authoritative results across restart
---
duration_ms: 6483.3179
type: 'test'
...
# Subtest: reviewed changes continue the original task without reopening a generic completed run
ok 27 - reviewed changes continue the original task without reopening a generic completed run
---
duration_ms: 2866.6981
type: 'test'
...
# Subtest: concurrent review-continuation API requests accept one run and retain the goal after restart
ok 28 - concurrent review-continuation API requests accept one run and retain the goal after restart
---
duration_ms: 11041.5089
type: 'test'
...
# Subtest: the model reads owned failure logs without running the check again
ok 29 - the model reads owned failure logs without running the check again
---
duration_ms: 4130.4864
type: 'test'
...
# Subtest: process exit at check queued preserves results and never replays commands
ok 30 - process exit at check queued preserves results and never replays commands
---
duration_ms: 1915.1744
type: 'test'
...
# Subtest: process exit at check result_committed preserves results and never replays commands
ok 31 - process exit at check result_committed preserves results and never replays commands
---
duration_ms: 1946.7068
type: 'test'
...
# Subtest: model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
ok 32 - model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
---
duration_ms: 5803.3382
type: 'test'
...
# Subtest: bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
ok 33 - bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
---
duration_ms: 3094.3993
type: 'test'
...
# Subtest: code tool arguments reject malformed ownership-independent inputs before side effects
ok 34 - code tool arguments reject malformed ownership-independent inputs before side effects
---
duration_ms: 0.2806
type: 'test'
...
# Subtest: observe-only device authority cannot read, configure or clear project parsing caches
ok 35 - observe-only device authority cannot read, configure or clear project parsing caches
---
duration_ms: 951.029
type: 'test'
...
# Subtest: pairing is short lived, single-use, generation-bound and validates exact permissions
ok 36 - pairing is short lived, single-use, generation-bound and validates exact permissions
---
duration_ms: 646.3317
type: 'test'
...
# Subtest: device transaction failure neither consumes the ticket nor leaves a credential
ok 37 - device transaction failure neither consumes the ticket nor leaves a credential
---
duration_ms: 912.1864
type: 'test'
...
# Subtest: devices have project and action boundaries; rotation, expiration, revocation and host changes reject old authority
ok 38 - devices have project and action boundaries; rotation, expiration, revocation and host changes reject old authority
---
duration_ms: 1161.5822
type: 'test'
...
# Subtest: persistent registry stores hashes and a bounded audit, never raw credentials
ok 39 - persistent registry stores hashes and a bounded audit, never raw credentials
---
duration_ms: 866.1901
type: 'test'
...
# Subtest: real TLS verifies IP SAN, CA chain, encrypted restart and public fingerprint
ok 40 - real TLS verifies IP SAN, CA chain, encrypted restart and public fingerprint
---
duration_ms: 1078.8355
type: 'test'
...
# Subtest: TLS sealing failure leaves listener closed and no plaintext or successful TLS registration
ok 41 - TLS sealing failure leaves listener closed and no plaintext or successful TLS registration
---
duration_ms: 1029.5483
type: 'test'
...
# Subtest: HTTP pairing is concurrent single-use; secure cookie and strict origin/host checks
ok 42 - HTTP pairing is concurrent single-use; secure cookie and strict origin/host checks
---
duration_ms: 999.0403
type: 'test'
...
# Subtest: gateway never exposes management routes, arbitrary assets or unpaired project data
ok 43 - gateway never exposes management routes, arbitrary assets or unpaired project data
---
duration_ms: 1134.9066
type: 'test'
...
# Subtest: authorized project events paginate from original seq without leaking other project events or payloads
ok 44 - authorized project events paginate from original seq without leaking other project events or payloads
---
duration_ms: 1653.7674
type: 'test'
...
# Subtest: remote task projection excludes raw model history, host configuration, tool input and credentials
ok 45 - remote task projection excludes raw model history, host configuration, tool input and credentials
---
duration_ms: 793.7678
type: 'test'
...
# Subtest: permission checks apply to direct remote mutation, not only UI controls
ok 46 - permission checks apply to direct remote mutation, not only UI controls
---
duration_ms: 1207.2802
type: 'test'
...
# Subtest: approval fingerprint and exact task/revision are bound; duplicate requests never execute twice
ok 47 - approval fingerprint and exact task/revision are bound; duplicate requests never execute twice
---
duration_ms: 1149.0551
type: 'test'
...
# Subtest: unknown original operation is recorded and never replayed after response failure
ok 48 - unknown original operation is recorded and never replayed after response failure
---
duration_ms: 1220.1044
type: 'test'
...
# Subtest: revocation and gateway closure reject old access without invoking runtime stop
ok 49 - revocation and gateway closure reject old access without invoking runtime stop
---
duration_ms: 1263.1358
type: 'test'
...
# Subtest: rate limits reject pairing brute force and do not persist candidate secrets
ok 50 - rate limits reject pairing brute force and do not persist candidate secrets
---
duration_ms: 999.4814
type: 'test'
...
# Subtest: real Windows CurrentUser DPAPI persists only a sealed CA and reopens it
ok 51 - real Windows CurrentUser DPAPI persists only a sealed CA and reopens it
---
duration_ms: 1815.4329
type: 'test'
...
# Subtest: mobile approval executes the original Runtime command exactly once and rejects the later desktop decision
ok 52 - mobile approval executes the original Runtime command exactly once and rejects the later desktop decision
---
duration_ms: 2295.3894
type: 'test'
...
# Subtest: desktop rejection wins a concurrent mobile request and original command remains unexecuted
ok 53 - desktop rejection wins a concurrent mobile request and original command remains unexecuted
---
duration_ms: 1937.6849
type: 'test'
...
# Subtest: phone stop waits for the original process exit and prevents later heartbeats and command replay
ok 54 - phone stop waits for the original process exit and prevents later heartbeats and command replay
---
duration_ms: 2946.0563
type: 'test'
...
# Subtest: Run replacement during parent-stop wait is rejected rather than stopping the new Run
ok 55 - Run replacement during parent-stop wait is rejected rather than stopping the new Run
---
duration_ms: 944.7421
type: 'test'
...
# Subtest: diff pages preserve source SHA; report reads verify blobs and exclude unrelated artifact kinds
ok 56 - diff pages preserve source SHA; report reads verify blobs and exclude unrelated artifact kinds
---
duration_ms: 1598.3206
type: 'test'
...
# Subtest: hot upgrade refuses an active gateway and restores closed gateway ownership on failure
ok 57 - hot upgrade refuses an active gateway and restores closed gateway ownership on failure
---
duration_ms: 535.4424
type: 'test'
...
# Subtest: damaged device permissions or expiry fail closed and never overwrite the original registry
ok 58 - damaged device permissions or expiry fail closed and never overwrite the original registry
---
duration_ms: 1032.1223
type: 'test'
...
# Subtest: device revocation destroys its actual authenticated TLS connection
ok 59 - device revocation destroys its actual authenticated TLS connection
---
duration_ms: 1230.3981
type: 'test'
...
# Subtest: companion observes only current Task screenshots, verifies original PNG bytes and loses access immediately on revoke
ok 60 - companion observes only current Task screenshots, verifies original PNG bytes and loses access immediately on revoke
---
duration_ms: 1537.5172
type: 'test'
...
# Subtest: actual config HTTP failure preserves the committed selection, config and volatile credential before a successful retry
ok 61 - actual config HTTP failure preserves the committed selection, config and volatile credential before a successful retry
---
duration_ms: 1475.4364
type: 'test'
...
# Subtest: controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
ok 62 - controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
---
duration_ms: 1149.3896
type: 'test'
...
# Subtest: controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
ok 63 - controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
---
duration_ms: 0.757
type: 'test'
...
# Subtest: owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
ok 64 - owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
---
duration_ms: 4.9989
type: 'test'
...
# Subtest: bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
ok 65 - bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
---
duration_ms: 643.9075
type: 'test'
...
# Subtest: bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
ok 66 - bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
---
duration_ms: 679.5795
type: 'test'
...
# Subtest: bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
ok 67 - bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
---
duration_ms: 763.9931
type: 'test'
...
# Subtest: stopped and oversized bridge requests never reach a local model or tool callback
ok 68 - stopped and oversized bridge requests never reach a local model or tool callback
---
duration_ms: 1124.1736
type: 'test'
...
# Subtest: a Windows virtual data-directory name binds new storage and credentials to its actual physical root
ok 69 - a Windows virtual data-directory name binds new storage and credentials to its actual physical root
---
duration_ms: 2243.2863
type: 'test'
...
# Subtest: physical data-root adoption still rejects explicit junctions at the directory or any ancestor
ok 70 - physical data-root adoption still rejects explicit junctions at the directory or any ancestor
---
duration_ms: 823.1979
type: 'test'
...
# Subtest: actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy
ok 71 - actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy
---
duration_ms: 1237.8702
type: 'test'
...
# Subtest: only explicitly supplied keys persist; new provider restores original revisions and public views contain no key
ok 72 - only explicitly supplied keys persist; new provider restores original revisions and public views contain no key
---
duration_ms: 2731.8219
type: 'test'
...
# Subtest: registry and cipher commit failure restores original routing, keys, block and every database row
ok 73 - registry and cipher commit failure restores original routing, keys, block and every database row
---
duration_ms: 1862.239
type: 'test'
...
# Subtest: a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview
ok 74 - a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview
---
duration_ms: 2329.2207
type: 'test'
...
# Subtest: connection revision changes retain the original saved block and report a source mismatch on restart
ok 75 - connection revision changes retain the original saved block and report a source mismatch on restart
---
duration_ms: 2607.2014
type: 'test'
...
# Subtest: disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both
ok 76 - disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both
---
duration_ms: 2812.2348
type: 'test'
...
# Subtest: corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext
ok 77 - corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext
---
duration_ms: 3148.5443
type: 'test'
...
# Subtest: legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save
ok 78 - legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save
---
duration_ms: 2744.5067
type: 'test'
...
# Subtest: owned plaintext keys never reach SQLite pages, WAL, config or public execution exports
ok 79 - owned plaintext keys never reach SQLite pages, WAL, config or public execution exports
---
duration_ms: 1674.08
type: 'test'
...
# Subtest: actual process exit at Git queued never replays a commit and can reconcile the durable result
ok 80 - actual process exit at Git queued never replays a commit and can reconcile the durable result
---
duration_ms: 13819.971
type: 'test'
...
# Subtest: actual process exit at Git preparing never replays a commit and can reconcile the durable result
ok 81 - actual process exit at Git preparing never replays a commit and can reconcile the durable result
---
duration_ms: 13328.7424
type: 'test'
...
# Subtest: actual process exit at Git index_locked never replays a commit and can reconcile the durable result
ok 82 - actual process exit at Git index_locked never replays a commit and can reconcile the durable result
---
duration_ms: 12336.4969
type: 'test'
...
# Subtest: actual process exit at Git prepared never replays a commit and can reconcile the durable result
ok 83 - actual process exit at Git prepared never replays a commit and can reconcile the durable result
---
duration_ms: 13591.2101
type: 'test'
...
# Subtest: actual process exit at Git ref_prepared never replays a commit and can reconcile the durable result
ok 84 - actual process exit at Git ref_prepared never replays a commit and can reconcile the durable result
---
duration_ms: 14210.4831
type: 'test'
...
# Subtest: actual process exit at Git publishing never replays a commit and can reconcile the durable result
ok 85 - actual process exit at Git publishing never replays a commit and can reconcile the durable result
---
duration_ms: 13764.1504
type: 'test'
...
# Subtest: actual process exit at Git committed never replays a commit and can reconcile the durable result
ok 86 - actual process exit at Git committed never replays a commit and can reconcile the durable result
---
duration_ms: 10007.3473
type: 'test'
...
# Subtest: actual process exit at Git index_published never replays a commit and can reconcile the durable result
ok 87 - actual process exit at Git index_published never replays a commit and can reconcile the durable result
---
duration_ms: 10242.1088
type: 'test'
...
# Subtest: actual process exit at Git finished never replays a commit and can reconcile the durable result
ok 88 - actual process exit at Git finished never replays a commit and can reconcile the durable result
---
duration_ms: 10200.8709
type: 'test'
...
# Subtest: an unknown Git result cannot overwrite an externally changed index or delete an unrelated lock
ok 89 - an unknown Git result cannot overwrite an externally changed index or delete an unrelated lock
---
duration_ms: 9567.873
type: 'test'
...
# Subtest: known publication with a later source edit retains the commit and marks the delivery for inspection
ok 90 - known publication with a later source edit retains the commit and marks the delivery for inspection
---
duration_ms: 9849.1959
type: 'test'
...
# Subtest: CRLF normalization, multiple applied revisions and unrelated special index flags preserve exact bytes and ownership
ok 91 - CRLF normalization, multiple applied revisions and unrelated special index flags preserve exact bytes and ownership
---
duration_ms: 10874.2522
type: 'test'
...
# Subtest: adding new durable record kinds to an existing hot Store preserves all existing Maps and records
ok 92 - adding new durable record kinds to an existing hot Store preserves all existing Maps and records
---
duration_ms: 7993.4287
type: 'test'
...
# Subtest: an unrelated owner deletion is fingerprinted and preserved while linked task paths are rejected
ok 93 - an unrelated owner deletion is fingerprinted and preserved while linked task paths are rejected
---
duration_ms: 15437.9734
type: 'test'
...
1..93
# tests 93
# suites 0
# pass 93
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 246328.7613