Files
Agent-Workbench/docs/engineering-evals-f-release-evidence/0233-tests.tap
T
2026-11-01 12:31:20 +08:00

3649 lines
160 KiB
Plaintext

TAP version 13
# Subtest: the bundled local service enforces host, origin, token and JSON object contracts
ok 1 - the bundled local service enforces host, origin, token and JSON object contracts
---
duration_ms: 2053.0322
type: 'test'
...
# Subtest: an in-flight connection probe prevents configuration changes and another probe until its actual result returns
ok 2 - an in-flight connection probe prevents configuration changes and another probe until its actual result returns
---
duration_ms: 2204.3678
type: 'test'
...
# Subtest: API review applies verified content, detects conflicts, exports sessions and keeps keys in memory
ok 3 - API review applies verified content, detects conflicts, exports sessions and keeps keys in memory
---
duration_ms: 4090.3429
type: 'test'
...
# Subtest: a real bundle restart preserves proposals, interrupts old approvals and requests fresh consent on resume
ok 4 - a real bundle restart preserves proposals, interrupts old approvals and requests fresh consent on resume
---
duration_ms: 9456.6156
type: 'test'
...
# Subtest: runtime diagnostics and model-response validation use actual records and preserve the saved connection
ok 5 - runtime diagnostics and model-response validation use actual records and preserve the saved connection
---
duration_ms: 2197.9256
type: 'test'
...
# Subtest: persistent event replay is read-only and keeps run/artifact identity across reconnects
ok 6 - persistent event replay is read-only and keeps run/artifact identity across reconnects
---
duration_ms: 5673.26
type: 'test'
...
# Subtest: real browser HTTP plans, original field pages and PNG bytes preserve ownership and survive host restart
ok 7 - real browser HTTP plans, original field pages and PNG bytes preserve ownership and survive host restart
---
duration_ms: 7237.4593
type: 'test'
...
# Subtest: self harness browser tools require approval and feed verified actual page fields back to the original Task
ok 8 - self harness browser tools require approval and feed verified actual page fields back to the original Task
---
duration_ms: 10216.0183
type: 'test'
...
# Subtest: browser host recovery retains unknown root outcome, blocks replay, and requires an explicit owned acknowledgement
ok 9 - browser host recovery retains unknown root outcome, blocks replay, and requires an explicit owned acknowledgement
---
duration_ms: 3764.5834
type: 'test'
...
# Subtest: late HTTP stop of a finished browser job cannot interrupt a later job in the same Task
ok 10 - late HTTP stop of a finished browser job cannot interrupt a later job in the same Task
---
duration_ms: 7653.0649
type: 'test'
...
# Subtest: actual failed page blocks source-passed delivery; a new passing page permits a bound commit and preserves both original records
ok 11 - actual failed page blocks source-passed delivery; a new passing page permits a bound commit and preserves both original records
---
duration_ms: 17550.1685
type: 'test'
...
# Subtest: a build-only change after Git review invalidates the actual browser evidence and leaves HEAD and the protected index intact
ok 12 - a build-only change after Git review invalidates the actual browser evidence and leaves HEAD and the protected index intact
---
duration_ms: 8686.8447
type: 'test'
...
# Subtest: actual DOM controls include validated unique CSS selectors across repeated parent buttons and escaped labels
ok 13 - actual DOM controls include validated unique CSS selectors across repeated parent buttons and escaped labels
---
duration_ms: 6731.9778
type: 'test'
...
# Subtest: browser field coverage distinguishes sections and Run windows while retaining original source identity
ok 14 - browser field coverage distinguishes sections and Run windows while retaining original source identity
---
duration_ms: 0.4354
type: 'test'
...
# Subtest: repeated original browser pages pause a live Task without re-opening the browser or breaking tool pairing
ok 15 - repeated original browser pages pause a live Task without re-opening the browser or breaking tool pairing
---
duration_ms: 4792.6284
type: 'test'
...
# Subtest: browser plan rejects outside builds, invalid interaction scope and unbounded steps before execution
ok 16 - browser plan rejects outside builds, invalid interaction scope and unbounded steps before execution
---
duration_ms: 0.9067
type: 'test'
...
# Subtest: real owned Edge interactions, assertions, raw PNG and stopped process survive exact result reuse and host reopen
ok 17 - real owned Edge interactions, assertions, raw PNG and stopped process survive exact result reuse and host reopen
---
duration_ms: 3434.4602
type: 'test'
...
# Subtest: failed real page assertion preserves actual value and forbids silent retry of the original plan
ok 18 - failed real page assertion preserves actual value and forbids silent retry of the original plan
---
duration_ms: 8114.9785
type: 'test'
...
# Subtest: build/source mutation and sealed step tampering reject before browser dispatch; earlier task cannot execute plan
ok 19 - build/source mutation and sealed step tampering reject before browser dispatch; earlier task cannot execute plan
---
duration_ms: 1415.8433
type: 'test'
...
# Subtest: outside network never reaches another local service, and original JavaScript/console failures remain failures
ok 20 - outside network never reaches another local service, and original JavaScript/console failures remain failures
---
duration_ms: 3103.3149
type: 'test'
...
# Subtest: stopping a real in-flight browser preserves finished steps, closes its owned root and never replays
ok 21 - stopping a real in-flight browser preserves finished steps, closes its owned root and never replays
---
duration_ms: 2997.6024
type: 'test'
...
# Subtest: 原PNG损坏使原结果校验失败,不能以已有通过状态复用
ok 22 - 原PNG损坏使原结果校验失败,不能以已有通过状态复用
---
duration_ms: 3363.3907
type: 'test'
...
# Subtest: a budget pause persists concrete text/tool/history/image breakdown and never dispatches an oversized request
ok 23 - a budget pause persists concrete text/tool/history/image breakdown and never dispatches an oversized request
---
duration_ms: 2519.0849
type: 'test'
...
# Subtest: explicit frozen preview resumes the same Task in a new Run, preserves completed tools and does not change global config or selected model
ok 24 - explicit frozen preview resumes the same Task in a new Run, preserves completed tools and does not change global config or selected model
---
duration_ms: 3001.8414
type: 'test'
...
# Subtest: insufficient budgets, silently clamped capacity and arbitrary config fields reject without a physical request or mutating task budget
ok 25 - insufficient budgets, silently clamped capacity and arbitrary config fields reject without a physical request or mutating task budget
---
duration_ms: 2131.3397
type: 'test'
...
# Subtest: changed session, changed registry, expiry and altered frozen preview all require a new explicit preview
ok 26 - changed session, changed registry, expiry and altered frozen preview all require a new explicit preview
---
duration_ms: 2461.6286
type: 'test'
...
# Subtest: preview preserves unknown invocation status and increasing Task allowance is committed only with confirmed new Run
ok 27 - preview preserves unknown invocation status and increasing Task allowance is committed only with confirmed new Run
---
duration_ms: 2813.424
type: 'test'
...
# Subtest: batch APIs enforce ownership and review fingerprints, apply once, and persist the completed batch across restart
ok 28 - batch APIs enforce ownership and review fingerprints, apply once, and persist the completed batch across restart
---
duration_ms: 5757.7466
type: 'test'
...
# Subtest: delivery reports bind actual batch identity and reject corrupted snapshot evidence without changing project files
ok 29 - delivery reports bind actual batch identity and reject corrupted snapshot evidence without changing project files
---
duration_ms: 4140.6899
type: 'test'
...
# Subtest: a compatible model can seal proposals through the real HTTP loop while application stays behind user review
ok 30 - a compatible model can seal proposals through the real HTTP loop while application stays behind user review
---
duration_ms: 6933.6013
type: 'test'
...
# Subtest: a step-limited sealed batch applies and continues the same Task into actual checks without replaying saved tools
ok 31 - a step-limited sealed batch applies and continues the same Task into actual checks without replaying saved tools
---
duration_ms: 13122.417
type: 'test'
...
# Subtest: applied batches cannot turn cancellation, other budgets, restart or unknown commands into a review continuation
ok 32 - applied batches cannot turn cancellation, other budgets, restart or unknown commands into a review continuation
---
duration_ms: 2230.2774
type: 'test'
...
# Subtest: actual process exit at file-batch prepared preserves durable identity and never replays writes
ok 33 - actual process exit at file-batch prepared preserves durable identity and never replays writes
---
duration_ms: 1674.328
type: 'test'
...
# Subtest: actual process exit at file-batch application_started preserves durable identity and never replays writes
ok 34 - actual process exit at file-batch application_started preserves durable identity and never replays writes
---
duration_ms: 1345.3872
type: 'test'
...
# Subtest: actual process exit at file-batch write_intent preserves durable identity and never replays writes
ok 35 - actual process exit at file-batch write_intent preserves durable identity and never replays writes
---
duration_ms: 1825.745
type: 'test'
...
# Subtest: actual process exit at file-batch staged preserves durable identity and never replays writes
ok 36 - actual process exit at file-batch staged preserves durable identity and never replays writes
---
duration_ms: 1937.96
type: 'test'
...
# Subtest: actual process exit at file-batch replaced preserves durable identity and never replays writes
ok 37 - actual process exit at file-batch replaced preserves durable identity and never replays writes
---
duration_ms: 2157.8269
type: 'test'
...
# Subtest: actual process exit at file-batch file_recorded preserves durable identity and never replays writes
ok 38 - actual process exit at file-batch file_recorded preserves durable identity and never replays writes
---
duration_ms: 2037.0384
type: 'test'
...
# Subtest: actual process exit at file-batch finished preserves durable identity and never replays writes
ok 39 - actual process exit at file-batch finished preserves durable identity and never replays writes
---
duration_ms: 2370.7793
type: 'test'
...
# Subtest: actual process exit at file-batch rollback_started preserves durable identity and never replays writes
ok 40 - actual process exit at file-batch rollback_started preserves durable identity and never replays writes
---
duration_ms: 2708.1826
type: 'test'
...
# Subtest: actual process exit at file-batch restore_intent preserves durable identity and never replays writes
ok 41 - actual process exit at file-batch restore_intent preserves durable identity and never replays writes
---
duration_ms: 3032.8667
type: 'test'
...
# Subtest: actual process exit at file-batch restore_staged preserves durable identity and never replays writes
ok 42 - actual process exit at file-batch restore_staged preserves durable identity and never replays writes
---
duration_ms: 3347.2658
type: 'test'
...
# Subtest: actual process exit at file-batch restored preserves durable identity and never replays writes
ok 43 - actual process exit at file-batch restored preserves durable identity and never replays writes
---
duration_ms: 2948.8384
type: 'test'
...
# Subtest: actual process exit at file-batch restore_recorded preserves durable identity and never replays writes
ok 44 - actual process exit at file-batch restore_recorded preserves durable identity and never replays writes
---
duration_ms: 2961.6374
type: 'test'
...
# Subtest: actual process exit at file-batch rollback_finished preserves durable identity and never replays writes
ok 45 - actual process exit at file-batch rollback_finished preserves durable identity and never replays writes
---
duration_ms: 2766.5862
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'src/two.mjs', LF will be replaced by CRLF the next time Git touches it
# Subtest: sealed batches preserve bytes until review, then apply and explicitly restore BOM/CRLF/new files
ok 46 - sealed batches preserve bytes until review, then apply and explicitly restore BOM/CRLF/new files
---
duration_ms: 2484.7516
type: 'test'
...
# Switched to a new branch 'owner-branch'
# Subtest: a conflict in the last file or Git branch prevents writing every file in the batch
ok 47 - a conflict in the last file or Git branch prevents writing every file in the batch
---
duration_ms: 2829.458
type: 'test'
...
# Subtest: duplicate canonical paths, ancestor collisions, links, dependencies and Windows aliases never form a batch
ok 48 - duplicate canonical paths, ancestor collisions, links, dependencies and Windows aliases never form a batch
---
duration_ms: 1155.4387
type: 'test'
...
# Subtest: fingerprints, changed proposals and corrupt snapshot artifacts cannot write or restore any target
ok 49 - fingerprints, changed proposals and corrupt snapshot artifacts cannot write or restore any target
---
duration_ms: 2014.7386
type: 'test'
...
# Subtest: a failure after replacement restores only batch bytes and never retries an old application
ok 50 - a failure after replacement restores only batch bytes and never retries an old application
---
duration_ms: 1790.068
type: 'test'
...
# Subtest: rollback preserves owner edits, blocks other project writers, and explicit acknowledgement releases recovery
ok 51 - rollback preserves owner edits, blocks other project writers, and explicit acknowledgement releases recovery
---
duration_ms: 2295.5554
type: 'test'
...
# Subtest: an unattempted owner-created file identical to a suggestion remains external and is never removed
ok 52 - an unattempted owner-created file identical to a suggestion remains external and is never removed
---
duration_ms: 1521.4213
type: 'test'
...
# Subtest: active batch requests are serialized and cancellation leaves a verifiable ended batch
ok 53 - active batch requests are serialized and cancellation leaves a verifiable ended batch
---
duration_ms: 1260.7086
type: 'test'
...
# Subtest: batch application and rollback preserve unrelated Git index and worktree bytes
ok 54 - batch application and rollback preserve unrelated Git index and worktree bytes
---
duration_ms: 3816.1783
type: 'test'
...
# Subtest: recovery reuses exact staged bytes but retains a conflicting temporary file for owner inspection
ok 55 - recovery reuses exact staged bytes but retains a conflicting temporary file for owner inspection
---
duration_ms: 2511.7886
type: 'test'
...
# Subtest: one Task can seal pending proposals from earlier Runs while snapshots retain each source Run
ok 56 - one Task can seal pending proposals from earlier Runs while snapshots retain each source Run
---
duration_ms: 1849.1468
type: 'test'
...
# Subtest: engineering inspection preserves a dirty Git baseline and treats project rules as data
ok 57 - engineering inspection preserves a dirty Git baseline and treats project rules as data
---
duration_ms: 2777.7698
type: 'test'
...
# Subtest: real npm tests and build produce counted results, log artifacts and persistent verification
ok 58 - real npm tests and build produce counted results, log artifacts and persistent verification
---
duration_ms: 2316.0088
type: 'test'
...
# Subtest: an actual failing test retains the nonzero exit code and failed count
ok 59 - an actual failing test retains the nonzero exit code and failed count
---
duration_ms: 2329.5285
type: 'test'
...
# Subtest: zero tests, skipped tests and unrecognized stdout cannot become verification passes
ok 60 - zero tests, skipped tests and unrecognized stdout cannot become verification passes
---
duration_ms: 7085.4441
type: 'test'
...
# Subtest: a successful build with no selected tests does not verify the task
ok 61 - a successful build with no selected tests does not verify the task
---
duration_ms: 1897.9026
type: 'test'
...
# Subtest: stale check plans and forged script names execute no project commands
ok 62 - stale check plans and forged script names execute no project commands
---
duration_ms: 974.8778
type: 'test'
...
# Subtest: applying a later proposal invalidates the prior passed engineering snapshot
ok 63 - applying a later proposal invalidates the prior passed engineering snapshot
---
duration_ms: 2303.4439
type: 'test'
...
# Subtest: stopping an actual check terminates its child process and blocks concurrent jobs
ok 64 - stopping an actual check terminates its child process and blocks concurrent jobs
---
duration_ms: 1766.5401
type: 'test'
...
# Subtest: check timeout records a failure with its actual termination result
ok 65 - check timeout records a failure with its actual termination result
---
duration_ms: 2035.5736
type: 'test'
...
# Subtest: source edits during a successful check make the result stale
ok 66 - source edits during a successful check make the result stale
---
duration_ms: 2811.7083
type: 'test'
...
# Subtest: bounded large logs retain the test footer and readable artifact instead of inventing counts
ok 67 - bounded large logs retain the test footer and readable artifact instead of inventing counts
---
duration_ms: 1844.8273
type: 'test'
...
# Subtest: model-selected checks require a run-bound decision and denial creates no check job
ok 68 - model-selected checks require a run-bound decision and denial creates no check job
---
duration_ms: 2472.5902
type: 'test'
...
# Subtest: check APIs expose owned plans and jobs and preserve the authoritative results across restart
ok 69 - check APIs expose owned plans and jobs and preserve the authoritative results across restart
---
duration_ms: 6010.6592
type: 'test'
...
# Subtest: reviewed changes continue the original task without reopening a generic completed run
ok 70 - reviewed changes continue the original task without reopening a generic completed run
---
duration_ms: 3227.869
type: 'test'
...
# Subtest: concurrent review-continuation API requests accept one run and retain the goal after restart
ok 71 - concurrent review-continuation API requests accept one run and retain the goal after restart
---
duration_ms: 9044.0383
type: 'test'
...
# Subtest: the model reads owned failure logs without running the check again
ok 72 - the model reads owned failure logs without running the check again
---
duration_ms: 3354.0824
type: 'test'
...
# Subtest: process exit at check queued preserves results and never replays commands
ok 73 - process exit at check queued preserves results and never replays commands
---
duration_ms: 1546.0795
type: 'test'
...
# Subtest: process exit at check result_committed preserves results and never replays commands
ok 74 - process exit at check result_committed preserves results and never replays commands
---
duration_ms: 1950.661
type: 'test'
...
# Subtest: model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
ok 75 - model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
---
duration_ms: 4130.0401
type: 'test'
...
# Subtest: bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
ok 76 - bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
---
duration_ms: 2822.3004
type: 'test'
...
# Subtest: code tool arguments reject malformed ownership-independent inputs before side effects
ok 77 - code tool arguments reject malformed ownership-independent inputs before side effects
---
duration_ms: 0.3787
type: 'test'
...
# Subtest: observe-only device authority cannot read, configure or clear project parsing caches
ok 78 - observe-only device authority cannot read, configure or clear project parsing caches
---
duration_ms: 1015.7577
type: 'test'
...
# Subtest: pairing is short lived, single-use, generation-bound and validates exact permissions
ok 79 - pairing is short lived, single-use, generation-bound and validates exact permissions
---
duration_ms: 853.4955
type: 'test'
...
# Subtest: device transaction failure neither consumes the ticket nor leaves a credential
ok 80 - device transaction failure neither consumes the ticket nor leaves a credential
---
duration_ms: 574.3679
type: 'test'
...
# Subtest: devices have project and action boundaries; rotation, expiration, revocation and host changes reject old authority
ok 81 - devices have project and action boundaries; rotation, expiration, revocation and host changes reject old authority
---
duration_ms: 905.4241
type: 'test'
...
# Subtest: persistent registry stores hashes and a bounded audit, never raw credentials
ok 82 - persistent registry stores hashes and a bounded audit, never raw credentials
---
duration_ms: 718.8699
type: 'test'
...
# Subtest: real TLS verifies IP SAN, CA chain, encrypted restart and public fingerprint
ok 83 - real TLS verifies IP SAN, CA chain, encrypted restart and public fingerprint
---
duration_ms: 896.1811
type: 'test'
...
# Subtest: TLS sealing failure leaves listener closed and no plaintext or successful TLS registration
ok 84 - TLS sealing failure leaves listener closed and no plaintext or successful TLS registration
---
duration_ms: 712.3463
type: 'test'
...
# Subtest: HTTP pairing is concurrent single-use; secure cookie and strict origin/host checks
ok 85 - HTTP pairing is concurrent single-use; secure cookie and strict origin/host checks
---
duration_ms: 732.3778
type: 'test'
...
# Subtest: gateway never exposes management routes, arbitrary assets or unpaired project data
ok 86 - gateway never exposes management routes, arbitrary assets or unpaired project data
---
duration_ms: 1051.889
type: 'test'
...
# Subtest: authorized project events paginate from original seq without leaking other project events or payloads
ok 87 - authorized project events paginate from original seq without leaking other project events or payloads
---
duration_ms: 1777.1997
type: 'test'
...
# Subtest: remote task projection excludes raw model history, host configuration, tool input and credentials
ok 88 - remote task projection excludes raw model history, host configuration, tool input and credentials
---
duration_ms: 921.9083
type: 'test'
...
# Subtest: permission checks apply to direct remote mutation, not only UI controls
ok 89 - permission checks apply to direct remote mutation, not only UI controls
---
duration_ms: 1022.3838
type: 'test'
...
# Subtest: approval fingerprint and exact task/revision are bound; duplicate requests never execute twice
ok 90 - approval fingerprint and exact task/revision are bound; duplicate requests never execute twice
---
duration_ms: 969.6471
type: 'test'
...
# Subtest: unknown original operation is recorded and never replayed after response failure
ok 91 - unknown original operation is recorded and never replayed after response failure
---
duration_ms: 1231.7131
type: 'test'
...
# Subtest: revocation and gateway closure reject old access without invoking runtime stop
ok 92 - revocation and gateway closure reject old access without invoking runtime stop
---
duration_ms: 1153.4226
type: 'test'
...
# Subtest: rate limits reject pairing brute force and do not persist candidate secrets
ok 93 - rate limits reject pairing brute force and do not persist candidate secrets
---
duration_ms: 977.3992
type: 'test'
...
# Subtest: real Windows CurrentUser DPAPI persists only a sealed CA and reopens it
ok 94 - real Windows CurrentUser DPAPI persists only a sealed CA and reopens it
---
duration_ms: 2142.3977
type: 'test'
...
# Subtest: mobile approval executes the original Runtime command exactly once and rejects the later desktop decision
ok 95 - mobile approval executes the original Runtime command exactly once and rejects the later desktop decision
---
duration_ms: 2349.3024
type: 'test'
...
# Subtest: desktop rejection wins a concurrent mobile request and original command remains unexecuted
ok 96 - desktop rejection wins a concurrent mobile request and original command remains unexecuted
---
duration_ms: 1942.898
type: 'test'
...
# Subtest: phone stop waits for the original process exit and prevents later heartbeats and command replay
ok 97 - phone stop waits for the original process exit and prevents later heartbeats and command replay
---
duration_ms: 3056.7525
type: 'test'
...
# Subtest: Run replacement during parent-stop wait is rejected rather than stopping the new Run
ok 98 - Run replacement during parent-stop wait is rejected rather than stopping the new Run
---
duration_ms: 747.3319
type: 'test'
...
# Subtest: diff pages preserve source SHA; report reads verify blobs and exclude unrelated artifact kinds
ok 99 - diff pages preserve source SHA; report reads verify blobs and exclude unrelated artifact kinds
---
duration_ms: 1185.7284
type: 'test'
...
# Subtest: hot upgrade refuses an active gateway and restores closed gateway ownership on failure
ok 100 - hot upgrade refuses an active gateway and restores closed gateway ownership on failure
---
duration_ms: 923.3363
type: 'test'
...
# Subtest: damaged device permissions or expiry fail closed and never overwrite the original registry
ok 101 - damaged device permissions or expiry fail closed and never overwrite the original registry
---
duration_ms: 929.1217
type: 'test'
...
# Subtest: device revocation destroys its actual authenticated TLS connection
ok 102 - device revocation destroys its actual authenticated TLS connection
---
duration_ms: 1177.5621
type: 'test'
...
# Subtest: companion observes only current Task screenshots, verifies original PNG bytes and loses access immediately on revoke
ok 103 - companion observes only current Task screenshots, verifies original PNG bytes and loses access immediately on revoke
---
duration_ms: 1425.0092
type: 'test'
...
# Subtest: actual config HTTP failure preserves the committed selection, config and volatile credential before a successful retry
ok 104 - actual config HTTP failure preserves the committed selection, config and volatile credential before a successful retry
---
duration_ms: 1267.7873
type: 'test'
...
# Subtest: controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
ok 105 - controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
---
duration_ms: 1121.073
type: 'test'
...
# Subtest: controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
ok 106 - controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
---
duration_ms: 0.5349
type: 'test'
...
# Subtest: owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
ok 107 - owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
---
duration_ms: 5.0885
type: 'test'
...
# Subtest: bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
ok 108 - bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
---
duration_ms: 938.9432
type: 'test'
...
# Subtest: bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
ok 109 - bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
---
duration_ms: 763.1579
type: 'test'
...
# Subtest: bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
ok 110 - bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
---
duration_ms: 939.8687
type: 'test'
...
# Subtest: stopped and oversized bridge requests never reach a local model or tool callback
ok 111 - stopped and oversized bridge requests never reach a local model or tool callback
---
duration_ms: 769.4705
type: 'test'
...
# Subtest: a Windows virtual data-directory name binds new storage and credentials to its actual physical root
ok 112 - a Windows virtual data-directory name binds new storage and credentials to its actual physical root
---
duration_ms: 2035.3076
type: 'test'
...
# Subtest: physical data-root adoption still rejects explicit junctions at the directory or any ancestor
ok 113 - physical data-root adoption still rejects explicit junctions at the directory or any ancestor
---
duration_ms: 787.3911
type: 'test'
...
# Subtest: actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy
ok 114 - actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy
---
duration_ms: 1481.0717
type: 'test'
...
# Subtest: only explicitly supplied keys persist; new provider restores original revisions and public views contain no key
ok 115 - only explicitly supplied keys persist; new provider restores original revisions and public views contain no key
---
duration_ms: 2395.2268
type: 'test'
...
# Subtest: registry and cipher commit failure restores original routing, keys, block and every database row
ok 116 - registry and cipher commit failure restores original routing, keys, block and every database row
---
duration_ms: 1817.7758
type: 'test'
...
# Subtest: a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview
ok 117 - a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview
---
duration_ms: 1760.6213
type: 'test'
...
# Subtest: connection revision changes retain the original saved block and report a source mismatch on restart
ok 118 - connection revision changes retain the original saved block and report a source mismatch on restart
---
duration_ms: 2174.3824
type: 'test'
...
# Subtest: disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both
ok 119 - disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both
---
duration_ms: 2488.9255
type: 'test'
...
# Subtest: corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext
ok 120 - corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext
---
duration_ms: 2784.3082
type: 'test'
...
# Subtest: legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save
ok 121 - legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save
---
duration_ms: 2559.962
type: 'test'
...
# Subtest: owned plaintext keys never reach SQLite pages, WAL, config or public execution exports
ok 122 - owned plaintext keys never reach SQLite pages, WAL, config or public execution exports
---
duration_ms: 1569.1374
type: 'test'
...
# Subtest: actual process exit at Git queued never replays a commit and can reconcile the durable result
ok 123 - actual process exit at Git queued never replays a commit and can reconcile the durable result
---
duration_ms: 10834.7737
type: 'test'
...
# Subtest: actual process exit at Git preparing never replays a commit and can reconcile the durable result
ok 124 - actual process exit at Git preparing never replays a commit and can reconcile the durable result
---
duration_ms: 11293.2421
type: 'test'
...
# Subtest: actual process exit at Git index_locked never replays a commit and can reconcile the durable result
ok 125 - actual process exit at Git index_locked never replays a commit and can reconcile the durable result
---
duration_ms: 12894.3854
type: 'test'
...
# Subtest: actual process exit at Git prepared never replays a commit and can reconcile the durable result
ok 126 - actual process exit at Git prepared never replays a commit and can reconcile the durable result
---
duration_ms: 13302.5859
type: 'test'
...
# Subtest: actual process exit at Git ref_prepared never replays a commit and can reconcile the durable result
ok 127 - actual process exit at Git ref_prepared never replays a commit and can reconcile the durable result
---
duration_ms: 12373.3225
type: 'test'
...
# Subtest: actual process exit at Git publishing never replays a commit and can reconcile the durable result
ok 128 - actual process exit at Git publishing never replays a commit and can reconcile the durable result
---
duration_ms: 13319.3271
type: 'test'
...
# Subtest: actual process exit at Git committed never replays a commit and can reconcile the durable result
ok 129 - actual process exit at Git committed never replays a commit and can reconcile the durable result
---
duration_ms: 9464.5877
type: 'test'
...
# Subtest: actual process exit at Git index_published never replays a commit and can reconcile the durable result
ok 130 - actual process exit at Git index_published never replays a commit and can reconcile the durable result
---
duration_ms: 11014.2658
type: 'test'
...
# Subtest: actual process exit at Git finished never replays a commit and can reconcile the durable result
ok 131 - actual process exit at Git finished never replays a commit and can reconcile the durable result
---
duration_ms: 9488.3444
type: 'test'
...
# Subtest: an unknown Git result cannot overwrite an externally changed index or delete an unrelated lock
ok 132 - an unknown Git result cannot overwrite an externally changed index or delete an unrelated lock
---
duration_ms: 9188.3424
type: 'test'
...
# Subtest: known publication with a later source edit retains the commit and marks the delivery for inspection
ok 133 - known publication with a later source edit retains the commit and marks the delivery for inspection
---
duration_ms: 10086.9475
type: 'test'
...
# Subtest: CRLF normalization, multiple applied revisions and unrelated special index flags preserve exact bytes and ownership
ok 134 - CRLF normalization, multiple applied revisions and unrelated special index flags preserve exact bytes and ownership
---
duration_ms: 10219.3512
type: 'test'
...
# Subtest: adding new durable record kinds to an existing hot Store preserves all existing Maps and records
ok 135 - adding new durable record kinds to an existing hot Store preserves all existing Maps and records
---
duration_ms: 7686.4779
type: 'test'
...
# Subtest: an unrelated owner deletion is fingerprinted and preserved while linked task paths are rejected
ok 136 - an unrelated owner deletion is fingerprinted and preserved while linked task paths are rejected
---
duration_ms: 14028.8566
type: 'test'
...
# Subtest: actual failed tests become a reviewed local commit and evidence report while preserving unrelated index and files
ok 137 - actual failed tests become a reviewed local commit and evidence report while preserving unrelated index and files
---
duration_ms: 13594.6215
type: 'test'
...
# Subtest: selected preexisting unstaged, staged and untracked owner edits cannot enter a task commit
ok 138 - selected preexisting unstaged, staged and untracked owner edits cannot enter a task commit
---
duration_ms: 15600.5595
type: 'test'
...
# Switched to a new branch 'owner-branch'
# Subtest: source, unrelated stage and branch changes after review invalidate a commit plan without changing HEAD
ok 139 - source, unrelated stage and branch changes after review invalidate a commit plan without changing HEAD
---
duration_ms: 19107.1596
type: 'test'
...
# Switched to a new branch 'delivery-branch'
# Subtest: a later Git metadata change keeps matching source evidence valid but a real source edit requires checks
ok 140 - a later Git metadata change keeps matching source evidence valid but a real source edit requires checks
---
duration_ms: 8552.4225
type: 'test'
...
# Subtest: a corrupt passed-check log and a pending proposal block Git delivery instead of inventing evidence
ok 141 - a corrupt passed-check log and a pending proposal block Git delivery instead of inventing evidence
---
duration_ms: 5294.3842
type: 'test'
...
# HEAD is now at 01ee486 Sealed delivery fixture baseline
# Subtest: Git filters, merge state, detached HEAD and old task ownership are explicitly rejected
ok 142 - Git filters, merge state, detached HEAD and old task ownership are explicitly rejected
---
duration_ms: 20472.8948
type: 'test'
...
# Subtest: local snapshot commits disable repository hooks and signing and isolate the Git child environment
ok 143 - local snapshot commits disable repository hooks and signing and isolate the Git child environment
---
duration_ms: 8975.4547
type: 'test'
...
# Subtest: stopping before publication cancels safely; stopping after publication preserves the actual completed commit
ok 144 - stopping before publication cancels safely; stopping after publication preserves the actual completed commit
---
duration_ms: 15769.5859
type: 'test'
...
# Subtest: delivery API confirms exactly one owned plan, serves verified reports and preserves results across restart
ok 145 - delivery API confirms exactly one owned plan, serves verified reports and preserves results across restart
---
duration_ms: 12477.6511
type: 'test'
...
# Subtest: the model can prepare an owned Git review and evidence report while publishing remains a separate user action
ok 146 - the model can prepare an owned Git review and evidence report while publishing remains a separate user action
---
duration_ms: 10827.7938
type: 'test'
...
# Subtest: HTTP Git review pairs deferred calls, survives reload and never requests more work until the saved preview is resolved
ok 147 - HTTP Git review pairs deferred calls, survives reload and never requests more work until the saved preview is resolved
---
duration_ms: 9205.9696
type: 'test'
...
# Subtest: a reviewed Git preview can be revised or withdrawn without publishing or losing the current Task
ok 148 - a reviewed Git preview can be revised or withdrawn without publishing or losing the current Task
---
duration_ms: 7394.797
type: 'test'
...
# Subtest: actual Electron debug argument ordering retains exactly the compiled entry and rejects extra or repeated actions
ok 149 - actual Electron debug argument ordering retains exactly the compiled entry and rejects extra or repeated actions
---
duration_ms: 0.9871
type: 'test'
...
# Subtest: native bridge refuses other origins, subframes, other windows and unsupported inputs before connecting
ok 150 - native bridge refuses other origins, subframes, other windows and unsupported inputs before connecting
---
duration_ms: 596.514
type: 'test'
...
# Subtest: file reveal binds the current project, task, path, UTF-8 bytes and original SHA without executing the file
ok 151 - file reveal binds the current project, task, path, UTF-8 bytes and original SHA without executing the file
---
duration_ms: 672.7448
type: 'test'
...
# Subtest: file changed during asynchronous task recheck is not revealed as the old bytes
ok 152 - file changed during asynchronous task recheck is not revealed as the old bytes
---
duration_ms: 625.6442
type: 'test'
...
# Subtest: desktop browser profile and aliases stay outside project inventory and file access
ok 153 - desktop browser profile and aliases stay outside project inventory and file access
---
duration_ms: 668.688
type: 'test'
...
# Subtest: native picker cancel and origin change after dialog publish no project registration
ok 154 - native picker cancel and origin change after dialog publish no project registration
---
duration_ms: 621.077
type: 'test'
...
# Subtest: pending native action is not dispatched twice, and current task review returns its original seq
ok 155 - pending native action is not dispatched twice, and current task review returns its original seq
---
duration_ms: 506.0692
type: 'test'
...
# Subtest: native stop cancellation and changed original host never stop a replacement process
ok 156 - native stop cancellation and changed original host never stop a replacement process
---
duration_ms: 553.4705
type: 'test'
...
# Subtest: window register rejects host PID, stale installation, extra fields and missing creation identity
ok 157 - window register rejects host PID, stale installation, extra fields and missing creation identity
---
duration_ms: 0.3357
type: 'test'
...
# Subtest: a rebuilt source archive binds actual generated client assets and retains its original running identity after disk changes
ok 158 - a rebuilt source archive binds actual generated client assets and retains its original running identity after disk changes
---
duration_ms: 2433.6562
type: 'test'
...
# Subtest: host challenge proof rejects a stale challenge, changed identity and changed signature
ok 159 - host challenge proof rejects a stale challenge, changed identity and changed signature
---
duration_ms: 0.6903
type: 'test'
...
# Subtest: stop confirmation binds the original instance, creation and loaded runtime
ok 160 - stop confirmation binds the original instance, creation and loaded runtime
---
duration_ms: 0.1347
type: 'test'
...
# Subtest: state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
ok 161 - state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
---
duration_ms: 950.39
type: 'test'
...
# Subtest: failed registration publishes no initialized memory and can complete after its actual inputs are supplied
ok 162 - failed registration publishes no initialized memory and can complete after its actual inputs are supplied
---
duration_ms: 3089.9115
type: 'test'
...
# Subtest: host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
ok 163 - host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
---
duration_ms: 1.0812
type: 'test'
...
# Subtest: host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
ok 164 - host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
---
duration_ms: 720.6049
type: 'test'
...
# Subtest: full candidate validation returns the exact loaded-input host identity and rejects undeclared or altered files
ok 165 - full candidate validation returns the exact loaded-input host identity and rejects undeclared or altered files
---
duration_ms: 1823.9375
type: 'test'
...
# Subtest: installation requires separate absolute program/data directories and a candidate in its own versions namespace
ok 166 - installation requires separate absolute program/data directories and a candidate in its own versions namespace
---
duration_ms: 1811.7593
type: 'test'
...
# Subtest: staging retains the original data and pointer without querying or restarting a host
ok 167 - staging retains the original data and pointer without querying or restarting a host
---
duration_ms: 2673.2261
type: 'test'
...
# Subtest: a post-pointer failure restores every original pointer byte and persistent row; a first-install failure removes only its published pointer
ok 168 - a post-pointer failure restores every original pointer byte and persistent row; a first-install failure removes only its published pointer
---
duration_ms: 6078.2023
type: 'test'
...
# Subtest: changed active manifest and concurrent pointer changes are rejected without overwriting the unknown record
ok 169 - changed active manifest and concurrent pointer changes are rejected without overwriting the unknown record
---
duration_ms: 3100.8617
type: 'test'
...
# Subtest: an unregistered non-HTTP listener blocks preflight even when service-info is absent
ok 170 - an unregistered non-HTTP listener blocks preflight even when service-info is absent
---
duration_ms: 1769.0548
type: 'test'
...
# Subtest: uninstall archives its original pointer and preserves every data row/artifact instead of recursively deleting data
ok 171 - uninstall archives its original pointer and preserves every data row/artifact instead of recursively deleting data
---
duration_ms: 3823.9907
type: 'test'
...
# Subtest: preflight rejects an unrelated program root or changed native bootstrap while preserving its original bytes
ok 172 - preflight rejects an unrelated program root or changed native bootstrap while preserving its original bytes
---
duration_ms: 1580.0793
type: 'test'
...
# Subtest: a changed owned bootstrap follows its candidate and a post-pointer fault restores both original bytes
ok 173 - a changed owned bootstrap follows its candidate and a post-pointer fault restores both original bytes
---
duration_ms: 6961.3936
type: 'test'
...
# Subtest: an external bootstrap change after preflight is preserved and never overwritten as an update or rollback
ok 174 - an external bootstrap change after preflight is preserved and never overwritten as an update or rollback
---
duration_ms: 5084.6355
type: 'test'
...
# Subtest: a question about the previous workbench error receives local error context and current change states
ok 175 - a question about the previous workbench error receives local error context and current change states
---
duration_ms: 1672.4475
type: 'test'
...
# Subtest: a transient model failure after an approved command retries only the model request
ok 176 - a transient model failure after an approved command retries only the model request
---
duration_ms: 2221.5111
type: 'test'
...
# Subtest: exhausted model retries preserve tool results, and explicit resume adds no new user turn or replay
ok 177 - exhausted model retries preserve tool results, and explicit resume adds no new user turn or replay
---
duration_ms: 2477.1793
type: 'test'
...
# Subtest: stopping during model backoff cancels further requests and clears the running request state
ok 178 - stopping during model backoff cancels further requests and clears the running request state
---
duration_ms: 1165.2142
type: 'test'
...
# Subtest: HTTP authentication errors are classified, redacted and never automatically retried
ok 179 - HTTP authentication errors are classified, redacted and never automatically retried
---
duration_ms: 21.3784
type: 'test'
...
# Subtest: temporary HTTP service errors retry and recover with recorded attempt counts
ok 180 - temporary HTTP service errors retry and recover with recorded attempt counts
---
duration_ms: 23.48
type: 'test'
...
# Subtest: invalid and oversized protocol responses fail once with a useful response-format diagnosis
ok 181 - invalid and oversized protocol responses fail once with a useful response-format diagnosis
---
duration_ms: 3.8931
type: 'test'
...
# Subtest: HTTP rate limits expose their source and obey the service retry interval before recovery
ok 182 - HTTP rate limits expose their source and obey the service retry interval before recovery
---
duration_ms: 1010.8402
type: 'test'
...
# Subtest: Windows commands preserve Chinese through a PowerShell pipeline into Node
ok 183 - Windows commands preserve Chinese through a PowerShell pipeline into Node
---
duration_ms: 746.1596
type: 'test'
...
# Subtest: Windows shell syntax errors stay readable and native command exit codes are retained
ok 184 - Windows shell syntax errors stay readable and native command exit codes are retained
---
duration_ms: 993.6271
type: 'test'
...
# Subtest: review and completed states do not turn a generic continue click into a new model request
ok 185 - review and completed states do not turn a generic continue click into a new model request
---
duration_ms: 837.9671
type: 'test'
...
# Subtest: old session data receives a truthful historical connection diagnosis without rewriting history
ok 186 - old session data receives a truthful historical connection diagnosis without rewriting history
---
duration_ms: 684.425
type: 'test'
...
# Subtest: engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
ok 187 - engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
---
duration_ms: 4997.2401
type: 'test'
...
# Subtest: HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
ok 188 - HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
---
duration_ms: 3970.395
type: 'test'
...
# Subtest: controlled engine HTTP freezes one child, pages original owned input/report, rejects foreign reads and prevents changed-source reuse
ok 189 - controlled engine HTTP freezes one child, pages original owned input/report, rejects foreign reads and prevents changed-source reuse
---
duration_ms: 14662.0243
type: 'test'
...
# Subtest: native text and call IDs preserve original result pairing while unsupported content fails closed
ok 190 - native text and call IDs preserve original result pairing while unsupported content fails closed
---
duration_ms: 0.7813
type: 'test'
...
# Subtest: one engine child freezes real installation identity before creating tasks and rejects a changed source
ok 191 - one engine child freezes real installation identity before creating tasks and rejects a changed source
---
duration_ms: 9055.3695
type: 'test'
...
# Subtest: owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
ok 192 - owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
---
duration_ms: 28204.6222
type: 'test'
...
# Subtest: forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
ok 193 - forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
---
duration_ms: 15257.6173
type: 'test'
...
# Subtest: duplicate native IDs are rejected without replaying a saved tool
ok 194 - duplicate native IDs are rejected without replaying a saved tool
---
duration_ms: 14286.1572
type: 'test'
...
# Subtest: native input exceeding the context budget is retained and sends no model request
ok 195 - native input exceeding the context budget is retained and sends no model request
---
duration_ms: 11851.6688
type: 'test'
...
# Subtest: stop retains a late reported model usage once and executes no tool from that output
ok 196 - stop retains a late reported model usage once and executes no tool from that output
---
duration_ms: 12509.5804
type: 'test'
...
# Subtest: a source change after the original model intent stops before native tools execute
ok 197 - a source change after the original model intent stops before native tools execute
---
duration_ms: 13275.5421
type: 'test'
...
# Subtest: an engine source change while approval is pending invalidates the old permission before any check starts
ok 198 - an engine source change while approval is pending invalidates the old permission before any check starts
---
duration_ms: 14879.8115
type: 'test'
...
# Subtest: missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
ok 199 - missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
---
duration_ms: 0.6601
type: 'test'
...
# Subtest: closed root with an original live descendant remains unknown and retains its process tree
ok 200 - closed root with an original live descendant remains unknown and retains its process tree
---
duration_ms: 0.3345
type: 'test'
...
# Subtest: host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
ok 201 - host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
---
duration_ms: 16983.2361
type: 'test'
...
# Subtest: corrupted model reservation cannot reduce recovered budget or permit a new engine request
ok 202 - corrupted model reservation cannot reduce recovered budget or permit a new engine request
---
duration_ms: 14005.1266
type: 'test'
...
# Subtest: engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
ok 203 - engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
---
duration_ms: 733.2563
type: 'test'
...
# Subtest: owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
ok 204 - owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
---
duration_ms: 1389.5825
type: 'test'
...
# Subtest: an invalid startup nonce is rejected before initialize and preserves the process close and partial report
ok 205 - an invalid startup nonce is rejected before initialize and preserves the process close and partial report
---
duration_ms: 1278.1354
type: 'test'
...
# Subtest: SDK identity and session directory mismatches retain raw responses and never become verified
ok 206 - SDK identity and session directory mismatches retain raw responses and never become verified
---
duration_ms: 4127.6149
type: 'test'
...
# Subtest: cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
ok 207 - cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
---
duration_ms: 1608.4459
type: 'test'
...
# Subtest: cancel before readiness sends no protocol request and a user retry creates a different process and record
ok 208 - cancel before readiness sends no protocol request and a user retry creates a different process and record
---
duration_ms: 1606.4018
type: 'test'
...
# Subtest: source or scratch changes and unexpected model traffic fail after preserving the actual observed result
ok 209 - source or scratch changes and unexpected model traffic fail after preserving the actual observed result
---
duration_ms: 4283.9796
type: 'test'
...
# Subtest: unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
ok 210 - unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
---
duration_ms: 2544.6635
type: 'test'
...
# Subtest: engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
ok 211 - engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
---
duration_ms: 1360.3901
type: 'test'
...
# Subtest: foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
ok 212 - foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
---
duration_ms: 1565.9202
type: 'test'
...
# Subtest: restart never replays an active engine check or stops a historical PID, and keeps prior task state
ok 213 - restart never replays an active engine check or stops a historical PID, and keeps prior task state
---
duration_ms: 1810.9121
type: 'test'
...
# Subtest: model argument validation and runtime activity do not grant external engine prompt or project execution
ok 214 - model argument validation and runtime activity do not grant external engine prompt or project execution
---
duration_ms: 653.1285
type: 'test'
...
# Subtest: a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
ok 215 - a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
---
duration_ms: 2372.866
type: 'test'
...
# Subtest: evaluation denominator distinguishes attempted unsealed candidates from unexecuted samples
ok 216 - evaluation denominator distinguishes attempted unsealed candidates from unexecuted samples
---
duration_ms: 0.6552
type: 'test'
...
# Subtest: evaluation summary retains sealed outcomes and stopped or failed original attempts
ok 217 - evaluation summary retains sealed outcomes and stopped or failed original attempts
---
duration_ms: 0.4103
type: 'test'
...
# Subtest: evaluation contract fixes bounded samples, source paths, checks and aggregate budget
ok 218 - evaluation contract fixes bounded samples, source paths, checks and aggregate budget
---
duration_ms: 658.6349
type: 'test'
...
# Subtest: same-source workspaces seal real commands before execution and preserve original staged and unstaged bytes
ok 219 - same-source workspaces seal real commands before execution and preserve original staged and unstaged bytes
---
duration_ms: 17907.4063
type: 'test'
...
# Subtest: actual original failures and candidate success are both preserved, then adoption requires parent review, checks and Git
ok 220 - actual original failures and candidate success are both preserved, then adoption requires parent review, checks and Git
---
duration_ms: 64358.6252
type: 'test'
...
# Subtest: candidate cannot shrink tests and changing original test bytes rejects execution before any model request
ok 221 - candidate cannot shrink tests and changing original test bytes rejects execution before any model request
---
duration_ms: 23600.3147
type: 'test'
...
# Subtest: missing upstream usage remains unknown and does not become a free run or invented cost
ok 222 - missing upstream usage remains unknown and does not become a free run or invented cost
---
duration_ms: 38814.1193
type: 'test'
...
# Subtest: missing raw check logs preserve unknown result and original sample denominator
ok 223 - missing raw check logs preserve unknown result and original sample denominator
---
duration_ms: 37147.0633
type: 'test'
...
# Subtest: source and model changes never silently replace an existing batch input
ok 224 - source and model changes never silently replace an existing batch input
---
duration_ms: 3446.8386
type: 'test'
...
# Subtest: model revision change before preparing a fixed sample cannot silently use the replacement connection
ok 225 - model revision change before preparing a fixed sample cannot silently use the replacement connection
---
duration_ms: 3431.9899
type: 'test'
...
# Subtest: HTTP evaluations require host token, original fingerprint and session ownership; worker API cannot bypass evaluation flow
ok 226 - HTTP evaluations require host token, original fingerprint and session ownership; worker API cannot bypass evaluation flow
---
duration_ms: 16858.1834
type: 'test'
...
# Subtest: sample queue cannot skip or reset attempted samples, and reports freeze further writes
ok 227 - sample queue cannot skip or reset attempted samples, and reports freeze further writes
---
duration_ms: 29324.7763
type: 'test'
...
# Subtest: stop cancels only current candidate and preserves partial results instead of replaying a request
ok 228 - stop cancels only current candidate and preserves partial results instead of replaying a request
---
duration_ms: 22891.2886
type: 'test'
...
# Subtest: restart recovers interrupted evaluations as unknown and keeps completed checks and plan identity
ok 229 - restart recovers interrupted evaluations as unknown and keeps completed checks and plan identity
---
duration_ms: 20726.8884
type: 'test'
...
# Subtest: JSON migration survives process exit before commit and retains exact legacy backups
ok 230 - JSON migration survives process exit before commit and retains exact legacy backups
---
duration_ms: 1911.9084
type: 'test'
...
# Subtest: process exit after_state rolls back state, event and outbox together
ok 231 - process exit after_state rolls back state, event and outbox together
---
duration_ms: 1624.6702
type: 'test'
...
# Subtest: process exit after_event rolls back state, event and outbox together
ok 232 - process exit after_event rolls back state, event and outbox together
---
duration_ms: 1738.6282
type: 'test'
...
# Subtest: crash recovery at accepted retains execution identity and never replays side effects
ok 233 - crash recovery at accepted retains execution identity and never replays side effects
---
duration_ms: 1586.0991
type: 'test'
...
# Subtest: crash recovery at queued retains execution identity and never replays side effects
ok 234 - crash recovery at queued retains execution identity and never replays side effects
---
duration_ms: 2137.4281
type: 'test'
...
# Subtest: crash recovery at approval_wait retains execution identity and never replays side effects
ok 235 - crash recovery at approval_wait retains execution identity and never replays side effects
---
duration_ms: 2737.9178
type: 'test'
...
# Subtest: crash recovery at approved retains execution identity and never replays side effects
ok 236 - crash recovery at approved retains execution identity and never replays side effects
---
duration_ms: 2862.12
type: 'test'
...
# Subtest: crash recovery at effect_unrecorded retains execution identity and never replays side effects
ok 237 - crash recovery at effect_unrecorded retains execution identity and never replays side effects
---
duration_ms: 2882.7572
type: 'test'
...
# Subtest: crash recovery at result_committed retains execution identity and never replays side effects
ok 238 - crash recovery at result_committed retains execution identity and never replays side effects
---
duration_ms: 2966.8815
type: 'test'
...
# Subtest: crash recovery at before_next_model retains execution identity and never replays side effects
ok 239 - crash recovery at before_next_model retains execution identity and never replays side effects
---
duration_ms: 2899.2017
type: 'test'
...
# Subtest: state and event failures publish no success and preserve the last committed memory snapshot
ok 240 - state and event failures publish no success and preserve the last committed memory snapshot
---
duration_ms: 702.3684
type: 'test'
...
# Subtest: tool result artifacts and event cursors retain project ownership across restart
ok 241 - tool result artifacts and event cursors retain project ownership across restart
---
duration_ms: 2086.5445
type: 'test'
...
# Subtest: token budgets pause before tools execute and continuation keeps original task and accumulated usage
ok 242 - token budgets pause before tools execute and continuation keeps original task and accumulated usage
---
duration_ms: 1367.6906
type: 'test'
...
# Subtest: a time budget interrupts an unresponsive model and persists a resumable run
ok 243 - a time budget interrupts an unresponsive model and persists a resumable run
---
duration_ms: 1027.4266
type: 'test'
...
# Subtest: a corrupted large result artifact cannot become a recovered success
ok 244 - a corrupted large result artifact cannot become a recovered success
---
duration_ms: 850.3615
type: 'test'
...
# Subtest: hard-link aliases cannot expose protected bytes through reads, proposals, inventory or automatic project rules
ok 245 - hard-link aliases cannot expose protected bytes through reads, proposals, inventory or automatic project rules
---
duration_ms: 563.1974
type: 'test'
...
# Subtest: ambiguous project hard links are explicit and ordinary independent file copies remain readable
ok 246 - ambiguous project hard links are explicit and ordinary independent file copies remain readable
---
duration_ms: 638.9358
type: 'test'
...
# Subtest: proposals preserve project bytes until review; apply backs up the exact original bytes
ok 247 - proposals preserve project bytes until review; apply backs up the exact original bytes
---
duration_ms: 573.9418
type: 'test'
...
# Subtest: new nested files are created only on apply and unchanged content creates no proposal
ok 248 - new nested files are created only on apply and unchanged content creates no proposal
---
duration_ms: 573.068
type: 'test'
...
# Subtest: stale reads and changed baselines are rejected without overwriting external edits
ok 249 - stale reads and changed baselines are rejected without overwriting external edits
---
duration_ms: 623.9334
type: 'test'
...
# Subtest: file paths reject traversal, absolute paths, credentials and outside junctions
ok 250 - file paths reject traversal, absolute paths, credentials and outside junctions
---
duration_ms: 517.1875
type: 'test'
...
# Subtest: read and search expose bounded text scopes and reject non UTF-8 / oversized files
ok 251 - read and search expose bounded text scopes and reject non UTF-8 / oversized files
---
duration_ms: 598.9614
type: 'test'
...
# Subtest: project-local junctions cannot expose or create protected Git and credential files
ok 252 - project-local junctions cannot expose or create protected Git and credential files
---
duration_ms: 644.2935
type: 'test'
...
# Subtest: Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
ok 253 - Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
---
duration_ms: 519.072
type: 'test'
...
# Subtest: a starter is copied into user data once; restarting from another program version preserves existing projects and editable bytes
ok 254 - a starter is copied into user data once; restarting from another program version preserves existing projects and editable bytes
---
duration_ms: 1142.7101
type: 'test'
...
# Subtest: startup does not insert a demo or rewrite/reorder an existing user project registry
ok 255 - startup does not insert a demo or rewrite/reorder an existing user project registry
---
duration_ms: 547.8861
type: 'test'
...
# Subtest: PNG bytes are fully decoded, metadata-free and bounded; JPEG EXIF orientation is applied to the sent PNG
ok 256 - PNG bytes are fully decoded, metadata-free and bounded; JPEG EXIF orientation is applied to the sent PNG
---
duration_ms: 107.0192
type: 'test'
...
# Subtest: forged type, short headers, CRC damage, incomplete chunks, trailing payloads, animation and dimension bombs reject
ok 257 - forged type, short headers, CRC damage, incomplete chunks, trailing payloads, animation and dimension bombs reject
---
duration_ms: 32.0888
type: 'test'
...
# Subtest: draft image ownership, withdrawal, reload and atomic Task binding retain original SHA and original bytes
ok 258 - draft image ownership, withdrawal, reload and atomic Task binding retain original SHA and original bytes
---
duration_ms: 952.2804
type: 'test'
...
# Subtest: a failed session transaction restores draft status and cannot leave a Run consuming the attachment
ok 259 - a failed session transaction restores draft status and cannot leave a Run consuming the attachment
---
duration_ms: 568.0188
type: 'test'
...
# Subtest: draft limits, duplicate selection, source changes and cross-Task association reject before dispatch
ok 260 - draft limits, duplicate selection, source changes and cross-Task association reject before dispatch
---
duration_ms: 1211.8758
type: 'test'
...
# Subtest: demo and legacy paths refuse image dispatch without creating a Task or consuming the draft
ok 261 - demo and legacy paths refuse image dispatch without creating a Task or consuming the draft
---
duration_ms: 624.205
type: 'test'
...
# Subtest: chat-completions sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
ok 262 - chat-completions sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
---
duration_ms: 2013.9516
type: 'test'
...
# Subtest: responses sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
ok 263 - responses sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
---
duration_ms: 1691.5252
type: 'test'
...
# Subtest: mixed pool excludes unknown vision before lease and sends zero HTTP to the incompatible member
ok 264 - mixed pool excludes unknown vision before lease and sends zero HTTP to the incompatible member
---
duration_ms: 1612.3576
type: 'test'
...
# Subtest: vision probe requires correct randomized pixel order and evidence expires when the connection revision changes
ok 265 - vision probe requires correct randomized pixel order and evidence expires when the connection revision changes
---
duration_ms: 861.2068
type: 'test'
...
# Subtest: HTTP upload/read/withdraw uses session authorization, returns byte SHA and refuses unknown ownership
ok 266 - HTTP upload/read/withdraw uses session authorization, returns byte SHA and refuses unknown ownership
---
duration_ms: 963.1255
type: 'test'
...
# Subtest: image accounting excludes Base64 as text but seals every original request byte and reserves image input separately
ok 267 - image accounting excludes Base64 as text but seals every original request byte and reserves image input separately
---
duration_ms: 3.3657
type: 'test'
...
# Subtest: MCP registration stays disabled until an explicit real stdio probe and schema-based tool selection, with actual process cleanup
ok 268 - MCP registration stays disabled until an explicit real stdio probe and schema-based tool selection, with actual process cleanup
---
duration_ms: 2015.4182
type: 'test'
...
# Subtest: MCP probe holds the project operation lock until its owned process and report are settled
ok 269 - MCP probe holds the project operation lock until its owned process and report are settled
---
duration_ms: 1545.8374
type: 'test'
...
# Subtest: MCP validates the declared JSON schema subset and rejects unsupported schemas before external dispatch
ok 270 - MCP validates the declared JSON schema subset and rejects unsupported schemas before external dispatch
---
duration_ms: 0.7806
type: 'test'
...
# Subtest: actual model MCP call approves long schema-valid arguments, validates the sent catalog and stores one original result without leaking environment secrets
ok 271 - actual model MCP call approves long schema-valid arguments, validates the sent catalog and stores one original result without leaking environment secrets
---
duration_ms: 3825.1706
type: 'test'
...
# Subtest: denying an MCP call never starts another process or executes the external tool
ok 272 - denying an MCP call never starts another process or executes the external tool
---
duration_ms: 2888.9986
type: 'test'
...
# Subtest: actual handshake drift rejects tools/call even if program entry hash is unchanged
ok 273 - actual handshake drift rejects tools/call even if program entry hash is unchanged
---
duration_ms: 3756.5515
type: 'test'
...
# Subtest: cancelled dispatched external side effect stays unknown, closes its owned process and cannot replay on reopen
ok 274 - cancelled dispatched external side effect stays unknown, closes its owned process and cannot replay on reopen
---
duration_ms: 4639.0782
type: 'test'
...
# Subtest: changed executable input, foreign project IDs and corrupted original contracts block enable and dispatch
ok 275 - changed executable input, foreign project IDs and corrupted original contracts block enable and dispatch
---
duration_ms: 1859.3294
type: 'test'
...
# Subtest: registered MCP HTTP API uses fixed execution contracts and project-owned probe records with no model requests
ok 276 - registered MCP HTTP API uses fixed execution contracts and project-owned probe records with no model requests
---
duration_ms: 4062.6919
type: 'test'
...
# Subtest: unknown MCP pauses later tool calls and all project writers; fingerprinted acknowledgement clears only the review gates and explicit resume does not replay
ok 277 - unknown MCP pauses later tool calls and all project writers; fingerprinted acknowledgement clears only the review gates and explicit resume does not replay
---
duration_ms: 4863.2388
type: 'test'
...
# Subtest: MCP acknowledgement persistence failure restores both job and tool review gates; corrupt evidence cannot be acknowledged
ok 278 - MCP acknowledgement persistence failure restores both job and tool review gates; corrupt evidence cannot be acknowledged
---
duration_ms: 4142.6781
type: 'test'
...
# Subtest: actual host exit after an external effect restores unknown jobs without a fabricated report, allows source-bound review and never replays the call
ok 279 - actual host exit after an external effect restores unknown jobs without a fabricated report, allows source-bound review and never replays the call
---
duration_ms: 3061.2875
type: 'test'
...
# Subtest: changed enabled MCP programs can be explicitly disabled without launching or trusting their changed source
ok 280 - changed enabled MCP programs can be explicitly disabled without launching or trusting their changed source
---
duration_ms: 1798.4579
type: 'test'
...
# Subtest: stdio preserves split UTF-8 frames and final replies drained after process exit
ok 281 - stdio preserves split UTF-8 frames and final replies drained after process exit
---
duration_ms: 1756.8954
type: 'test'
...
# Subtest: server-initiated model requests are refused instead of inheriting provider privileges
ok 282 - server-initiated model requests are refused instead of inheriting provider privileges
---
duration_ms: 963.9123
type: 'test'
...
# Subtest: invalid or over-budget protocol invalid closes only its owned process and is not retried
ok 283 - invalid or over-budget protocol invalid closes only its owned process and is not retried
---
duration_ms: 818.0337
type: 'test'
...
# Subtest: invalid or over-budget protocol oversized closes only its owned process and is not retried
ok 284 - invalid or over-budget protocol oversized closes only its owned process and is not retried
---
duration_ms: 893.7892
type: 'test'
...
# Subtest: cancel and timeout do not resend a dispatched request and pre-cancel has no request trace
ok 285 - cancel and timeout do not resend a dispatched request and pre-cancel has no request trace
---
duration_ms: 913.2134
type: 'test'
...
# Subtest: startup failure remains undispatched and has no process PID to terminate
ok 286 - startup failure remains undispatched and has no process PID to terminate
---
duration_ms: 461.3415
type: 'test'
...
# Subtest: REA launch filters a fixture credential canary and rejects changed entry identity before a new connection
ok 287 - REA launch filters a fixture credential canary and rejects changed entry identity before a new connection
---
duration_ms: 795.3266
type: 'test'
...
# Subtest: schema1 connections remain readable without inventing observed capabilities or migrating original state
ok 288 - schema1 connections remain readable without inventing observed capabilities or migrating original state
---
duration_ms: 627.9169
type: 'test'
...
# Subtest: protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence
ok 289 - protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence
---
duration_ms: 770.9284
type: 'test'
...
# Subtest: ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing
ok 290 - ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing
---
duration_ms: 0.2905
type: 'test'
...
# Subtest: invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate
ok 291 - invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate
---
duration_ms: 602.3245
type: 'test'
...
# Subtest: model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
ok 292 - model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
---
duration_ms: 876.5327
type: 'test'
...
# Subtest: config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
ok 293 - config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
---
duration_ms: 798.4102
type: 'test'
...
# Subtest: real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
ok 294 - real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
---
duration_ms: 2221.8719
type: 'test'
...
# Subtest: pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
ok 295 - pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
---
duration_ms: 3105.4386
type: 'test'
...
# Subtest: 401 blocks the credential revision; updating the key restores availability without leaking error echoes
ok 296 - 401 blocks the credential revision; updating the key restores availability without leaking error echoes
---
duration_ms: 1120.6132
type: 'test'
...
# Subtest: queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
ok 297 - queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
---
duration_ms: 759.2013
type: 'test'
...
# Subtest: compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
ok 298 - compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
---
duration_ms: 2129.7195
type: 'test'
...
# Subtest: model registry disk failures restore routing, pool profiles and credential references without partial updates
ok 299 - model registry disk failures restore routing, pool profiles and credential references without partial updates
---
duration_ms: 701.3637
type: 'test'
...
# Subtest: model selection and saved configuration commit together and failures preserve the original mode and endpoint
ok 300 - model selection and saved configuration commit together and failures preserve the original mode and endpoint
---
duration_ms: 640.9852
type: 'test'
...
# Subtest: configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
ok 301 - configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
---
duration_ms: 715.0677
type: 'test'
...
# Subtest: saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
ok 302 - saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
---
duration_ms: 862.8933
type: 'test'
...
# Subtest: owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
ok 303 - owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
---
duration_ms: 1036.475
type: 'test'
...
# Subtest: Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
ok 304 - Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
---
duration_ms: 2418.5518
type: 'test'
...
# Subtest: mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
ok 305 - mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
---
duration_ms: 2616.5086
type: 'test'
...
# Subtest: Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
# Subtest: Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
ok 1 - Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
---
duration_ms: 1382.0469
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
ok 2 - Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
---
duration_ms: 1198.5267
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
ok 3 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
---
duration_ms: 1367.386
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
ok 4 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
---
duration_ms: 1280.8272
type: 'test'
...
1..4
ok 306 - Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
---
duration_ms: 5229.6266
type: 'test'
...
# Subtest: invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
# Subtest: chat-completions
ok 1 - chat-completions
---
duration_ms: 1267.1376
type: 'test'
...
# Subtest: responses
ok 2 - responses
---
duration_ms: 1303.8964
type: 'test'
...
1..2
ok 307 - invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
---
duration_ms: 2571.5377
type: 'test'
...
# Subtest: wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
ok 308 - wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
---
duration_ms: 0.2653
type: 'test'
...
# Subtest: connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
ok 309 - connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
---
duration_ms: 636.0881
type: 'test'
...
# Subtest: capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
ok 310 - capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
---
duration_ms: 1346.7323
type: 'test'
...
# Subtest: all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
ok 311 - all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
---
duration_ms: 1148.7805
type: 'test'
...
# Subtest: explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
ok 312 - explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
---
duration_ms: 748.2043
type: 'test'
...
# Subtest: plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
ok 313 - plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
---
duration_ms: 748.8076
type: 'test'
...
# Subtest: a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
ok 314 - a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
---
duration_ms: 779.018
type: 'test'
...
# Subtest: HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
ok 315 - HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
---
duration_ms: 2280.6429
type: 'test'
...
# Subtest: real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
ok 316 - real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
---
duration_ms: 2523.8894
type: 'test'
...
# Subtest: Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
ok 317 - Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
---
duration_ms: 2966.6195
type: 'test'
...
# Subtest: incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
ok 318 - incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
---
duration_ms: 1632.7357
type: 'test'
...
# Subtest: stopping an active HTTP stream closes only original request and keeps partial text without executing tools
ok 319 - stopping an active HTTP stream closes only original request and keeps partial text without executing tools
---
duration_ms: 1513.4859
type: 'test'
...
# Subtest: explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
ok 320 - explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
---
duration_ms: 777.199
type: 'test'
...
# Subtest: coalesced initial SSE events publish the latest partial state even when the upstream stays idle
ok 321 - coalesced initial SSE events publish the latest partial state even when the upstream stays idle
---
duration_ms: 1447.617
type: 'test'
...
# Subtest: stream timeout closes the original HTTP response, preserves redacted capture and never retries
ok 322 - stream timeout closes the original HTTP response, preserves redacted capture and never retries
---
duration_ms: 849.8524
type: 'test'
...
# Subtest: SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
ok 323 - SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
---
duration_ms: 0.7894
type: 'test'
...
# Subtest: stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
# Subtest: reject 0
ok 1 - reject 0
---
duration_ms: 0.1915
type: 'test'
...
# Subtest: reject 1
ok 2 - reject 1
---
duration_ms: 0.1724
type: 'test'
...
# Subtest: reject 2
ok 3 - reject 2
---
duration_ms: 0.1684
type: 'test'
...
# Subtest: reject 3
ok 4 - reject 3
---
duration_ms: 5.0529
type: 'test'
...
# Subtest: reject 4
ok 5 - reject 4
---
duration_ms: 0.1462
type: 'test'
...
# Subtest: reject 5
ok 6 - reject 5
---
duration_ms: 0.1445
type: 'test'
...
1..6
ok 324 - stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
---
duration_ms: 6.3814
type: 'test'
...
# Subtest: paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
ok 325 - paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
---
duration_ms: 3250.9848
type: 'test'
...
# Subtest: inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
ok 326 - inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
---
duration_ms: 674.7081
type: 'test'
...
# Subtest: exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
ok 327 - exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
---
duration_ms: 684.6684
type: 'test'
...
# Subtest: several patches are matched against one original snapshot in any input order and keep LF
ok 328 - several patches are matched against one original snapshot in any input order and keep LF
---
duration_ms: 608.838
type: 'test'
...
# Subtest: mixed line endings require exact anchors and preserve untouched formatting
ok 329 - mixed line endings require exact anchors and preserve untouched formatting
---
duration_ms: 639.7146
type: 'test'
...
# Subtest: ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
ok 330 - ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
---
duration_ms: 584.8577
type: 'test'
...
# Subtest: stale original hashes and changes before apply preserve owner edits and mark conflicts
ok 331 - stale original hashes and changes before apply preserve owner edits and mark conflicts
---
duration_ms: 714.7784
type: 'test'
...
# Subtest: no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
ok 332 - no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
---
duration_ms: 494.7513
type: 'test'
...
# Subtest: an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
ok 333 - an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
---
duration_ms: 890.9105
type: 'test'
...
# Subtest: real npm tests and build do not inherit arbitrary host credentials or Node injection settings
ok 334 - real npm tests and build do not inherit arbitrary host credentials or Node injection settings
---
duration_ms: 1849.2851
type: 'test'
...
# Subtest: real Python tests and compilation keep their sealed inputs without host credentials
ok 335 - real Python tests and compilation keep their sealed inputs without host credentials
---
duration_ms: 2403.3372
type: 'test'
...
# Subtest: cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
ok 336 - cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
---
duration_ms: 2295.8319
type: 'test'
...
# Subtest: cache enablement and derived reuse survive a real host restart without becoming task recovery state
ok 337 - cache enablement and derived reuse survive a real host restart without becoming task recovery state
---
duration_ms: 4130.3056
type: 'test'
...
# Subtest: persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
ok 338 - persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
---
duration_ms: 897.5851
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'main.ts', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'value.ts', LF will be replaced by CRLF the next time Git touches it
# Subtest: same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
ok 339 - same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
---
duration_ms: 800.3103
type: 'test'
...
# Switched to a new branch 'other'
# Subtest: branch and commit changes invalidate even byte-identical sources
ok 340 - branch and commit changes invalidate even byte-identical sources
---
duration_ms: 2245.0971
type: 'test'
...
# Subtest: corrupt, malformed and schema-invalid records fall back to fresh parsing
ok 341 - corrupt, malformed and schema-invalid records fall back to fresh parsing
---
duration_ms: 748.2439
type: 'test'
...
# Subtest: disable and clear persist without touching sources, sessions, configuration or original artifacts
ok 342 - disable and clear persist without touching sources, sessions, configuration or original artifacts
---
duration_ms: 712.8851
type: 'test'
...
# Subtest: cache capacity bounds disk and memory by bytes and LRU project count
ok 343 - cache capacity bounds disk and memory by bytes and LRU project count
---
duration_ms: 835.9047
type: 'test'
...
# Subtest: incomplete scans do not load or save cached entries; unavailable files leave the current result scope
ok 344 - incomplete scans do not load or save cached entries; unavailable files leave the current result scope
---
duration_ms: 868.7662
type: 'test'
...
# Subtest: project and cache junctions cannot expose or delete an outside directory
ok 345 - project and cache junctions cannot expose or delete an outside directory
---
duration_ms: 950.505
type: 'test'
...
# Subtest: concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
ok 346 - concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
---
duration_ms: 1099.0246
type: 'test'
...
# Subtest: file access mode changes invalidate parsed material even when bytes are unchanged
ok 347 - file access mode changes invalidate parsed material even when bytes are unchanged
---
duration_ms: 981.4911
type: 'test'
...
# Subtest: tracked directory replaced by a junction invalidates access scope and never uses its old cache
ok 348 - tracked directory replaced by a junction invalidates access scope and never uses its old cache
---
duration_ms: 2198.3065
type: 'test'
...
# Subtest: JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
ok 349 - JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
---
duration_ms: 818.4535
type: 'test'
...
# Subtest: default expressions, named default exports and declared functions retain their AST evidence
ok 350 - default expressions, named default exports and declared functions retain their AST evidence
---
duration_ms: 851.6269
type: 'test'
...
# Subtest: incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
ok 351 - incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
---
duration_ms: 1221.1255
type: 'test'
...
# Subtest: Python candidates exclude comments and multiline strings and declare limited evidence
ok 352 - Python candidates exclude comments and multiline strings and declare limited evidence
---
duration_ms: 879.2647
type: 'test'
...
# Subtest: indexes isolate project identity and root and evict bounded caches without sharing results
ok 353 - indexes isolate project identity and root and evict bounded caches without sharing results
---
duration_ms: 950.6296
type: 'test'
...
# Subtest: Git ignore, credential paths and links stay outside the index and no project files are executed
ok 354 - Git ignore, credential paths and links stay outside the index and no project files are executed
---
duration_ms: 1694.3286
type: 'test'
...
# Subtest: malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
ok 355 - malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
---
duration_ms: 799.7949
type: 'test'
...
# Subtest: index query rejects invalid limits/types and does not imply reference or alias resolution
ok 356 - index query rejects invalid limits/types and does not imply reference or alias resolution
---
duration_ms: 736.9894
type: 'test'
...
# Subtest: read-only engineering inspection disables configured Git clean filters and preserves index bytes
ok 357 - read-only engineering inspection disables configured Git clean filters and preserves index bytes
---
duration_ms: 2223.9577
type: 'test'
...
# Subtest: Python multiline declarations retain candidate scope without interpreting expressions as declarations
ok 358 - Python multiline declarations retain candidate scope without interpreting expressions as declarations
---
duration_ms: 717.0452
type: 'test'
...
# Subtest: TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
ok 359 - TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
---
duration_ms: 706.5296
type: 'test'
...
# Subtest: actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
ok 360 - actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
---
duration_ms: 2380.3231
type: 'test'
...
# Subtest: actual HTTP request excludes archived, timed-out and foreign-project memories
ok 361 - actual HTTP request excludes archived, timed-out and foreign-project memories
---
duration_ms: 3192.317
type: 'test'
...
# Subtest: actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
ok 362 - actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
---
duration_ms: 2815.8639
type: 'test'
...
# Subtest: incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
ok 363 - incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
---
duration_ms: 2413.4683
type: 'test'
...
# Subtest: corrupt original artifact expires its memory and cannot reach an HTTP model request
ok 364 - corrupt original artifact expires its memory and cannot reach an HTTP model request
---
duration_ms: 1824.3655
type: 'test'
...
# Subtest: memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
ok 365 - memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
---
duration_ms: 3067.1861
type: 'test'
...
# Subtest: optional memory yields to the complete goal and original code evidence under the whole-request budget
ok 366 - optional memory yields to the complete goal and original code evidence under the whole-request budget
---
duration_ms: 1242.073
type: 'test'
...
# Subtest: changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
ok 367 - changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
---
duration_ms: 1589.8134
type: 'test'
...
# Subtest: a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
ok 368 - a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
---
duration_ms: 1717.2615
type: 'test'
...
# Subtest: an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
ok 369 - an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
---
duration_ms: 1440.1578
type: 'test'
...
# Subtest: project memories persist across restart, keep source provenance, and are visible across tasks
ok 370 - project memories persist across restart, keep source provenance, and are visible across tasks
---
duration_ms: 1243.943
type: 'test'
...
# Subtest: source changes expire current project memories and keep the original evidence
ok 371 - source changes expire current project memories and keep the original evidence
---
duration_ms: 913.5143
type: 'test'
...
# Subtest: incomplete source scans mark current memories unverified without expiring or reusing them
ok 372 - incomplete source scans mark current memories unverified without expiring or reusing them
---
duration_ms: 1005.6857
type: 'test'
...
# Subtest: explicit file provenance is rechecked even when the inventory excludes that path
ok 373 - explicit file provenance is rechecked even when the inventory excludes that path
---
duration_ms: 1032.2696
type: 'test'
...
# Subtest: execution snapshots do not expose project memories before their source scope is validated
ok 374 - execution snapshots do not expose project memories before their source scope is validated
---
duration_ms: 746.7342
type: 'test'
...
# Subtest: project memory records stay isolated and archive requires the owning session
ok 375 - project memory records stay isolated and archive requires the owning session
---
duration_ms: 823.9966
type: 'test'
...
# Subtest: project memory HTTP API exposes read-only source status and explicit writes
ok 376 - project memory HTTP API exposes read-only source status and explicit writes
---
duration_ms: 2677.3248
type: 'test'
...
# Subtest: two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
ok 377 - two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
---
duration_ms: 722.6714
type: 'test'
...
# Subtest: incomplete, unsupported, relative and oversized sources cannot enable the experiment
ok 378 - incomplete, unsupported, relative and oversized sources cannot enable the experiment
---
duration_ms: 793.7103
type: 'test'
...
# Subtest: invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
ok 379 - invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
---
duration_ms: 2968.2235
type: 'test'
...
# Subtest: source edits between detection and plan are rejected without creating a parent Task
ok 380 - source edits between detection and plan are rejected without creating a parent Task
---
duration_ms: 2374.0441
type: 'test'
...
# Subtest: source edits after sealing cannot launch a child and do not reset its cumulative budget
ok 381 - source edits after sealing cannot launch a child and do not reset its cumulative budget
---
duration_ms: 10200.0333
type: 'test'
...
# Subtest: literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
ok 382 - literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
---
duration_ms: 26855.9774
type: 'test'
...
# Subtest: source changes after a model response stop before any native tool is accepted, retaining the actual usage once
ok 383 - source changes after a model response stop before any native tool is accepted, retaining the actual usage once
---
duration_ms: 11681.719
type: 'test'
...
# Subtest: source changes while approval is pending invalidate the old permission before an engineering check starts
ok 384 - source changes while approval is pending invalidate the old permission before an engineering check starts
---
duration_ms: 15175.0974
type: 'test'
...
# Subtest: altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
ok 385 - altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
---
duration_ms: 2048.8314
type: 'test'
...
# Subtest: the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
ok 386 - the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
---
duration_ms: 2105.3533
type: 'test'
...
# Subtest: a missing or duplicated experimental section in the actual input is rejected before any model dispatch
ok 387 - a missing or duplicated experimental section in the actual input is rejected before any model dispatch
---
duration_ms: 21034.3943
type: 'test'
...
# Subtest: experimental prompt overhead still participates in the original complete-input budget guard
ok 388 - experimental prompt overhead still participates in the original complete-input budget guard
---
duration_ms: 10396.2401
type: 'test'
...
# Subtest: source detection HTTP remains local-authenticated and read-only with no configured model requests
ok 389 - source detection HTTP remains local-authenticated and read-only with no configured model requests
---
duration_ms: 2020.2386
type: 'test'
...
# Subtest: Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
ok 390 - Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
---
duration_ms: 9109.7869
type: 'test'
...
# Subtest: an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
ok 391 - an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
---
duration_ms: 36088.0048
type: 'test'
...
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
ok 392 - Python static inspection does not import project code or probe a project interpreter before approval
---
duration_ms: 884.447
type: 'test'
...
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
ok 393 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
---
duration_ms: 4424.1112
type: 'test'
...
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
ok 394 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
---
duration_ms: 2782.1467
type: 'test'
...
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
ok 395 - unittest empty, skipped, expected failure and class initialization errors never verify a task
---
duration_ms: 7138.7571
type: 'test'
...
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
ok 396 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
---
duration_ms: 2887.2062
type: 'test'
...
# Subtest: compilation reads actual Python source bytes without executing top-level project code
ok 397 - compilation reads actual Python source bytes without executing top-level project code
---
duration_ms: 2885.1619
type: 'test'
...
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
ok 398 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
---
duration_ms: 2491.9368
type: 'test'
...
# Subtest: changed project interpreters and forged Python plan bindings execute no check
ok 399 - changed project interpreters and forged Python plan bindings execute no check
---
duration_ms: 1471.2887
type: 'test'
...
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
ok 400 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
---
duration_ms: 1111.1621
type: 'test'
...
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
ok 401 - stopping a real Python check terminates its child and keeps the completed result as cancelled
---
duration_ms: 1684.1114
type: 'test'
...
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
ok 402 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
---
duration_ms: 13571.2851
type: 'test'
...
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
ok 403 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
---
duration_ms: 10551.5645
type: 'test'
...
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
ok 404 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
---
duration_ms: 2259.0517
type: 'test'
...
# Subtest: continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
ok 405 - continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
---
duration_ms: 2.5871
type: 'test'
...
# Subtest: a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
ok 406 - a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
---
duration_ms: 0.6222
type: 'test'
...
# Subtest: budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
ok 407 - budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
---
duration_ms: 9.2567
type: 'test'
...
# Subtest: known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
ok 408 - known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
---
duration_ms: 0.325
type: 'test'
...
# Subtest: actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
ok 409 - actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
---
duration_ms: 4169.2414
type: 'test'
...
# Subtest: a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
ok 410 - a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
---
duration_ms: 4734.9107
type: 'test'
...
# Subtest: actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
ok 411 - actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
---
duration_ms: 5432.3444
type: 'test'
...
# Subtest: an installed app outside the source drive resolves registered SDK and Purge through actual input verification
ok 412 - an installed app outside the source drive resolves registered SDK and Purge through actual input verification
---
duration_ms: 728.1933
type: 'test'
...
# Subtest: standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
ok 413 - standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
---
duration_ms: 723.036
type: 'test'
...
# Subtest: registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
ok 414 - registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
---
duration_ms: 731.5773
type: 'test'
...
# Subtest: unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
ok 415 - unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
---
duration_ms: 578.4477
type: 'test'
...
# Subtest: oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
ok 416 - oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
---
duration_ms: 635.0926
type: 'test'
...
# Subtest: a linked registry directory is rejected without reading or deleting its external source
ok 417 - a linked registry directory is rejected without reading or deleting its external source
---
duration_ms: 740.9635
type: 'test'
...
# Subtest: matching research declarations do not replace actual installed version and critical-source checks
ok 418 - matching research declarations do not replace actual installed version and critical-source checks
---
duration_ms: 667.9362
type: 'test'
...
# Subtest: context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
ok 419 - context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
---
duration_ms: 3499.0654
type: 'test'
...
# Subtest: delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
ok 420 - delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
---
duration_ms: 2582.479
type: 'test'
...
# Subtest: direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
ok 421 - direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
---
duration_ms: 2054.5433
type: 'test'
...
# Subtest: one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
ok 422 - one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
---
duration_ms: 4951.881
type: 'test'
...
# Subtest: tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
ok 423 - tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
---
duration_ms: 873.9308
type: 'test'
...
# Subtest: oversized required user instructions pause intact and can be explicitly resumed after increasing the window
ok 424 - oversized required user instructions pause intact and can be explicitly resumed after increasing the window
---
duration_ms: 1887.4306
type: 'test'
...
# Subtest: all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
ok 425 - all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
---
duration_ms: 1528.0245
type: 'test'
...
# Subtest: a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
ok 426 - a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
---
duration_ms: 1295.0362
type: 'test'
...
# Subtest: invalid orphan result is rejected before archive or network preparation
ok 427 - invalid orphan result is rejected before archive or network preparation
---
duration_ms: 664.4984
type: 'test'
...
# Subtest: invalid missing result is rejected before archive or network preparation
ok 428 - invalid missing result is rejected before archive or network preparation
---
duration_ms: 972.1447
type: 'test'
...
# Subtest: invalid wrong result is rejected before archive or network preparation
ok 429 - invalid wrong result is rejected before archive or network preparation
---
duration_ms: 748.0496
type: 'test'
...
# Subtest: invalid duplicate call is rejected before archive or network preparation
ok 430 - invalid duplicate call is rejected before archive or network preparation
---
duration_ms: 774.0671
type: 'test'
...
# Subtest: a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
ok 431 - a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
---
duration_ms: 2267.3353
type: 'test'
...
# Subtest: changed or missing archived evidence stops reuse and is never silently recreated
ok 432 - changed or missing archived evidence stops reuse and is never silently recreated
---
duration_ms: 1087.6305
type: 'test'
...
# Subtest: transaction failure prevents publishing a plan and any corresponding model request
ok 433 - transaction failure prevents publishing a plan and any corresponding model request
---
duration_ms: 1102.8263
type: 'test'
...
# Subtest: the Provider rejects body mutation after a sealed plan before calling HTTP
ok 434 - the Provider rejects body mutation after a sealed plan before calling HTTP
---
duration_ms: 858.2279
type: 'test'
...
# Subtest: HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
ok 435 - HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
---
duration_ms: 8645.8909
type: 'test'
...
# Subtest: a real process exit after plan persistence marks interruption and never issues an automatic model request
ok 436 - a real process exit after plan persistence marks interruption and never issues an automatic model request
---
duration_ms: 1671.4244
type: 'test'
...
# Subtest: deep Windows data directories keep REA output within the external path allowance and retain owned evidence
ok 437 - deep Windows data directories keep REA output within the external path allowance and retain owned evidence
---
duration_ms: 2532.8215
type: 'test'
...
# Subtest: user research registration creates an owned Task without model requests and seals the exact artifact identity
ok 438 - user research registration creates an owned Task without model requests and seals the exact artifact identity
---
duration_ms: 1026.3801
type: 'test'
...
# Subtest: complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
ok 439 - complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
---
duration_ms: 2399.616
type: 'test'
...
# Subtest: artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
ok 440 - artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
---
duration_ms: 2966.3137
type: 'test'
...
# Subtest: owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
ok 441 - owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
---
duration_ms: 2306.6657
type: 'test'
...
# Subtest: a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
ok 442 - a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
---
duration_ms: 1905.2408
type: 'test'
...
# Subtest: corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
ok 443 - corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
---
duration_ms: 1982.1291
type: 'test'
...
# Subtest: research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
ok 444 - research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
---
duration_ms: 1440.3834
type: 'test'
...
# Subtest: research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
ok 445 - research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
---
duration_ms: 4736.36
type: 'test'
...
# Subtest: file identity rejects directory and invalid formats without running a target
ok 446 - file identity rejects directory and invalid formats without running a target
---
duration_ms: 780.9083
type: 'test'
...
# Subtest: a stop from the event loop interrupts immediate model replies before later tools
ok 447 - a stop from the event loop interrupts immediate model replies before later tools
---
duration_ms: 1934.5825
type: 'test'
...
# Subtest: a stop after the first tool preserves a complete interrupted multi-call protocol group
ok 448 - a stop after the first tool preserves a complete interrupted multi-call protocol group
---
duration_ms: 1843.4615
type: 'test'
...
# Subtest: the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
ok 449 - the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
---
duration_ms: 5753.574
type: 'test'
...
# Subtest: denial prevents command execution and produces a paired denied result
ok 450 - denial prevents command execution and produces a paired denied result
---
duration_ms: 2042.891
type: 'test'
...
# Subtest: stopping during approval interrupts pending calls without executing or replaying them
ok 451 - stopping during approval interrupts pending calls without executing or replaying them
---
duration_ms: 2167.2031
type: 'test'
...
# Subtest: stopping a running fixture command terminates its own process tree and retains uncertain state
ok 452 - stopping a running fixture command terminates its own process tree and retains uncertain state
---
duration_ms: 2455.4622
type: 'test'
...
# Subtest: command output decodes split UTF-8 and excludes the workbench key from child environment
ok 453 - command output decodes split UTF-8 and excludes the workbench key from child environment
---
duration_ms: 1549.9241
type: 'test'
...
# Subtest: model-list testing uses a tentative key without changing the saved connection and redacts service errors
ok 454 - model-list testing uses a tentative key without changing the saved connection and redacts service errors
---
duration_ms: 6.9952
type: 'test'
...
# Subtest: truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
ok 455 - truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
---
duration_ms: 3081.5181
type: 'test'
...
# Subtest: request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
ok 456 - request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
---
duration_ms: 1534.8047
type: 'test'
...
# Subtest: local skill revisions require explicit enable, retain original text, survive restart and stay within the selected project
ok 457 - local skill revisions require explicit enable, retain original text, survive restart and stay within the selected project
---
duration_ms: 1101.0049
type: 'test'
...
# Subtest: registration rejects non-SKILL paths, oversized/non-UTF8 files, duplicate sources and wrong field shapes without running project code
ok 458 - registration rejects non-SKILL paths, oversized/non-UTF8 files, duplicate sources and wrong field shapes without running project code
---
duration_ms: 806.412
type: 'test'
...
# Subtest: actual HTTP models receive only enabled current-project metadata, then a redacted owned skill page with complete tool pairing
ok 459 - actual HTTP models receive only enabled current-project metadata, then a redacted owned skill page with complete tool pairing
---
duration_ms: 3131.1873
type: 'test'
...
# Subtest: source edits after a catalog request prevent the read and appear as changed on the next request without replay
ok 460 - source edits after a catalog request prevent the read and appear as changed on the next request without replay
---
duration_ms: 3133.1778
type: 'test'
...
# Subtest: disabled and foreign skills cannot be read by guessing their IDs from another project
ok 461 - disabled and foreign skills cannot be read by guessing their IDs from another project
---
duration_ms: 2546.9367
type: 'test'
...
# Subtest: skill catalog takes remaining escaped JSON budget and cannot evict the user goal or current code
ok 462 - skill catalog takes remaining escaped JSON budget and cannot evict the user goal or current code
---
duration_ms: 1501.9032
type: 'test'
...
# Subtest: multilingual skill body pages fit actual tool JSON bytes and every page uses the same immutable artifact
ok 463 - multilingual skill body pages fit actual tool JSON bytes and every page uses the same immutable artifact
---
duration_ms: 3879.0239
type: 'test'
...
# Subtest: registry failures roll back enable and refresh state; corrupted snapshots block requests before network
ok 464 - registry failures roll back enable and refresh state; corrupted snapshots block requests before network
---
duration_ms: 1424.473
type: 'test'
...
# Subtest: saved skill catalogs retain SHA-bound historical evidence and reject corrupt catalog blobs
ok 465 - saved skill catalogs retain SHA-bound historical evidence and reject corrupt catalog blobs
---
duration_ms: 2142.3348
type: 'test'
...
# Subtest: HTTP skill administration enforces project scope, revision checks and idle mutation without model calls
ok 466 - HTTP skill administration enforces project scope, revision checks and idle mutation without model calls
---
duration_ms: 3385.0151
type: 'test'
...
# Subtest: JSON state keeps an atomic backup and preserves corrupt primary files
ok 467 - JSON state keeps an atomic backup and preserves corrupt primary files
---
duration_ms: 691.8914
type: 'test'
...
# Subtest: tool-pair recovery fills missing results and drops orphan or duplicate results
ok 468 - tool-pair recovery fills missing results and drops orphan or duplicate results
---
duration_ms: 0.351
type: 'test'
...
# Subtest: restart pauses unfinished work, retains proposals and never replays a command
ok 469 - restart pauses unfinished work, retains proposals and never replays a command
---
duration_ms: 792.2708
type: 'test'
...
# Subtest: public snapshots carry increasing revisions without the private provider transcript or config key
ok 470 - public snapshots carry increasing revisions without the private provider transcript or config key
---
duration_ms: 1133.0766
type: 'test'
...
# Subtest: a checkpoint seals all task requirements and original results without a model request and explicit continuation keeps the same Task without replay
ok 471 - a checkpoint seals all task requirements and original results without a model request and explicit continuation keeps the same Task without replay
---
duration_ms: 3568.4407
type: 'test'
...
# Subtest: checkpoint sources, requirements, plan and original tool changes block continuation and leave original checkpoint bytes intact
ok 472 - checkpoint sources, requirements, plan and original tool changes block continuation and leave original checkpoint bytes intact
---
duration_ms: 3016.7901
type: 'test'
...
# Subtest: unknown tool effects and pending proposals stay blocked in recovery packages rather than being changed into completed work
ok 473 - unknown tool effects and pending proposals stay blocked in recovery packages rather than being changed into completed work
---
duration_ms: 2409.6617
type: 'test'
...
# Subtest: checkpoint and referenced result corruption are rejected before dispatch and historical blobs are never rebuilt
ok 474 - checkpoint and referenced result corruption are rejected before dispatch and historical blobs are never rebuilt
---
duration_ms: 2411.3863
type: 'test'
...
# Subtest: checkpoint ownership, exact confirmation and concurrent operations reject foreign or stale resumes
ok 475 - checkpoint ownership, exact confirmation and concurrent operations reject foreign or stale resumes
---
duration_ms: 2446.1894
type: 'test'
...
# Subtest: Git identity changes and altered plan proofs cannot be accepted as the sealed recovery state
ok 476 - Git identity changes and altered plan proofs cannot be accepted as the sealed recovery state
---
duration_ms: 3465.3644
type: 'test'
...
# Subtest: checkpoint records survive SQLite reopen and do not trigger automatic model or tool replay
ok 477 - checkpoint records survive SQLite reopen and do not trigger automatic model or tool replay
---
duration_ms: 2997.3459
type: 'test'
...
# Subtest: incomplete scans and in-progress project activity refuse checkpoint creation while private credentials are redacted from saved requirements
ok 478 - incomplete scans and in-progress project activity refuse checkpoint creation while private credentials are redacted from saved requirements
---
duration_ms: 2784.4914
type: 'test'
...
# Subtest: oversized recovery evidence is refused before reading or publishing the checkpoint
ok 479 - oversized recovery evidence is refused before reading or publishing the checkpoint
---
duration_ms: 2021.7221
type: 'test'
...
# Subtest: compiled checkpoint HTTP APIs bind current Task/Run, isolate sessions and only resume on an explicit matching confirmation
ok 480 - compiled checkpoint HTTP APIs bind current Task/Run, isolate sessions and only resume on an explicit matching confirmation
---
duration_ms: 5658.1727
type: 'test'
...
# Subtest: actual process exit before checkpoint commit retains only durable records without replay
ok 481 - actual process exit before checkpoint commit retains only durable records without replay
---
duration_ms: 2085.2928
type: 'test'
...
# Subtest: actual process exit after checkpoint commit retains only durable records without replay
ok 482 - actual process exit after checkpoint commit retains only durable records without replay
---
duration_ms: 2377.2108
type: 'test'
...
# Subtest: task-plan HTTP mutations bind current Task/Run and retain original evidence through real host restart
ok 483 - task-plan HTTP mutations bind current Task/Run and retain original evidence through real host restart
---
duration_ms: 5018.2008
type: 'test'
...
# Subtest: concurrent stale HTTP plan revisions cannot replace conditions or attach proofs to a different plan
ok 484 - concurrent stale HTTP plan revisions cannot replace conditions or attach proofs to a different plan
---
duration_ms: 3054.2693
type: 'test'
...
# Subtest: a real escaped long-file tool message keeps its proof identity within a tight request budget
ok 485 - a real escaped long-file tool message keeps its proof identity within a tight request budget
---
duration_ms: 1379.8555
type: 'test'
...
# Subtest: task plans reject fabricated completion, invalid scopes and cyclic or missing dependencies
ok 486 - task plans reject fabricated completion, invalid scopes and cyclic or missing dependencies
---
duration_ms: 0.4666
type: 'test'
...
# Subtest: sealed plans retain goal, contract hash and original steps through SQLite reopen without executing tools
ok 487 - sealed plans retain goal, contract hash and original steps through SQLite reopen without executing tools
---
duration_ms: 1218.9448
type: 'test'
...
# Subtest: proofs require original owned reads, honor dependencies and reject altered invocation arguments and bytes
ok 488 - proofs require original owned reads, honor dependencies and reject altered invocation arguments and bytes
---
duration_ms: 1566.0292
type: 'test'
...
# Subtest: new user requirements invalidate current proofs and reseal the same original operations in a new revision
ok 489 - new user requirements invalidate current proofs and reseal the same original operations in a new revision
---
duration_ms: 1863.5422
type: 'test'
...
# Subtest: applied change-set evidence binds reviewed current files and invalidates dependent steps after outside edits
ok 490 - applied change-set evidence binds reviewed current files and invalidates dependent steps after outside edits
---
duration_ms: 2210.7616
type: 'test'
...
# Subtest: actual npm checks are verified by original counted logs and current source, with failure history retained
ok 491 - actual npm checks are verified by original counted logs and current source, with failure history retained
---
duration_ms: 7896.1776
type: 'test'
...
# Subtest: real desktop and mobile browser proofs bind required actions and PNGs, rejecting source changes, a later failed plan and changed builds
ok 492 - real desktop and mobile browser proofs bind required actions and PNGs, rejecting source changes, a later failed plan and changed builds
---
duration_ms: 12276.7225
type: 'test'
...
# Subtest: Git delivery blocks incomplete plans and changed preview bindings, preserving HEAD and owner index before a fresh verified commit
ok 493 - Git delivery blocks incomplete plans and changed preview bindings, preserving HEAD and owner index before a fresh verified commit
---
duration_ms: 13471.7178
type: 'test'
...
# Subtest: the runtime supplies owned read IDs and completes a plan only after original step evidence verification
ok 494 - the runtime supplies owned read IDs and completes a plan only after original step evidence verification
---
duration_ms: 3262.9543
type: 'test'
...
# Subtest: premature model completion pauses the original Task and resume preserves the existing plan without replay
ok 495 - premature model completion pauses the original Task and resume preserves the existing plan without replay
---
duration_ms: 3455.4947
type: 'test'
...
# Subtest: plan operations participate in project activity and orderly shutdown
ok 496 - plan operations participate in project activity and orderly shutdown
---
duration_ms: 616.534
type: 'test'
...
# Subtest: actual process exit before plan save restores only committed plan evidence without replay
ok 497 - actual process exit before plan save restores only committed plan evidence without replay
---
duration_ms: 1318.8112
type: 'test'
...
# Subtest: actual process exit after plan save restores only committed plan evidence without replay
ok 498 - actual process exit after plan save restores only committed plan evidence without replay
---
duration_ms: 2195.0285
type: 'test'
...
# Subtest: actual process exit before proof save restores only committed plan evidence without replay
ok 499 - actual process exit before proof save restores only committed plan evidence without replay
---
duration_ms: 1492.0538
type: 'test'
...
# Subtest: actual process exit after proof save restores only committed plan evidence without replay
ok 500 - actual process exit after proof save restores only committed plan evidence without replay
---
duration_ms: 1409.4014
type: 'test'
...
# Subtest: the latest oversized session result reaches the next request together with already read source modules
ok 501 - the latest oversized session result reaches the next request together with already read source modules
---
duration_ms: 2005.7544
type: 'test'
...
# Subtest: every call in a large latest group keeps its actual outcome, including denied and unknown results
ok 502 - every call in a large latest group keeps its actual outcome, including denied and unknown results
---
duration_ms: 1179.4027
type: 'test'
...
# Subtest: a small complete latest tool group is sent once and needs no duplicate feedback view
ok 503 - a small complete latest tool group is sent once and needs no duplicate feedback view
---
duration_ms: 926.1581
type: 'test'
...
# Subtest: real HTTP repeated state inspection pauses after three identical engineering outcomes and preserves tool pairing
ok 504 - real HTTP repeated state inspection pauses after three identical engineering outcomes and preserves tool pairing
---
duration_ms: 3136.3742
type: 'test'
...
# Subtest: a live SQLite host with the actual 1.9 artifact object upgrades, keeps its original blobs and verifies real browser PNG bytes
ok 505 - a live SQLite host with the actual 1.9 artifact object upgrades, keeps its original blobs and verifies real browser PNG bytes
---
duration_ms: 3756.6791
type: 'test'
...
# Subtest: failed upgrade restores the original artifact object, provider and request handler
ok 506 - failed upgrade restores the original artifact object, provider and request handler
---
duration_ms: 1645.5935
type: 'test'
...
# Subtest: claiming the same runtime owner twice preserves its original metadata and every database row
ok 507 - claiming the same runtime owner twice preserves its original metadata and every database row
---
duration_ms: 628.2254
type: 'test'
...
# Subtest: sessions without controlled-engine history retain their prior export shape and never expose another session record
ok 508 - sessions without controlled-engine history retain their prior export shape and never expose another session record
---
duration_ms: 797.999
type: 'test'
...
# Subtest: live workers, controlled drivers, or MCP operations refuse an upgrade before changing handlers, managers or database rows
ok 509 - live workers, controlled drivers, or MCP operations refuse an upgrade before changing handlers, managers or database rows
---
duration_ms: 628.0285
type: 'test'
...
# Subtest: an idle upgrade loads the newly introduced engine record map, resets obsolete managers and preserves original rows, sessions and provider objects
ok 510 - an idle upgrade loads the newly introduced engine record map, resets obsolete managers and preserves original rows, sessions and provider objects
---
duration_ms: 624.4671
type: 'test'
...
# Subtest: an installation failure restores old managers, original record maps, handlers and all existing database rows
ok 511 - an installation failure restores old managers, original record maps, handlers and all existing database rows
---
duration_ms: 1488.9584
type: 'test'
...
# Subtest: the owned controlled driver remains an active session and project even after outer task activity has ended
ok 512 - the owned controlled driver remains an active session and project even after outer task activity has ended
---
duration_ms: 701.6402
type: 'test'
...
# Subtest: release and upgrade help or invalid arguments have no file or network setup side effects in an independent directory
ok 513 - release and upgrade help or invalid arguments have no file or network setup side effects in an independent directory
---
duration_ms: 896.3168
type: 'test'
...
# Subtest: hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing
ok 514 - hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing
---
duration_ms: 1449.1652
type: 'test'
...
# Subtest: failed adoption restores the original virtual data-root name and original open database
ok 515 - failed adoption restores the original virtual data-root name and original open database
---
duration_ms: 737.14
type: 'test'
...
# Subtest: hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
ok 516 - hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
---
duration_ms: 811.738
type: 'test'
...
# Subtest: hot upgrade refuses active probes and restores retained model methods if installation fails
ok 517 - hot upgrade refuses active probes and restores retained model methods if installation fails
---
duration_ms: 804.2487
type: 'test'
...
# Subtest: a directly started compiled host upgrades twice with the same PID, sessions, applied bytes and volatile provider
ok 518 - a directly started compiled host upgrades twice with the same PID, sessions, applied bytes and volatile provider
---
duration_ms: 5345.4365
type: 'test'
...
# Subtest: the running 0.1.0 process upgrades in place and retains its project, session, files and volatile model connection
ok 519 - the running 0.1.0 process upgrades in place and retains its project, session, files and volatile model connection
---
duration_ms: 9910.5635
type: 'test'
...
# Subtest: HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
ok 520 - HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
---
duration_ms: 19967.7847
type: 'test'
...
# Subtest: HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
ok 521 - HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
---
duration_ms: 26019.9567
type: 'test'
...
# Subtest: verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
ok 522 - verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
---
duration_ms: 63007.1842
type: 'test'
...
# Subtest: overlapping worker paths are explicit conflicts even if each independent task checks successfully
ok 523 - overlapping worker paths are explicit conflicts even if each independent task checks successfully
---
duration_ms: 39898.5637
type: 'test'
...
# Subtest: source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
ok 524 - source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
---
duration_ms: 36043.7819
type: 'test'
...
# Subtest: changed child bytes after parent preview block the entire batch before any parent write
ok 525 - changed child bytes after parent preview block the entire batch before any parent write
---
duration_ms: 51681.1398
type: 'test'
...
# Subtest: corrupt original check logs cannot become collected outputs or a parent review
ok 526 - corrupt original check logs cannot become collected outputs or a parent review
---
duration_ms: 39763.6656
type: 'test'
...
# Subtest: stopping a parent accounts late responses and executes none of their proposed tools
ok 527 - stopping a parent accounts late responses and executes none of their proposed tools
---
duration_ms: 18776.9487
type: 'test'
...
# Subtest: unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
ok 528 - unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
---
duration_ms: 19823.9891
type: 'test'
...
# Subtest: a response exceeding the cumulative token allocation stops before registering or executing its tools
ok 529 - a response exceeding the cumulative token allocation stops before registering or executing its tools
---
duration_ms: 20698.2734
type: 'test'
...
# Subtest: cumulative tool allocation rejects the entire returned batch before any tool side effect
ok 530 - cumulative tool allocation rejects the entire returned batch before any tool side effect
---
duration_ms: 18580.7562
type: 'test'
...
# Subtest: single response 16 tool ceiling rejects the entire returned batch before any tool side effect
ok 531 - single response 16 tool ceiling rejects the entire returned batch before any tool side effect
---
duration_ms: 17642.1266
type: 'test'
...
# Subtest: consumed request steps remain consumed across explicit worker resumes
ok 532 - consumed request steps remain consumed across explicit worker resumes
---
duration_ms: 20105.4382
type: 'test'
...
# Subtest: a saved completed response with missing usage is conservatively accounted exactly once during recovery
ok 533 - a saved completed response with missing usage is conservatively accounted exactly once during recovery
---
duration_ms: 16040.3685
type: 'test'
...
# Subtest: an unexecuted second workspace plan resumes its original identity without recreating the first checkout
ok 534 - an unexecuted second workspace plan resumes its original identity without recreating the first checkout
---
duration_ms: 20159.4742
type: 'test'
...
# Subtest: a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
ok 535 - a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
---
duration_ms: 61539.2401
type: 'test'
...
# Subtest: recovery attaches a sealed parent batch saved before its group reference without creating another batch
ok 536 - recovery attaches a sealed parent batch saved before its group reference without creating another batch
---
duration_ms: 54362.7404
type: 'test'
...
# Subtest: explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
ok 537 - explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
---
duration_ms: 50925.6285
type: 'test'
...
# Subtest: unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
ok 538 - unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
---
duration_ms: 57040.7184
type: 'test'
...
# Subtest: after a restart the batch application lazily reinstates the worker result guard before any parent write
ok 539 - after a restart the batch application lazily reinstates the worker result guard before any parent write
---
duration_ms: 48402.5816
type: 'test'
...
# Subtest: unknown original tool inputs must match before acknowledgement, and reviewed checkpoint IDs preserve the unknown fact
ok 540 - unknown original tool inputs must match before acknowledgement, and reviewed checkpoint IDs preserve the unknown fact
---
duration_ms: 20601.9972
type: 'test'
...
# Subtest: a parent stop observes and waits for a manually approved child check and its real descendant process
ok 541 - a parent stop observes and waits for a manually approved child check and its real descendant process
---
duration_ms: 18049.7834
type: 'test'
...
# Subtest: a real host crash preserves unknown checks, refuses a still living owned PID and never replays a model or tool
ok 542 - a real host crash preserves unknown checks, refuses a still living owned PID and never replays a model or tool
---
duration_ms: 30044.799
type: 'test'
...
# Subtest: a persisted child initialization resumes the original control run after a failure before its worker record
ok 543 - a persisted child initialization resumes the original control run after a failure before its worker record
---
duration_ms: 18852.0782
type: 'test'
...
# Subtest: failed request intent persistence never dispatches a worker request or changes source
ok 544 - failed request intent persistence never dispatches a worker request or changes source
---
duration_ms: 18035.1977
type: 'test'
...
# Subtest: failed usage persistence rolls back the uncommitted usage and conservatively reserves one unknown request without tools
ok 545 - failed usage persistence rolls back the uncommitted usage and conservatively reserves one unknown request without tools
---
duration_ms: 18580.8562
type: 'test'
...
# Subtest: a child file change after observation prevents acknowledgement even when the tool inputs did not change
ok 546 - a child file change after observation prevents acknowledgement even when the tool inputs did not change
---
duration_ms: 15995.4776
type: 'test'
...
# Subtest: worker scopes and allocated budgets reject aliases, extra permissions and aggregate overflow
ok 547 - worker scopes and allocated budgets reject aliases, extra permissions and aggregate overflow
---
duration_ms: 550.601
type: 'test'
...
# Subtest: two sequential Git workspaces freeze a new parent goal, separate owned tasks and preserve all source bytes
ok 548 - two sequential Git workspaces freeze a new parent goal, separate owned tasks and preserve all source bytes
---
duration_ms: 18221.2753
type: 'test'
...
# Subtest: real isolated changes, approvals and npm checks produce original owned outputs, not model completion claims
ok 549 - real isolated changes, approvals and npm checks produce original owned outputs, not model completion claims
---
duration_ms: 39915.6775
type: 'test'
...
# Subtest: forged worker tools cannot execute terminal or Git even when absent from the advertised tool list
ok 550 - forged worker tools cannot execute terminal or Git even when absent from the advertised tool list
---
duration_ms: 18030.3852
type: 'test'
...
# Subtest: a completion-only model pauses each worker without fabricated changes or checks
ok 551 - a completion-only model pauses each worker without fabricated changes or checks
---
duration_ms: 20639.1462
type: 'test'
...
# Subtest: restart retains frozen scope and marks interrupted parent and workers unknown without sending requests
ok 552 - restart retains frozen scope and marks interrupted parent and workers unknown without sending requests
---
duration_ms: 18023.2033
type: 'test'
...
# Subtest: small code and actual failed command stay visible when their original multi-tool group cannot fit
ok 553 - small code and actual failed command stay visible when their original multi-tool group cannot fit
---
duration_ms: 1266.0405
type: 'test'
...
# Subtest: mixed group retains six distinct small file observations with exact multilingual text and bounded request bytes
ok 554 - mixed group retains six distinct small file observations with exact multilingual text and bounded request bytes
---
duration_ms: 1674.2223
type: 'test'
...
# Subtest: working observations are bound to the current Task and stop treating a pre-application file revision as current evidence
ok 555 - working observations are bound to the current Task and stop treating a pre-application file revision as current evidence
---
duration_ms: 1783.6188
type: 'test'
...
# Subtest: a sealed observation rejects changed or missing original result artifacts instead of recreating evidence
ok 556 - a sealed observation rejects changed or missing original result artifacts instead of recreating evidence
---
duration_ms: 1013.3999
type: 'test'
...
# Subtest: a real passed-check observation is excluded after a source edit invalidates the check, while its historical sent evidence remains valid
ok 557 - a real passed-check observation is excluded after a source edit invalidates the check, while its historical sent evidence remains valid
---
duration_ms: 5016.3634
type: 'test'
...
# Subtest: budgeted file pages reconstruct UTF-8 text including long single lines and surrogate boundaries
ok 558 - budgeted file pages reconstruct UTF-8 text including long single lines and surrogate boundaries
---
duration_ms: 4.0811
type: 'test'
...
# Subtest: actual HTTP multi-tool reads survive an oversized runtime snapshot and the sealed evidence survives reopening
ok 559 - actual HTTP multi-tool reads survive an oversized runtime snapshot and the sealed evidence survives reopening
---
duration_ms: 9429.4751
type: 'test'
...
# Subtest: actual HTTP file pagination advances over a long file with each returned page visible in the next request
ok 560 - actual HTTP file pagination advances over a long file with each returned page visible in the next request
---
duration_ms: 2331.8675
type: 'test'
...
# Subtest: later mixed history pages cannot displace the actual module sources and complete requirements
ok 561 - later mixed history pages cannot displace the actual module sources and complete requirements
---
duration_ms: 4969.5114
type: 'test'
...
# Subtest: a later narrow page of the same file revision cannot evict the wider actual observation
ok 562 - a later narrow page of the same file revision cannot evict the wider actual observation
---
duration_ms: 4369.1297
type: 'test'
...
# Subtest: historical read-artifact navigation points to the original artifact and next page, never its result wrapper
ok 563 - historical read-artifact navigation points to the original artifact and next page, never its result wrapper
---
duration_ms: 1242.7295
type: 'test'
...
# Subtest: a 1.6.1 full-provenance sent view remains verifiable after introducing the compact view
ok 564 - a 1.6.1 full-provenance sent view remains verifiable after introducing the compact view
---
duration_ms: 1293.8492
type: 'test'
...
# Subtest: actual HTTP requests keep four observed modules after a later large history read and preserve all source bytes
ok 565 - actual HTTP requests keep four observed modules after a later large history read and preserve all source bytes
---
duration_ms: 11514.6072
type: 'test'
...
# Subtest: workspace HTTP ownership, reviewed creation and reopen survive restart without changing source files
ok 566 - workspace HTTP ownership, reviewed creation and reopen survive restart without changing source files
---
duration_ms: 13099.3536
type: 'test'
...
# Subtest: isolated model Task applies a batch, executes real checks and commits at the Git review boundary with a source-bound report
ok 567 - isolated model Task applies a batch, executes real checks and commits at the Git review boundary with a source-bound report
---
duration_ms: 33564.4394
type: 'test'
...
# warning: in the working copy of 'src/空 格.mjs', LF will be replaced by CRLF the next time Git touches it
# Subtest: worktree checkout disables hooks, fsmonitor and all filter command variants while honoring built-in EOL conversion
ok 568 - worktree checkout disables hooks, fsmonitor and all filter command variants while honoring built-in EOL conversion
---
duration_ms: 8462.3185
type: 'test'
...
# Subtest: an ignored external file at checkout is observed and never accepted as pristine creation
ok 569 - an ignored external file at checkout is observed and never accepted as pristine creation
---
duration_ms: 7885.2265
type: 'test'
...
# Subtest: outside content hidden by assume-unchanged cannot pass workspace verification and blocks further source execution
ok 570 - outside content hidden by assume-unchanged cannot pass workspace verification and blocks further source execution
---
duration_ms: 6058.8918
type: 'test'
...
# Subtest: workspace preparation refuses known shared-repository activity and preserves archived child sessions
ok 571 - workspace preparation refuses known shared-repository activity and preserves archived child sessions
---
duration_ms: 7811.317
type: 'test'
...
# Subtest: compact checkout identities create in deep Unicode source directories while retaining the human branch name
ok 572 - compact checkout identities create in deep Unicode source directories while retaining the human branch name
---
duration_ms: 7046.7039
type: 'test'
...
# Subtest: Windows Git metadata path limits reject creation before publishing a branch or changing source bytes
ok 573 - Windows Git metadata path limits reject creation before publishing a branch or changing source bytes
---
duration_ms: 3387.7351
type: 'test'
...
# Subtest: a pending source snapshot participates in shutdown and completes before storage can close
ok 574 - a pending source snapshot participates in shutdown and completes before storage can close
---
duration_ms: 2527.8719
type: 'test'
...
# Subtest: source configuration values stay private and a configuration change invalidates a saved review
ok 575 - source configuration values stay private and a configuration change invalidates a saved review
---
duration_ms: 2981.0481
type: 'test'
...
# Subtest: workspace review rejects excluded dependency before any checkout
ok 576 - workspace review rejects excluded dependency before any checkout
---
duration_ms: 3048.3277
type: 'test'
...
# Subtest: workspace review rejects large committed blob before any checkout
ok 577 - workspace review rejects large committed blob before any checkout
---
duration_ms: 2786.2062
type: 'test'
...
# Subtest: workspace review rejects case collision before any checkout
ok 578 - workspace review rejects case collision before any checkout
---
duration_ms: 3080.4519
type: 'test'
...
# Subtest: workspace review rejects committed symbolic link before any checkout
ok 579 - workspace review rejects committed symbolic link before any checkout
---
duration_ms: 2807.6964
type: 'test'
...
# Subtest: workspace review rejects external config include before any checkout
ok 580 - workspace review rejects external config include before any checkout
---
duration_ms: 1963.3714
type: 'test'
...
# Subtest: actual process exit at workspace intent preserves source and reconciles without creation replay
ok 581 - actual process exit at workspace intent preserves source and reconciles without creation replay
---
duration_ms: 5374.8921
type: 'test'
...
# Subtest: actual process exit at workspace git_started preserves source and reconciles without creation replay
ok 582 - actual process exit at workspace git_started preserves source and reconciles without creation replay
---
duration_ms: 8255.0153
type: 'test'
...
# Subtest: actual process exit at workspace git_finished preserves source and reconciles without creation replay
ok 583 - actual process exit at workspace git_finished preserves source and reconciles without creation replay
---
duration_ms: 8452.3399
type: 'test'
...
# Subtest: actual process exit at workspace verifying preserves source and reconciles without creation replay
ok 584 - actual process exit at workspace verifying preserves source and reconciles without creation replay
---
duration_ms: 7358.7279
type: 'test'
...
# Subtest: actual process exit at workspace registering preserves source and reconciles without creation replay
ok 585 - actual process exit at workspace registering preserves source and reconciles without creation replay
---
duration_ms: 8408.1866
type: 'test'
...
# Subtest: actual process exit at workspace project_registered preserves source and reconciles without creation replay
ok 586 - actual process exit at workspace project_registered preserves source and reconciles without creation replay
---
duration_ms: 11136.3096
type: 'test'
...
# Subtest: actual process exit at workspace session_registered preserves source and reconciles without creation replay
ok 587 - actual process exit at workspace session_registered preserves source and reconciles without creation replay
---
duration_ms: 9975.0451
type: 'test'
...
# Subtest: actual process exit at workspace ready preserves source and reconciles without creation replay
ok 588 - actual process exit at workspace ready preserves source and reconciles without creation replay
---
duration_ms: 8835.5826
type: 'test'
...
# Subtest: outside changes at project registration remain unknown and preserve the already registered child identity
ok 589 - outside changes at project registration remain unknown and preserve the already registered child identity
---
duration_ms: 8937.9215
type: 'test'
...
# Subtest: managed worktree preserves source index and dirty files, opens a distinct project and binds Run identity
ok 590 - managed worktree preserves source index and dirty files, opens a distinct project and binds Run identity
---
duration_ms: 7395.1668
type: 'test'
...
# Subtest: stale review, branch/path collisions and forged ownership do not run worktree creation
ok 591 - stale review, branch/path collisions and forged ownership do not run worktree creation
---
duration_ms: 4495.9624
type: 'test'
...
# Subtest: workspace project verification is read-only and rejects physical Git identity changes
ok 592 - workspace project verification is read-only and rejects physical Git identity changes
---
duration_ms: 7187.5576
type: 'test'
...
1..592
# tests 604
# suites 0
# pass 604
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 1544386.4013