Files
Agent-Workbench/docs/reproducible-env-interrupted-candidate-evidence/source/tests.tap
T

3675 lines
161 KiB
Plaintext

TAP version 13
# Subtest: the bundled local service enforces host, origin, token and JSON object contracts
ok 1 - the bundled local service enforces host, origin, token and JSON object contracts
---
duration_ms: 2522.5423
type: 'test'
...
# Subtest: an in-flight connection probe prevents configuration changes and another probe until its actual result returns
ok 2 - an in-flight connection probe prevents configuration changes and another probe until its actual result returns
---
duration_ms: 2623.1485
type: 'test'
...
# Subtest: API review applies verified content, detects conflicts, exports sessions and keeps keys in memory
ok 3 - API review applies verified content, detects conflicts, exports sessions and keeps keys in memory
---
duration_ms: 5077.7106
type: 'test'
...
# Subtest: a real bundle restart preserves proposals, interrupts old approvals and requests fresh consent on resume
ok 4 - a real bundle restart preserves proposals, interrupts old approvals and requests fresh consent on resume
---
duration_ms: 12025.313
type: 'test'
...
# Subtest: runtime diagnostics and model-response validation use actual records and preserve the saved connection
ok 5 - runtime diagnostics and model-response validation use actual records and preserve the saved connection
---
duration_ms: 2928.3051
type: 'test'
...
# Subtest: persistent event replay is read-only and keeps run/artifact identity across reconnects
ok 6 - persistent event replay is read-only and keeps run/artifact identity across reconnects
---
duration_ms: 6409.234
type: 'test'
...
# Subtest: real browser HTTP plans, original field pages and PNG bytes preserve ownership and survive host restart
ok 7 - real browser HTTP plans, original field pages and PNG bytes preserve ownership and survive host restart
---
duration_ms: 8246.6432
type: 'test'
...
# Subtest: self harness browser tools require approval and feed verified actual page fields back to the original Task
ok 8 - self harness browser tools require approval and feed verified actual page fields back to the original Task
---
duration_ms: 11932.7638
type: 'test'
...
# Subtest: browser host recovery retains unknown root outcome, blocks replay, and requires an explicit owned acknowledgement
ok 9 - browser host recovery retains unknown root outcome, blocks replay, and requires an explicit owned acknowledgement
---
duration_ms: 4991.4883
type: 'test'
...
# Subtest: late HTTP stop of a finished browser job cannot interrupt a later job in the same Task
ok 10 - late HTTP stop of a finished browser job cannot interrupt a later job in the same Task
---
duration_ms: 9439.3422
type: 'test'
...
# Subtest: actual failed page blocks source-passed delivery; a new passing page permits a bound commit and preserves both original records
ok 11 - actual failed page blocks source-passed delivery; a new passing page permits a bound commit and preserves both original records
---
duration_ms: 25349.2459
type: 'test'
...
# Subtest: a build-only change after Git review invalidates the actual browser evidence and leaves HEAD and the protected index intact
ok 12 - a build-only change after Git review invalidates the actual browser evidence and leaves HEAD and the protected index intact
---
duration_ms: 11090.8749
type: 'test'
...
# Subtest: actual DOM controls include validated unique CSS selectors across repeated parent buttons and escaped labels
ok 13 - actual DOM controls include validated unique CSS selectors across repeated parent buttons and escaped labels
---
duration_ms: 8649.4865
type: 'test'
...
# Subtest: browser field coverage distinguishes sections and Run windows while retaining original source identity
ok 14 - browser field coverage distinguishes sections and Run windows while retaining original source identity
---
duration_ms: 0.4543
type: 'test'
...
# Subtest: repeated original browser pages pause a live Task without re-opening the browser or breaking tool pairing
ok 15 - repeated original browser pages pause a live Task without re-opening the browser or breaking tool pairing
---
duration_ms: 7263.1917
type: 'test'
...
# Subtest: browser plan rejects outside builds, invalid interaction scope and unbounded steps before execution
ok 16 - browser plan rejects outside builds, invalid interaction scope and unbounded steps before execution
---
duration_ms: 0.9659
type: 'test'
...
# Subtest: real owned Edge interactions, assertions, raw PNG and stopped process survive exact result reuse and host reopen
ok 17 - real owned Edge interactions, assertions, raw PNG and stopped process survive exact result reuse and host reopen
---
duration_ms: 4567.4708
type: 'test'
...
# Subtest: failed real page assertion preserves actual value and forbids silent retry of the original plan
ok 18 - failed real page assertion preserves actual value and forbids silent retry of the original plan
---
duration_ms: 8939.1399
type: 'test'
...
# Subtest: build/source mutation and sealed step tampering reject before browser dispatch; earlier task cannot execute plan
ok 19 - build/source mutation and sealed step tampering reject before browser dispatch; earlier task cannot execute plan
---
duration_ms: 1441.7165
type: 'test'
...
# Subtest: outside network never reaches another local service, and original JavaScript/console failures remain failures
ok 20 - outside network never reaches another local service, and original JavaScript/console failures remain failures
---
duration_ms: 3028.2132
type: 'test'
...
# Subtest: stopping a real in-flight browser preserves finished steps, closes its owned root and never replays
ok 21 - stopping a real in-flight browser preserves finished steps, closes its owned root and never replays
---
duration_ms: 3183.5547
type: 'test'
...
# Subtest: 原PNG损坏使原结果校验失败,不能以已有通过状态复用
ok 22 - 原PNG损坏使原结果校验失败,不能以已有通过状态复用
---
duration_ms: 4072.2517
type: 'test'
...
# Subtest: a budget pause persists concrete text/tool/history/image breakdown and never dispatches an oversized request
ok 23 - a budget pause persists concrete text/tool/history/image breakdown and never dispatches an oversized request
---
duration_ms: 1938.2104
type: 'test'
...
# Subtest: explicit frozen preview resumes the same Task in a new Run, preserves completed tools and does not change global config or selected model
ok 24 - explicit frozen preview resumes the same Task in a new Run, preserves completed tools and does not change global config or selected model
---
duration_ms: 4403.0589
type: 'test'
...
# Subtest: insufficient budgets, silently clamped capacity and arbitrary config fields reject without a physical request or mutating task budget
ok 25 - insufficient budgets, silently clamped capacity and arbitrary config fields reject without a physical request or mutating task budget
---
duration_ms: 2254.4021
type: 'test'
...
# Subtest: changed session, changed registry, expiry and altered frozen preview all require a new explicit preview
ok 26 - changed session, changed registry, expiry and altered frozen preview all require a new explicit preview
---
duration_ms: 3358.9583
type: 'test'
...
# Subtest: preview preserves unknown invocation status and increasing Task allowance is committed only with confirmed new Run
ok 27 - preview preserves unknown invocation status and increasing Task allowance is committed only with confirmed new Run
---
duration_ms: 3344.3008
type: 'test'
...
# Subtest: batch APIs enforce ownership and review fingerprints, apply once, and persist the completed batch across restart
ok 28 - batch APIs enforce ownership and review fingerprints, apply once, and persist the completed batch across restart
---
duration_ms: 7713.2212
type: 'test'
...
# Subtest: delivery reports bind actual batch identity and reject corrupted snapshot evidence without changing project files
ok 29 - delivery reports bind actual batch identity and reject corrupted snapshot evidence without changing project files
---
duration_ms: 4332.6938
type: 'test'
...
# Subtest: a compatible model can seal proposals through the real HTTP loop while application stays behind user review
ok 30 - a compatible model can seal proposals through the real HTTP loop while application stays behind user review
---
duration_ms: 9366.7881
type: 'test'
...
# Subtest: a step-limited sealed batch applies and continues the same Task into actual checks without replaying saved tools
ok 31 - a step-limited sealed batch applies and continues the same Task into actual checks without replaying saved tools
---
duration_ms: 18364.2135
type: 'test'
...
# Subtest: applied batches cannot turn cancellation, other budgets, restart or unknown commands into a review continuation
ok 32 - applied batches cannot turn cancellation, other budgets, restart or unknown commands into a review continuation
---
duration_ms: 2461.4823
type: 'test'
...
# Subtest: actual process exit at file-batch prepared preserves durable identity and never replays writes
ok 33 - actual process exit at file-batch prepared preserves durable identity and never replays writes
---
duration_ms: 1647.8419
type: 'test'
...
# Subtest: actual process exit at file-batch application_started preserves durable identity and never replays writes
ok 34 - actual process exit at file-batch application_started preserves durable identity and never replays writes
---
duration_ms: 1976.148
type: 'test'
...
# Subtest: actual process exit at file-batch write_intent preserves durable identity and never replays writes
ok 35 - actual process exit at file-batch write_intent preserves durable identity and never replays writes
---
duration_ms: 1931.9011
type: 'test'
...
# Subtest: actual process exit at file-batch staged preserves durable identity and never replays writes
ok 36 - actual process exit at file-batch staged preserves durable identity and never replays writes
---
duration_ms: 2149.7249
type: 'test'
...
# Subtest: actual process exit at file-batch replaced preserves durable identity and never replays writes
ok 37 - actual process exit at file-batch replaced preserves durable identity and never replays writes
---
duration_ms: 3253.9414
type: 'test'
...
# Subtest: actual process exit at file-batch file_recorded preserves durable identity and never replays writes
ok 38 - actual process exit at file-batch file_recorded preserves durable identity and never replays writes
---
duration_ms: 2776.286
type: 'test'
...
# Subtest: actual process exit at file-batch finished preserves durable identity and never replays writes
ok 39 - actual process exit at file-batch finished preserves durable identity and never replays writes
---
duration_ms: 2456.6101
type: 'test'
...
# Subtest: actual process exit at file-batch rollback_started preserves durable identity and never replays writes
ok 40 - actual process exit at file-batch rollback_started preserves durable identity and never replays writes
---
duration_ms: 4395.3254
type: 'test'
...
# Subtest: actual process exit at file-batch restore_intent preserves durable identity and never replays writes
ok 41 - actual process exit at file-batch restore_intent preserves durable identity and never replays writes
---
duration_ms: 3651.0748
type: 'test'
...
# Subtest: actual process exit at file-batch restore_staged preserves durable identity and never replays writes
ok 42 - actual process exit at file-batch restore_staged preserves durable identity and never replays writes
---
duration_ms: 4086.7502
type: 'test'
...
# Subtest: actual process exit at file-batch restored preserves durable identity and never replays writes
ok 43 - actual process exit at file-batch restored preserves durable identity and never replays writes
---
duration_ms: 3030.8986
type: 'test'
...
# Subtest: actual process exit at file-batch restore_recorded preserves durable identity and never replays writes
ok 44 - actual process exit at file-batch restore_recorded preserves durable identity and never replays writes
---
duration_ms: 3634.288
type: 'test'
...
# Subtest: actual process exit at file-batch rollback_finished preserves durable identity and never replays writes
ok 45 - actual process exit at file-batch rollback_finished preserves durable identity and never replays writes
---
duration_ms: 3686.6199
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'src/two.mjs', LF will be replaced by CRLF the next time Git touches it
# Subtest: sealed batches preserve bytes until review, then apply and explicitly restore BOM/CRLF/new files
ok 46 - sealed batches preserve bytes until review, then apply and explicitly restore BOM/CRLF/new files
---
duration_ms: 3356.1884
type: 'test'
...
# Switched to a new branch 'owner-branch'
# Subtest: a conflict in the last file or Git branch prevents writing every file in the batch
ok 47 - a conflict in the last file or Git branch prevents writing every file in the batch
---
duration_ms: 4319.2578
type: 'test'
...
# Subtest: duplicate canonical paths, ancestor collisions, links, dependencies and Windows aliases never form a batch
ok 48 - duplicate canonical paths, ancestor collisions, links, dependencies and Windows aliases never form a batch
---
duration_ms: 1237.5273
type: 'test'
...
# Subtest: fingerprints, changed proposals and corrupt snapshot artifacts cannot write or restore any target
ok 49 - fingerprints, changed proposals and corrupt snapshot artifacts cannot write or restore any target
---
duration_ms: 2262.2417
type: 'test'
...
# Subtest: a failure after replacement restores only batch bytes and never retries an old application
ok 50 - a failure after replacement restores only batch bytes and never retries an old application
---
duration_ms: 1623.6717
type: 'test'
...
# Subtest: rollback preserves owner edits, blocks other project writers, and explicit acknowledgement releases recovery
ok 51 - rollback preserves owner edits, blocks other project writers, and explicit acknowledgement releases recovery
---
duration_ms: 2826.3016
type: 'test'
...
# Subtest: an unattempted owner-created file identical to a suggestion remains external and is never removed
ok 52 - an unattempted owner-created file identical to a suggestion remains external and is never removed
---
duration_ms: 1430.5306
type: 'test'
...
# Subtest: active batch requests are serialized and cancellation leaves a verifiable ended batch
ok 53 - active batch requests are serialized and cancellation leaves a verifiable ended batch
---
duration_ms: 1657.0608
type: 'test'
...
# Subtest: batch application and rollback preserve unrelated Git index and worktree bytes
ok 54 - batch application and rollback preserve unrelated Git index and worktree bytes
---
duration_ms: 3545.7105
type: 'test'
...
# Subtest: recovery reuses exact staged bytes but retains a conflicting temporary file for owner inspection
ok 55 - recovery reuses exact staged bytes but retains a conflicting temporary file for owner inspection
---
duration_ms: 2877.3514
type: 'test'
...
# Subtest: one Task can seal pending proposals from earlier Runs while snapshots retain each source Run
ok 56 - one Task can seal pending proposals from earlier Runs while snapshots retain each source Run
---
duration_ms: 2549.5893
type: 'test'
...
# Subtest: engineering inspection preserves a dirty Git baseline and treats project rules as data
ok 57 - engineering inspection preserves a dirty Git baseline and treats project rules as data
---
duration_ms: 3564.6658
type: 'test'
...
# Subtest: real npm tests and build produce counted results, log artifacts and persistent verification
ok 58 - real npm tests and build produce counted results, log artifacts and persistent verification
---
duration_ms: 2560.7784
type: 'test'
...
# Subtest: an actual failing test retains the nonzero exit code and failed count
ok 59 - an actual failing test retains the nonzero exit code and failed count
---
duration_ms: 2643.249
type: 'test'
...
# Subtest: unchanged automatic checks return original failure evidence, while explicit user reruns and changed source still execute
ok 60 - unchanged automatic checks return original failure evidence, while explicit user reruns and changed source still execute
---
duration_ms: 5255.6821
type: 'test'
...
# Subtest: agent loops cannot hide identical failing checks behind new plan IDs or unrelated reads
ok 61 - agent loops cannot hide identical failing checks behind new plan IDs or unrelated reads
---
duration_ms: 9674.7514
type: 'test'
...
# Subtest: zero tests, skipped tests and unrecognized stdout cannot become verification passes
ok 62 - zero tests, skipped tests and unrecognized stdout cannot become verification passes
---
duration_ms: 9235.33
type: 'test'
...
# Subtest: a successful build with no selected tests does not verify the task
ok 63 - a successful build with no selected tests does not verify the task
---
duration_ms: 1713.4853
type: 'test'
...
# Subtest: stale check plans and forged script names execute no project commands
ok 64 - stale check plans and forged script names execute no project commands
---
duration_ms: 1399.0199
type: 'test'
...
# Subtest: applying a later proposal invalidates the prior passed engineering snapshot
ok 65 - applying a later proposal invalidates the prior passed engineering snapshot
---
duration_ms: 3060.9071
type: 'test'
...
# Subtest: stopping an actual check terminates its child process and blocks concurrent jobs
ok 66 - stopping an actual check terminates its child process and blocks concurrent jobs
---
duration_ms: 2320.6438
type: 'test'
...
# Subtest: check timeout records a failure with its actual termination result
ok 67 - check timeout records a failure with its actual termination result
---
duration_ms: 2764.0071
type: 'test'
...
# Subtest: source edits during a successful check make the result stale
ok 68 - source edits during a successful check make the result stale
---
duration_ms: 3137.1766
type: 'test'
...
# Subtest: bounded large logs retain the test footer and readable artifact instead of inventing counts
ok 69 - bounded large logs retain the test footer and readable artifact instead of inventing counts
---
duration_ms: 2115.0776
type: 'test'
...
# Subtest: model-selected checks require a run-bound decision and denial creates no check job
ok 70 - model-selected checks require a run-bound decision and denial creates no check job
---
duration_ms: 2592.1895
type: 'test'
...
# Subtest: check APIs expose owned plans and jobs and preserve the authoritative results across restart
ok 71 - check APIs expose owned plans and jobs and preserve the authoritative results across restart
---
duration_ms: 6290.4894
type: 'test'
...
# Subtest: reviewed changes continue the original task without reopening a generic completed run
ok 72 - reviewed changes continue the original task without reopening a generic completed run
---
duration_ms: 2990.6107
type: 'test'
...
# Subtest: concurrent review-continuation API requests accept one run and retain the goal after restart
ok 73 - concurrent review-continuation API requests accept one run and retain the goal after restart
---
duration_ms: 9161.4679
type: 'test'
...
# Subtest: the model reads owned failure logs without running the check again
ok 74 - the model reads owned failure logs without running the check again
---
duration_ms: 2836.3773
type: 'test'
...
# Subtest: process exit at check queued preserves results and never replays commands
ok 75 - process exit at check queued preserves results and never replays commands
---
duration_ms: 1296.3467
type: 'test'
...
# Subtest: process exit at check result_committed preserves results and never replays commands
ok 76 - process exit at check result_committed preserves results and never replays commands
---
duration_ms: 1952.9966
type: 'test'
...
# Subtest: model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
ok 77 - model code tools keep Task/Run ownership, index evidence and exact proposals across storage recovery
---
duration_ms: 6743.019
type: 'test'
...
# Subtest: bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
ok 78 - bundled code APIs isolate project results, validate queries and create review-only patches with conflicts
---
duration_ms: 3329.8462
type: 'test'
...
# Subtest: code tool arguments reject malformed ownership-independent inputs before side effects
ok 79 - code tool arguments reject malformed ownership-independent inputs before side effects
---
duration_ms: 0.2894
type: 'test'
...
# Subtest: observe-only device authority cannot read, configure or clear project parsing caches
ok 80 - observe-only device authority cannot read, configure or clear project parsing caches
---
duration_ms: 992.7445
type: 'test'
...
# Subtest: pairing is short lived, single-use, generation-bound and validates exact permissions
ok 81 - pairing is short lived, single-use, generation-bound and validates exact permissions
---
duration_ms: 771.5952
type: 'test'
...
# Subtest: device transaction failure neither consumes the ticket nor leaves a credential
ok 82 - device transaction failure neither consumes the ticket nor leaves a credential
---
duration_ms: 1027.9416
type: 'test'
...
# Subtest: devices have project and action boundaries; rotation, expiration, revocation and host changes reject old authority
ok 83 - devices have project and action boundaries; rotation, expiration, revocation and host changes reject old authority
---
duration_ms: 705.2046
type: 'test'
...
# Subtest: persistent registry stores hashes and a bounded audit, never raw credentials
ok 84 - persistent registry stores hashes and a bounded audit, never raw credentials
---
duration_ms: 593.0549
type: 'test'
...
# Subtest: real TLS verifies IP SAN, CA chain, encrypted restart and public fingerprint
ok 85 - real TLS verifies IP SAN, CA chain, encrypted restart and public fingerprint
---
duration_ms: 685.1729
type: 'test'
...
# Subtest: TLS sealing failure leaves listener closed and no plaintext or successful TLS registration
ok 86 - TLS sealing failure leaves listener closed and no plaintext or successful TLS registration
---
duration_ms: 949.2051
type: 'test'
...
# Subtest: HTTP pairing is concurrent single-use; secure cookie and strict origin/host checks
ok 87 - HTTP pairing is concurrent single-use; secure cookie and strict origin/host checks
---
duration_ms: 771.2998
type: 'test'
...
# Subtest: gateway never exposes management routes, arbitrary assets or unpaired project data
ok 88 - gateway never exposes management routes, arbitrary assets or unpaired project data
---
duration_ms: 746.6822
type: 'test'
...
# Subtest: authorized project events paginate from original seq without leaking other project events or payloads
ok 89 - authorized project events paginate from original seq without leaking other project events or payloads
---
duration_ms: 1690.5881
type: 'test'
...
# Subtest: remote task projection excludes raw model history, host configuration, tool input and credentials
ok 90 - remote task projection excludes raw model history, host configuration, tool input and credentials
---
duration_ms: 686.2088
type: 'test'
...
# Subtest: permission checks apply to direct remote mutation, not only UI controls
ok 91 - permission checks apply to direct remote mutation, not only UI controls
---
duration_ms: 1112.8511
type: 'test'
...
# Subtest: approval fingerprint and exact task/revision are bound; duplicate requests never execute twice
ok 92 - approval fingerprint and exact task/revision are bound; duplicate requests never execute twice
---
duration_ms: 902.6896
type: 'test'
...
# Subtest: unknown original operation is recorded and never replayed after response failure
ok 93 - unknown original operation is recorded and never replayed after response failure
---
duration_ms: 841.4115
type: 'test'
...
# Subtest: revocation and gateway closure reject old access without invoking runtime stop
ok 94 - revocation and gateway closure reject old access without invoking runtime stop
---
duration_ms: 800.2519
type: 'test'
...
# Subtest: rate limits reject pairing brute force and do not persist candidate secrets
ok 95 - rate limits reject pairing brute force and do not persist candidate secrets
---
duration_ms: 1111.9488
type: 'test'
...
# Subtest: real Windows CurrentUser DPAPI persists only a sealed CA and reopens it
ok 96 - real Windows CurrentUser DPAPI persists only a sealed CA and reopens it
---
duration_ms: 1868.471
type: 'test'
...
# Subtest: mobile approval executes the original Runtime command exactly once and rejects the later desktop decision
ok 97 - mobile approval executes the original Runtime command exactly once and rejects the later desktop decision
---
duration_ms: 2691.9451
type: 'test'
...
# Subtest: desktop rejection wins a concurrent mobile request and original command remains unexecuted
ok 98 - desktop rejection wins a concurrent mobile request and original command remains unexecuted
---
duration_ms: 1591.1127
type: 'test'
...
# Subtest: phone stop waits for the original process exit and prevents later heartbeats and command replay
ok 99 - phone stop waits for the original process exit and prevents later heartbeats and command replay
---
duration_ms: 2310.9108
type: 'test'
...
# Subtest: Run replacement during parent-stop wait is rejected rather than stopping the new Run
ok 100 - Run replacement during parent-stop wait is rejected rather than stopping the new Run
---
duration_ms: 496.5402
type: 'test'
...
# Subtest: diff pages preserve source SHA; report reads verify blobs and exclude unrelated artifact kinds
ok 101 - diff pages preserve source SHA; report reads verify blobs and exclude unrelated artifact kinds
---
duration_ms: 1103.3108
type: 'test'
...
# Subtest: hot upgrade refuses an active gateway and restores closed gateway ownership on failure
ok 102 - hot upgrade refuses an active gateway and restores closed gateway ownership on failure
---
duration_ms: 779.1371
type: 'test'
...
# Subtest: damaged device permissions or expiry fail closed and never overwrite the original registry
ok 103 - damaged device permissions or expiry fail closed and never overwrite the original registry
---
duration_ms: 835.1926
type: 'test'
...
# Subtest: device revocation destroys its actual authenticated TLS connection
ok 104 - device revocation destroys its actual authenticated TLS connection
---
duration_ms: 1006.8197
type: 'test'
...
# Subtest: companion observes only current Task screenshots, verifies original PNG bytes and loses access immediately on revoke
ok 105 - companion observes only current Task screenshots, verifies original PNG bytes and loses access immediately on revoke
---
duration_ms: 1316.6076
type: 'test'
...
# Subtest: actual config HTTP failure preserves the committed selection, config and volatile credential before a successful retry
ok 106 - actual config HTTP failure preserves the committed selection, config and volatile credential before a successful retry
---
duration_ms: 888.0173
type: 'test'
...
# Subtest: controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
ok 107 - controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
---
duration_ms: 1044.6287
type: 'test'
...
# Subtest: controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
ok 108 - controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
---
duration_ms: 0.533
type: 'test'
...
# Subtest: owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
ok 109 - owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
---
duration_ms: 4.8401
type: 'test'
...
# Subtest: bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
ok 110 - bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
---
duration_ms: 780.8509
type: 'test'
...
# Subtest: bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
ok 111 - bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
---
duration_ms: 707.4758
type: 'test'
...
# Subtest: bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
ok 112 - bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
---
duration_ms: 794.0095
type: 'test'
...
# Subtest: stopped and oversized bridge requests never reach a local model or tool callback
ok 113 - stopped and oversized bridge requests never reach a local model or tool callback
---
duration_ms: 839.8422
type: 'test'
...
# Subtest: a Windows virtual data-directory name binds new storage and credentials to its actual physical root
ok 114 - a Windows virtual data-directory name binds new storage and credentials to its actual physical root
---
duration_ms: 1738.8996
type: 'test'
...
# Subtest: physical data-root adoption still rejects explicit junctions at the directory or any ancestor
ok 115 - physical data-root adoption still rejects explicit junctions at the directory or any ancestor
---
duration_ms: 855.4946
type: 'test'
...
# Subtest: actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy
ok 116 - actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy
---
duration_ms: 1378.0126
type: 'test'
...
# Subtest: only explicitly supplied keys persist; new provider restores original revisions and public views contain no key
ok 117 - only explicitly supplied keys persist; new provider restores original revisions and public views contain no key
---
duration_ms: 2681.463
type: 'test'
...
# Subtest: registry and cipher commit failure restores original routing, keys, block and every database row
ok 118 - registry and cipher commit failure restores original routing, keys, block and every database row
---
duration_ms: 1949.3548
type: 'test'
...
# Subtest: a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview
ok 119 - a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview
---
duration_ms: 2282.3218
type: 'test'
...
# Subtest: connection revision changes retain the original saved block and report a source mismatch on restart
ok 120 - connection revision changes retain the original saved block and report a source mismatch on restart
---
duration_ms: 2852.7476
type: 'test'
...
# Subtest: disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both
ok 121 - disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both
---
duration_ms: 4426.89
type: 'test'
...
# Subtest: corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext
ok 122 - corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext
---
duration_ms: 3927.2172
type: 'test'
...
# Subtest: legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save
ok 123 - legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save
---
duration_ms: 2833.0795
type: 'test'
...
# Subtest: owned plaintext keys never reach SQLite pages, WAL, config or public execution exports
ok 124 - owned plaintext keys never reach SQLite pages, WAL, config or public execution exports
---
duration_ms: 1871.8903
type: 'test'
...
# Subtest: actual process exit at Git queued never replays a commit and can reconcile the durable result
ok 125 - actual process exit at Git queued never replays a commit and can reconcile the durable result
---
duration_ms: 18272.4373
type: 'test'
...
# Subtest: actual process exit at Git preparing never replays a commit and can reconcile the durable result
ok 126 - actual process exit at Git preparing never replays a commit and can reconcile the durable result
---
duration_ms: 15811.4721
type: 'test'
...
# Subtest: actual process exit at Git index_locked never replays a commit and can reconcile the durable result
ok 127 - actual process exit at Git index_locked never replays a commit and can reconcile the durable result
---
duration_ms: 21134.2766
type: 'test'
...
# Subtest: actual process exit at Git prepared never replays a commit and can reconcile the durable result
ok 128 - actual process exit at Git prepared never replays a commit and can reconcile the durable result
---
duration_ms: 30081.7451
type: 'test'
...
# Subtest: actual process exit at Git ref_prepared never replays a commit and can reconcile the durable result
ok 129 - actual process exit at Git ref_prepared never replays a commit and can reconcile the durable result
---
duration_ms: 22095.4786
type: 'test'
...
# Subtest: actual process exit at Git publishing never replays a commit and can reconcile the durable result
ok 130 - actual process exit at Git publishing never replays a commit and can reconcile the durable result
---
duration_ms: 20131.9472
type: 'test'
...
# Subtest: actual process exit at Git committed never replays a commit and can reconcile the durable result
ok 131 - actual process exit at Git committed never replays a commit and can reconcile the durable result
---
duration_ms: 17019.7395
type: 'test'
...
# Subtest: actual process exit at Git index_published never replays a commit and can reconcile the durable result
ok 132 - actual process exit at Git index_published never replays a commit and can reconcile the durable result
---
duration_ms: 16808.1869
type: 'test'
...
# Subtest: actual process exit at Git finished never replays a commit and can reconcile the durable result
ok 133 - actual process exit at Git finished never replays a commit and can reconcile the durable result
---
duration_ms: 20140.1816
type: 'test'
...
# Subtest: an unknown Git result cannot overwrite an externally changed index or delete an unrelated lock
ok 134 - an unknown Git result cannot overwrite an externally changed index or delete an unrelated lock
---
duration_ms: 14406.4393
type: 'test'
...
# Subtest: known publication with a later source edit retains the commit and marks the delivery for inspection
ok 135 - known publication with a later source edit retains the commit and marks the delivery for inspection
---
duration_ms: 14518.3829
type: 'test'
...
# Subtest: CRLF normalization, multiple applied revisions and unrelated special index flags preserve exact bytes and ownership
ok 136 - CRLF normalization, multiple applied revisions and unrelated special index flags preserve exact bytes and ownership
---
duration_ms: 19118.9535
type: 'test'
...
# Subtest: adding new durable record kinds to an existing hot Store preserves all existing Maps and records
ok 137 - adding new durable record kinds to an existing hot Store preserves all existing Maps and records
---
duration_ms: 12573.9954
type: 'test'
...
# Subtest: an unrelated owner deletion is fingerprinted and preserved while linked task paths are rejected
ok 138 - an unrelated owner deletion is fingerprinted and preserved while linked task paths are rejected
---
duration_ms: 21653.0345
type: 'test'
...
# Subtest: actual failed tests become a reviewed local commit and evidence report while preserving unrelated index and files
ok 139 - actual failed tests become a reviewed local commit and evidence report while preserving unrelated index and files
---
duration_ms: 17617.3918
type: 'test'
...
# Subtest: selected preexisting unstaged, staged and untracked owner edits cannot enter a task commit
ok 140 - selected preexisting unstaged, staged and untracked owner edits cannot enter a task commit
---
duration_ms: 34250.7414
type: 'test'
...
# Switched to a new branch 'owner-branch'
# Subtest: source, unrelated stage and branch changes after review invalidate a commit plan without changing HEAD
ok 141 - source, unrelated stage and branch changes after review invalidate a commit plan without changing HEAD
---
duration_ms: 37396.1297
type: 'test'
...
# Switched to a new branch 'delivery-branch'
# Subtest: a later Git metadata change keeps matching source evidence valid but a real source edit requires checks
ok 142 - a later Git metadata change keeps matching source evidence valid but a real source edit requires checks
---
duration_ms: 14394.6377
type: 'test'
...
# Subtest: a corrupt passed-check log and a pending proposal block Git delivery instead of inventing evidence
ok 143 - a corrupt passed-check log and a pending proposal block Git delivery instead of inventing evidence
---
duration_ms: 10361.4493
type: 'test'
...
# HEAD is now at 1b302f9 Sealed delivery fixture baseline
# Subtest: Git filters, merge state, detached HEAD and old task ownership are explicitly rejected
ok 144 - Git filters, merge state, detached HEAD and old task ownership are explicitly rejected
---
duration_ms: 35180.1701
type: 'test'
...
# Subtest: local snapshot commits disable repository hooks and signing and isolate the Git child environment
ok 145 - local snapshot commits disable repository hooks and signing and isolate the Git child environment
---
duration_ms: 18290.6398
type: 'test'
...
# Subtest: stopping before publication cancels safely; stopping after publication preserves the actual completed commit
ok 146 - stopping before publication cancels safely; stopping after publication preserves the actual completed commit
---
duration_ms: 24382.9232
type: 'test'
...
# Subtest: delivery API confirms exactly one owned plan, serves verified reports and preserves results across restart
ok 147 - delivery API confirms exactly one owned plan, serves verified reports and preserves results across restart
---
duration_ms: 24070.1547
type: 'test'
...
# Subtest: the model can prepare an owned Git review and evidence report while publishing remains a separate user action
ok 148 - the model can prepare an owned Git review and evidence report while publishing remains a separate user action
---
duration_ms: 16500.3884
type: 'test'
...
# Subtest: HTTP Git review pairs deferred calls, survives reload and never requests more work until the saved preview is resolved
ok 149 - HTTP Git review pairs deferred calls, survives reload and never requests more work until the saved preview is resolved
---
duration_ms: 14899.9776
type: 'test'
...
# Subtest: a reviewed Git preview can be revised or withdrawn without publishing or losing the current Task
ok 150 - a reviewed Git preview can be revised or withdrawn without publishing or losing the current Task
---
duration_ms: 9474.4581
type: 'test'
...
# Subtest: actual Electron debug argument ordering retains exactly the compiled entry and rejects extra or repeated actions
ok 151 - actual Electron debug argument ordering retains exactly the compiled entry and rejects extra or repeated actions
---
duration_ms: 1.055
type: 'test'
...
# Subtest: native bridge refuses other origins, subframes, other windows and unsupported inputs before connecting
ok 152 - native bridge refuses other origins, subframes, other windows and unsupported inputs before connecting
---
duration_ms: 487.0339
type: 'test'
...
# Subtest: file reveal binds the current project, task, path, UTF-8 bytes and original SHA without executing the file
ok 153 - file reveal binds the current project, task, path, UTF-8 bytes and original SHA without executing the file
---
duration_ms: 445.3256
type: 'test'
...
# Subtest: file changed during asynchronous task recheck is not revealed as the old bytes
ok 154 - file changed during asynchronous task recheck is not revealed as the old bytes
---
duration_ms: 835.7426
type: 'test'
...
# Subtest: desktop browser profile and aliases stay outside project inventory and file access
ok 155 - desktop browser profile and aliases stay outside project inventory and file access
---
duration_ms: 943.4356
type: 'test'
...
# Subtest: native picker cancel and origin change after dialog publish no project registration
ok 156 - native picker cancel and origin change after dialog publish no project registration
---
duration_ms: 802.2505
type: 'test'
...
# Subtest: pending native action is not dispatched twice, and current task review returns its original seq
ok 157 - pending native action is not dispatched twice, and current task review returns its original seq
---
duration_ms: 669.6444
type: 'test'
...
# Subtest: native stop cancellation and changed original host never stop a replacement process
ok 158 - native stop cancellation and changed original host never stop a replacement process
---
duration_ms: 573.3915
type: 'test'
...
# Subtest: window register rejects host PID, stale installation, extra fields and missing creation identity
ok 159 - window register rejects host PID, stale installation, extra fields and missing creation identity
---
duration_ms: 0.509
type: 'test'
...
# Subtest: a rebuilt source archive binds actual generated client assets and retains its original running identity after disk changes
ok 160 - a rebuilt source archive binds actual generated client assets and retains its original running identity after disk changes
---
duration_ms: 2955.8542
type: 'test'
...
# Subtest: host challenge proof rejects a stale challenge, changed identity and changed signature
ok 161 - host challenge proof rejects a stale challenge, changed identity and changed signature
---
duration_ms: 0.8524
type: 'test'
...
# Subtest: stop confirmation binds the original instance, creation and loaded runtime
ok 162 - stop confirmation binds the original instance, creation and loaded runtime
---
duration_ms: 0.148
type: 'test'
...
# Subtest: state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
ok 163 - state paths reject escaping, linked ancestors, ambiguous hardlinks and damaged JSON
---
duration_ms: 873.091
type: 'test'
...
# Subtest: failed registration publishes no initialized memory and can complete after its actual inputs are supplied
ok 164 - failed registration publishes no initialized memory and can complete after its actual inputs are supplied
---
duration_ms: 4349.3856
type: 'test'
...
# Subtest: host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
ok 165 - host shutdown cancels an un-signalled HTTP model request and refuses later requests until recovered
---
duration_ms: 1.3714
type: 'test'
...
# Subtest: host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
ok 166 - host shutdown cancels model-pool acquisition and releases queue ownership without inventing attempts
---
duration_ms: 697.4903
type: 'test'
...
# Subtest: full candidate validation returns the exact loaded-input host identity and rejects undeclared or altered files
ok 167 - full candidate validation returns the exact loaded-input host identity and rejects undeclared or altered files
---
duration_ms: 2563.0003
type: 'test'
...
# Subtest: installation requires separate absolute program/data directories and a candidate in its own versions namespace
ok 168 - installation requires separate absolute program/data directories and a candidate in its own versions namespace
---
duration_ms: 1459.3906
type: 'test'
...
# Subtest: staging retains the original data and pointer without querying or restarting a host
ok 169 - staging retains the original data and pointer without querying or restarting a host
---
duration_ms: 2480.6306
type: 'test'
...
# Subtest: a post-pointer failure restores every original pointer byte and persistent row; a first-install failure removes only its published pointer
ok 170 - a post-pointer failure restores every original pointer byte and persistent row; a first-install failure removes only its published pointer
---
duration_ms: 6374.1934
type: 'test'
...
# Subtest: changed active manifest and concurrent pointer changes are rejected without overwriting the unknown record
ok 171 - changed active manifest and concurrent pointer changes are rejected without overwriting the unknown record
---
duration_ms: 3265.6447
type: 'test'
...
# Subtest: an unregistered non-HTTP listener blocks preflight even when service-info is absent
ok 172 - an unregistered non-HTTP listener blocks preflight even when service-info is absent
---
duration_ms: 1855.5981
type: 'test'
...
# Subtest: uninstall archives its original pointer and preserves every data row/artifact instead of recursively deleting data
ok 173 - uninstall archives its original pointer and preserves every data row/artifact instead of recursively deleting data
---
duration_ms: 4158.6311
type: 'test'
...
# Subtest: preflight rejects an unrelated program root or changed native bootstrap while preserving its original bytes
ok 174 - preflight rejects an unrelated program root or changed native bootstrap while preserving its original bytes
---
duration_ms: 1681.9743
type: 'test'
...
# Subtest: a changed owned bootstrap follows its candidate and a post-pointer fault restores both original bytes
ok 175 - a changed owned bootstrap follows its candidate and a post-pointer fault restores both original bytes
---
duration_ms: 7597.5854
type: 'test'
...
# Subtest: an external bootstrap change after preflight is preserved and never overwritten as an update or rollback
ok 176 - an external bootstrap change after preflight is preserved and never overwritten as an update or rollback
---
duration_ms: 5299.5549
type: 'test'
...
# Subtest: owned startup retries only read-only observation after a slow health response and attests the same original child
ok 177 - owned startup retries only read-only observation after a slow health response and attests the same original child
---
duration_ms: 4493.171
type: 'test'
...
# Subtest: unverified startup expires with its original live child and never treats timeout or an unrelated health PID as proof
ok 178 - unverified startup expires with its original live child and never treats timeout or an unrelated health PID as proof
---
duration_ms: 7047.704
type: 'test'
...
# Subtest: a question about the previous workbench error receives local error context and current change states
ok 179 - a question about the previous workbench error receives local error context and current change states
---
duration_ms: 1709.4193
type: 'test'
...
# Subtest: a transient model failure after an approved command retries only the model request
ok 180 - a transient model failure after an approved command retries only the model request
---
duration_ms: 2197.2647
type: 'test'
...
# Subtest: exhausted model retries preserve tool results, and explicit resume adds no new user turn or replay
ok 181 - exhausted model retries preserve tool results, and explicit resume adds no new user turn or replay
---
duration_ms: 2107.7438
type: 'test'
...
# Subtest: stopping during model backoff cancels further requests and clears the running request state
ok 182 - stopping during model backoff cancels further requests and clears the running request state
---
duration_ms: 1035.8404
type: 'test'
...
# Subtest: HTTP authentication errors are classified, redacted and never automatically retried
ok 183 - HTTP authentication errors are classified, redacted and never automatically retried
---
duration_ms: 19.9593
type: 'test'
...
# Subtest: temporary HTTP service errors retry and recover with recorded attempt counts
ok 184 - temporary HTTP service errors retry and recover with recorded attempt counts
---
duration_ms: 6.4289
type: 'test'
...
# Subtest: invalid and oversized protocol responses fail once with a useful response-format diagnosis
ok 185 - invalid and oversized protocol responses fail once with a useful response-format diagnosis
---
duration_ms: 4.1623
type: 'test'
...
# Subtest: HTTP rate limits expose their source and obey the service retry interval before recovery
ok 186 - HTTP rate limits expose their source and obey the service retry interval before recovery
---
duration_ms: 1016.7561
type: 'test'
...
# Subtest: Windows commands preserve Chinese through a PowerShell pipeline into Node
ok 187 - Windows commands preserve Chinese through a PowerShell pipeline into Node
---
duration_ms: 761.1768
type: 'test'
...
# Subtest: Windows shell syntax errors stay readable and native command exit codes are retained
ok 188 - Windows shell syntax errors stay readable and native command exit codes are retained
---
duration_ms: 1149.4451
type: 'test'
...
# Subtest: review and completed states do not turn a generic continue click into a new model request
ok 189 - review and completed states do not turn a generic continue click into a new model request
---
duration_ms: 562.5845
type: 'test'
...
# Subtest: old session data receives a truthful historical connection diagnosis without rewriting history
ok 190 - old session data receives a truthful historical connection diagnosis without rewriting history
---
duration_ms: 670.0469
type: 'test'
...
# Subtest: engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
ok 191 - engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
---
duration_ms: 5399.4827
type: 'test'
...
# Subtest: HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
ok 192 - HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
---
duration_ms: 3895.6398
type: 'test'
...
# Subtest: controlled engine HTTP freezes one child, pages original owned input/report, rejects foreign reads and prevents changed-source reuse
ok 193 - controlled engine HTTP freezes one child, pages original owned input/report, rejects foreign reads and prevents changed-source reuse
---
duration_ms: 18018.9288
type: 'test'
...
# Subtest: native text and call IDs preserve original result pairing while unsupported content fails closed
ok 194 - native text and call IDs preserve original result pairing while unsupported content fails closed
---
duration_ms: 0.7712
type: 'test'
...
# Subtest: one engine child freezes real installation identity before creating tasks and rejects a changed source
ok 195 - one engine child freezes real installation identity before creating tasks and rejects a changed source
---
duration_ms: 11173.0707
type: 'test'
...
# Subtest: owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
ok 196 - owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
---
duration_ms: 27738.0617
type: 'test'
...
# Subtest: forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
ok 197 - forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
---
duration_ms: 15013.4816
type: 'test'
...
# Subtest: duplicate native IDs are rejected without replaying a saved tool
ok 198 - duplicate native IDs are rejected without replaying a saved tool
---
duration_ms: 14569.7251
type: 'test'
...
# Subtest: native input exceeding the context budget is retained and sends no model request
ok 199 - native input exceeding the context budget is retained and sends no model request
---
duration_ms: 13086.3574
type: 'test'
...
# Subtest: stop retains a late reported model usage once and executes no tool from that output
ok 200 - stop retains a late reported model usage once and executes no tool from that output
---
duration_ms: 13611.5944
type: 'test'
...
# Subtest: a source change after the original model intent stops before native tools execute
ok 201 - a source change after the original model intent stops before native tools execute
---
duration_ms: 13948.1027
type: 'test'
...
# Subtest: an engine source change while approval is pending invalidates the old permission before any check starts
ok 202 - an engine source change while approval is pending invalidates the old permission before any check starts
---
duration_ms: 17049.9092
type: 'test'
...
# Subtest: missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
ok 203 - missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
---
duration_ms: 0.6402
type: 'test'
...
# Subtest: closed root with an original live descendant remains unknown and retains its process tree
ok 204 - closed root with an original live descendant remains unknown and retains its process tree
---
duration_ms: 0.275
type: 'test'
...
# Subtest: host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
ok 205 - host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
---
duration_ms: 16794.7623
type: 'test'
...
# Subtest: corrupted model reservation cannot reduce recovered budget or permit a new engine request
ok 206 - corrupted model reservation cannot reduce recovered budget or permit a new engine request
---
duration_ms: 13571.1663
type: 'test'
...
# Subtest: engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
ok 207 - engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
---
duration_ms: 789.699
type: 'test'
...
# Subtest: owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
ok 208 - owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
---
duration_ms: 1330.922
type: 'test'
...
# Subtest: an invalid startup nonce is rejected before initialize and preserves the process close and partial report
ok 209 - an invalid startup nonce is rejected before initialize and preserves the process close and partial report
---
duration_ms: 1433.5281
type: 'test'
...
# Subtest: SDK identity and session directory mismatches retain raw responses and never become verified
ok 210 - SDK identity and session directory mismatches retain raw responses and never become verified
---
duration_ms: 3705.5005
type: 'test'
...
# Subtest: cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
ok 211 - cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
---
duration_ms: 1420.0548
type: 'test'
...
# Subtest: cancel before readiness sends no protocol request and a user retry creates a different process and record
ok 212 - cancel before readiness sends no protocol request and a user retry creates a different process and record
---
duration_ms: 2252.1552
type: 'test'
...
# Subtest: source or scratch changes and unexpected model traffic fail after preserving the actual observed result
ok 213 - source or scratch changes and unexpected model traffic fail after preserving the actual observed result
---
duration_ms: 4046.11
type: 'test'
...
# Subtest: unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
ok 214 - unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
---
duration_ms: 2330.4767
type: 'test'
...
# Subtest: engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
ok 215 - engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
---
duration_ms: 1034.3931
type: 'test'
...
# Subtest: foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
ok 216 - foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
---
duration_ms: 1201.9959
type: 'test'
...
# Subtest: restart never replays an active engine check or stops a historical PID, and keeps prior task state
ok 217 - restart never replays an active engine check or stops a historical PID, and keeps prior task state
---
duration_ms: 1555.8598
type: 'test'
...
# Subtest: model argument validation and runtime activity do not grant external engine prompt or project execution
ok 218 - model argument validation and runtime activity do not grant external engine prompt or project execution
---
duration_ms: 578.1733
type: 'test'
...
# Subtest: a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
ok 219 - a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
---
duration_ms: 2236.7477
type: 'test'
...
# Subtest: unfixed dependency URLs and invalid integrity are reported without exposing URL credentials or allowing a plan
ok 220 - unfixed dependency URLs and invalid integrity are reported without exposing URL credentials or allowing a plan
---
duration_ms: 615.0723
type: 'test'
...
# Subtest: hot upgrade refuses an active dependency operation or evaluation before changing runtime objects
ok 221 - hot upgrade refuses an active dependency operation or evaluation before changing runtime objects
---
duration_ms: 0.5349
type: 'test'
...
# Subtest: read-only environment diagnosis identifies actual runtime, missing dependencies and sealed inputs without installing or running scripts
ok 222 - read-only environment diagnosis identifies actual runtime, missing dependencies and sealed inputs without installing or running scripts
---
duration_ms: 7591.9215
type: 'test'
...
# Subtest: diagnosis rejects unsupported managers, lock integrity and credential configuration without reading config content
ok 223 - diagnosis rejects unsupported managers, lock integrity and credential configuration without reading config content
---
duration_ms: 6687.5969
type: 'test'
...
# Subtest: approved real npm ci runs only in owned worktree, skips scripts, retains logs and binds later actual tests
ok 224 - approved real npm ci runs only in owned worktree, skips scripts, retains logs and binds later actual tests
---
duration_ms: 17583.5864
type: 'test'
...
# Subtest: explicitly allowing lifecycle scripts executes sealed root script and preserves the separate preparation result
ok 225 - explicitly allowing lifecycle scripts executes sealed root script and preserves the separate preparation result
---
duration_ms: 11394.8671
type: 'test'
...
# Subtest: stale lockfile, tampered plan/config, cross-session identities and mismatched download sources never dispatch npm
ok 226 - stale lockfile, tampered plan/config, cross-session identities and mismatched download sources never dispatch npm
---
duration_ms: 8845.0159
type: 'test'
...
# Subtest: registry failure keeps original npm exit/log and performs no automatic fallback or replay
ok 227 - registry failure keeps original npm exit/log and performs no automatic fallback or replay
---
duration_ms: 10664.0019
type: 'test'
...
# Subtest: stopping a hanging dependency download records only its owned process and preserves stopped logs
ok 228 - stopping a hanging dependency download records only its owned process and preserves stopped logs
---
duration_ms: 11332.9888
type: 'test'
...
# Subtest: restart retains unknown preparation, blocks writes and checks, and requires explicit read-only reconciliation
ok 229 - restart retains unknown preparation, blocks writes and checks, and requires explicit read-only reconciliation
---
duration_ms: 7901.4386
type: 'test'
...
# Subtest: HTTP environment flow survives refresh, requires explicit approval and preserves task and artifact ownership
ok 230 - HTTP environment flow survives refresh, requires explicit approval and preserves task and artifact ownership
---
duration_ms: 24109.4032
type: 'test'
...
# Subtest: Python environment diagnosis reads declarations and runtime identity without executing project code or installing packages
ok 231 - Python environment diagnosis reads declarations and runtime identity without executing project code or installing packages
---
duration_ms: 801.4664
type: 'test'
...
# Subtest: empty build cache directories keep dependency identity while added executable files invalidate it
ok 232 - empty build cache directories keep dependency identity while added executable files invalidate it
---
duration_ms: 908.39
type: 'test'
...
# Subtest: dependency snapshots reject external links and incomplete budgets instead of claiming environment equivalence
ok 233 - dependency snapshots reject external links and incomplete budgets instead of claiming environment equivalence
---
duration_ms: 709.9372
type: 'test'
...
# Subtest: model-requested environment preparation uses the original approval boundary and never treats preparation as passed engineering checks
ok 234 - model-requested environment preparation uses the original approval boundary and never treats preparation as passed engineering checks
---
duration_ms: 13867.7495
type: 'test'
...
# Subtest: timeout and offline cache miss retain actual failures and new attempts require newly sealed plans
ok 235 - timeout and offline cache miss retain actual failures and new attempts require newly sealed plans
---
duration_ms: 15742.0879
type: 'test'
...
# Subtest: both evaluation worktrees can approve fixed dependency preparation and different actual dependencies reject candidate execution
ok 236 - both evaluation worktrees can approve fixed dependency preparation and different actual dependencies reject candidate execution
---
duration_ms: 37188.6257
type: 'test'
...
# Subtest: evaluation denominator distinguishes attempted unsealed candidates from unexecuted samples
ok 237 - evaluation denominator distinguishes attempted unsealed candidates from unexecuted samples
---
duration_ms: 0.314
type: 'test'
...
# Subtest: evaluation summary retains sealed outcomes and stopped or failed original attempts
ok 238 - evaluation summary retains sealed outcomes and stopped or failed original attempts
---
duration_ms: 0.5078
type: 'test'
...
# Subtest: evaluation contract fixes bounded samples, source paths, checks and aggregate budget
ok 239 - evaluation contract fixes bounded samples, source paths, checks and aggregate budget
---
duration_ms: 522.364
type: 'test'
...
# Subtest: same-source workspaces seal real commands before execution and preserve original staged and unstaged bytes
ok 240 - same-source workspaces seal real commands before execution and preserve original staged and unstaged bytes
---
duration_ms: 16836.8289
type: 'test'
...
# Subtest: actual original failures and candidate success are both preserved, then adoption requires parent review, checks and Git
ok 241 - actual original failures and candidate success are both preserved, then adoption requires parent review, checks and Git
---
duration_ms: 65763.4423
type: 'test'
...
# Subtest: candidate cannot shrink tests and changing original test bytes rejects execution before any model request
ok 242 - candidate cannot shrink tests and changing original test bytes rejects execution before any model request
---
duration_ms: 24671.4385
type: 'test'
...
# Subtest: missing upstream usage remains unknown and does not become a free run or invented cost
ok 243 - missing upstream usage remains unknown and does not become a free run or invented cost
---
duration_ms: 41518.4084
type: 'test'
...
# Subtest: missing raw check logs preserve unknown result and original sample denominator
ok 244 - missing raw check logs preserve unknown result and original sample denominator
---
duration_ms: 43320.8187
type: 'test'
...
# Subtest: source and model changes never silently replace an existing batch input
ok 245 - source and model changes never silently replace an existing batch input
---
duration_ms: 3872.6953
type: 'test'
...
# Subtest: model revision change before preparing a fixed sample cannot silently use the replacement connection
ok 246 - model revision change before preparing a fixed sample cannot silently use the replacement connection
---
duration_ms: 3361.9833
type: 'test'
...
# Subtest: HTTP evaluations require host token, original fingerprint and session ownership; worker API cannot bypass evaluation flow
ok 247 - HTTP evaluations require host token, original fingerprint and session ownership; worker API cannot bypass evaluation flow
---
duration_ms: 19786.5994
type: 'test'
...
# Subtest: sample queue cannot skip or reset attempted samples, and reports freeze further writes
ok 248 - sample queue cannot skip or reset attempted samples, and reports freeze further writes
---
duration_ms: 36154.7381
type: 'test'
...
# Subtest: stop cancels only current candidate and preserves partial results instead of replaying a request
ok 249 - stop cancels only current candidate and preserves partial results instead of replaying a request
---
duration_ms: 30046.6657
type: 'test'
...
# Subtest: restart recovers interrupted evaluations as unknown and keeps completed checks and plan identity
ok 250 - restart recovers interrupted evaluations as unknown and keeps completed checks and plan identity
---
duration_ms: 33911.2723
type: 'test'
...
# Subtest: JSON migration survives process exit before commit and retains exact legacy backups
ok 251 - JSON migration survives process exit before commit and retains exact legacy backups
---
duration_ms: 1812.2445
type: 'test'
...
# Subtest: process exit after_state rolls back state, event and outbox together
ok 252 - process exit after_state rolls back state, event and outbox together
---
duration_ms: 1609.5584
type: 'test'
...
# Subtest: process exit after_event rolls back state, event and outbox together
ok 253 - process exit after_event rolls back state, event and outbox together
---
duration_ms: 1323.8212
type: 'test'
...
# Subtest: crash recovery at accepted retains execution identity and never replays side effects
ok 254 - crash recovery at accepted retains execution identity and never replays side effects
---
duration_ms: 1603.3895
type: 'test'
...
# Subtest: crash recovery at queued retains execution identity and never replays side effects
ok 255 - crash recovery at queued retains execution identity and never replays side effects
---
duration_ms: 2010.7264
type: 'test'
...
# Subtest: crash recovery at approval_wait retains execution identity and never replays side effects
ok 256 - crash recovery at approval_wait retains execution identity and never replays side effects
---
duration_ms: 2509.4981
type: 'test'
...
# Subtest: crash recovery at approved retains execution identity and never replays side effects
ok 257 - crash recovery at approved retains execution identity and never replays side effects
---
duration_ms: 2770.6159
type: 'test'
...
# Subtest: crash recovery at effect_unrecorded retains execution identity and never replays side effects
ok 258 - crash recovery at effect_unrecorded retains execution identity and never replays side effects
---
duration_ms: 2303.3785
type: 'test'
...
# Subtest: crash recovery at result_committed retains execution identity and never replays side effects
ok 259 - crash recovery at result_committed retains execution identity and never replays side effects
---
duration_ms: 3471.7599
type: 'test'
...
# Subtest: crash recovery at before_next_model retains execution identity and never replays side effects
ok 260 - crash recovery at before_next_model retains execution identity and never replays side effects
---
duration_ms: 3146.0058
type: 'test'
...
# Subtest: state and event failures publish no success and preserve the last committed memory snapshot
ok 261 - state and event failures publish no success and preserve the last committed memory snapshot
---
duration_ms: 696.2354
type: 'test'
...
# Subtest: tool result artifacts and event cursors retain project ownership across restart
ok 262 - tool result artifacts and event cursors retain project ownership across restart
---
duration_ms: 1089.107
type: 'test'
...
# Subtest: token budgets pause before tools execute and continuation keeps original task and accumulated usage
ok 263 - token budgets pause before tools execute and continuation keeps original task and accumulated usage
---
duration_ms: 1276.0996
type: 'test'
...
# Subtest: a time budget interrupts an unresponsive model and persists a resumable run
ok 264 - a time budget interrupts an unresponsive model and persists a resumable run
---
duration_ms: 731.8401
type: 'test'
...
# Subtest: a corrupted large result artifact cannot become a recovered success
ok 265 - a corrupted large result artifact cannot become a recovered success
---
duration_ms: 806.2056
type: 'test'
...
# Subtest: hard-link aliases cannot expose protected bytes through reads, proposals, inventory or automatic project rules
ok 266 - hard-link aliases cannot expose protected bytes through reads, proposals, inventory or automatic project rules
---
duration_ms: 767.0394
type: 'test'
...
# Subtest: ambiguous project hard links are explicit and ordinary independent file copies remain readable
ok 267 - ambiguous project hard links are explicit and ordinary independent file copies remain readable
---
duration_ms: 703.2081
type: 'test'
...
# Subtest: proposals preserve project bytes until review; apply backs up the exact original bytes
ok 268 - proposals preserve project bytes until review; apply backs up the exact original bytes
---
duration_ms: 770.2471
type: 'test'
...
# Subtest: new nested files are created only on apply and unchanged content creates no proposal
ok 269 - new nested files are created only on apply and unchanged content creates no proposal
---
duration_ms: 686.5411
type: 'test'
...
# Subtest: stale reads and changed baselines are rejected without overwriting external edits
ok 270 - stale reads and changed baselines are rejected without overwriting external edits
---
duration_ms: 562.5166
type: 'test'
...
# Subtest: file paths reject traversal, absolute paths, credentials and outside junctions
ok 271 - file paths reject traversal, absolute paths, credentials and outside junctions
---
duration_ms: 604.997
type: 'test'
...
# Subtest: read and search expose bounded text scopes and reject non UTF-8 / oversized files
ok 272 - read and search expose bounded text scopes and reject non UTF-8 / oversized files
---
duration_ms: 603.6414
type: 'test'
...
# Subtest: project-local junctions cannot expose or create protected Git and credential files
ok 273 - project-local junctions cannot expose or create protected Git and credential files
---
duration_ms: 552.0229
type: 'test'
...
# Subtest: Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
ok 274 - Windows trailing-dot and trailing-space path aliases cannot bypass protected paths
---
duration_ms: 488.4943
type: 'test'
...
# Subtest: a starter is copied into user data once; restarting from another program version preserves existing projects and editable bytes
ok 275 - a starter is copied into user data once; restarting from another program version preserves existing projects and editable bytes
---
duration_ms: 1115.8134
type: 'test'
...
# Subtest: startup does not insert a demo or rewrite/reorder an existing user project registry
ok 276 - startup does not insert a demo or rewrite/reorder an existing user project registry
---
duration_ms: 598.1109
type: 'test'
...
# Subtest: PNG bytes are fully decoded, metadata-free and bounded; JPEG EXIF orientation is applied to the sent PNG
ok 277 - PNG bytes are fully decoded, metadata-free and bounded; JPEG EXIF orientation is applied to the sent PNG
---
duration_ms: 105.5947
type: 'test'
...
# Subtest: forged type, short headers, CRC damage, incomplete chunks, trailing payloads, animation and dimension bombs reject
ok 278 - forged type, short headers, CRC damage, incomplete chunks, trailing payloads, animation and dimension bombs reject
---
duration_ms: 25.7089
type: 'test'
...
# Subtest: draft image ownership, withdrawal, reload and atomic Task binding retain original SHA and original bytes
ok 279 - draft image ownership, withdrawal, reload and atomic Task binding retain original SHA and original bytes
---
duration_ms: 900.683
type: 'test'
...
# Subtest: a failed session transaction restores draft status and cannot leave a Run consuming the attachment
ok 280 - a failed session transaction restores draft status and cannot leave a Run consuming the attachment
---
duration_ms: 569.4081
type: 'test'
...
# Subtest: draft limits, duplicate selection, source changes and cross-Task association reject before dispatch
ok 281 - draft limits, duplicate selection, source changes and cross-Task association reject before dispatch
---
duration_ms: 1206.0436
type: 'test'
...
# Subtest: demo and legacy paths refuse image dispatch without creating a Task or consuming the draft
ok 282 - demo and legacy paths refuse image dispatch without creating a Task or consuming the draft
---
duration_ms: 668.7514
type: 'test'
...
# Subtest: chat-completions sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
ok 283 - chat-completions sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
---
duration_ms: 1980.465
type: 'test'
...
# Subtest: responses sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
ok 284 - responses sends one owned image per actual request, pairs original tools and verifies exact sealed bytes
---
duration_ms: 2056.8637
type: 'test'
...
# Subtest: mixed pool excludes unknown vision before lease and sends zero HTTP to the incompatible member
ok 285 - mixed pool excludes unknown vision before lease and sends zero HTTP to the incompatible member
---
duration_ms: 1349.4385
type: 'test'
...
# Subtest: vision probe requires correct randomized pixel order and evidence expires when the connection revision changes
ok 286 - vision probe requires correct randomized pixel order and evidence expires when the connection revision changes
---
duration_ms: 765.9196
type: 'test'
...
# Subtest: HTTP upload/read/withdraw uses session authorization, returns byte SHA and refuses unknown ownership
ok 287 - HTTP upload/read/withdraw uses session authorization, returns byte SHA and refuses unknown ownership
---
duration_ms: 641.6667
type: 'test'
...
# Subtest: image accounting excludes Base64 as text but seals every original request byte and reserves image input separately
ok 288 - image accounting excludes Base64 as text but seals every original request byte and reserves image input separately
---
duration_ms: 3.4058
type: 'test'
...
# Subtest: MCP registration stays disabled until an explicit real stdio probe and schema-based tool selection, with actual process cleanup
ok 289 - MCP registration stays disabled until an explicit real stdio probe and schema-based tool selection, with actual process cleanup
---
duration_ms: 1869.101
type: 'test'
...
# Subtest: MCP probe holds the project operation lock until its owned process and report are settled
ok 290 - MCP probe holds the project operation lock until its owned process and report are settled
---
duration_ms: 1479.3718
type: 'test'
...
# Subtest: MCP validates the declared JSON schema subset and rejects unsupported schemas before external dispatch
ok 291 - MCP validates the declared JSON schema subset and rejects unsupported schemas before external dispatch
---
duration_ms: 0.5814
type: 'test'
...
# Subtest: actual model MCP call approves long schema-valid arguments, validates the sent catalog and stores one original result without leaking environment secrets
ok 292 - actual model MCP call approves long schema-valid arguments, validates the sent catalog and stores one original result without leaking environment secrets
---
duration_ms: 3901.5739
type: 'test'
...
# Subtest: denying an MCP call never starts another process or executes the external tool
ok 293 - denying an MCP call never starts another process or executes the external tool
---
duration_ms: 2839.0207
type: 'test'
...
# Subtest: actual handshake drift rejects tools/call even if program entry hash is unchanged
ok 294 - actual handshake drift rejects tools/call even if program entry hash is unchanged
---
duration_ms: 3940.2634
type: 'test'
...
# Subtest: cancelled dispatched external side effect stays unknown, closes its owned process and cannot replay on reopen
ok 295 - cancelled dispatched external side effect stays unknown, closes its owned process and cannot replay on reopen
---
duration_ms: 3144.7292
type: 'test'
...
# Subtest: changed executable input, foreign project IDs and corrupted original contracts block enable and dispatch
ok 296 - changed executable input, foreign project IDs and corrupted original contracts block enable and dispatch
---
duration_ms: 1782.6934
type: 'test'
...
# Subtest: registered MCP HTTP API uses fixed execution contracts and project-owned probe records with no model requests
ok 297 - registered MCP HTTP API uses fixed execution contracts and project-owned probe records with no model requests
---
duration_ms: 3211.7775
type: 'test'
...
# Subtest: unknown MCP pauses later tool calls and all project writers; fingerprinted acknowledgement clears only the review gates and explicit resume does not replay
ok 298 - unknown MCP pauses later tool calls and all project writers; fingerprinted acknowledgement clears only the review gates and explicit resume does not replay
---
duration_ms: 4937.6925
type: 'test'
...
# Subtest: MCP acknowledgement persistence failure restores both job and tool review gates; corrupt evidence cannot be acknowledged
ok 299 - MCP acknowledgement persistence failure restores both job and tool review gates; corrupt evidence cannot be acknowledged
---
duration_ms: 4260.9124
type: 'test'
...
# Subtest: actual host exit after an external effect restores unknown jobs without a fabricated report, allows source-bound review and never replays the call
ok 300 - actual host exit after an external effect restores unknown jobs without a fabricated report, allows source-bound review and never replays the call
---
duration_ms: 3124.642
type: 'test'
...
# Subtest: changed enabled MCP programs can be explicitly disabled without launching or trusting their changed source
ok 301 - changed enabled MCP programs can be explicitly disabled without launching or trusting their changed source
---
duration_ms: 1367.294
type: 'test'
...
# Subtest: stdio preserves split UTF-8 frames and final replies drained after process exit
ok 302 - stdio preserves split UTF-8 frames and final replies drained after process exit
---
duration_ms: 1723.2462
type: 'test'
...
# Subtest: server-initiated model requests are refused instead of inheriting provider privileges
ok 303 - server-initiated model requests are refused instead of inheriting provider privileges
---
duration_ms: 877.421
type: 'test'
...
# Subtest: invalid or over-budget protocol invalid closes only its owned process and is not retried
ok 304 - invalid or over-budget protocol invalid closes only its owned process and is not retried
---
duration_ms: 914.1102
type: 'test'
...
# Subtest: invalid or over-budget protocol oversized closes only its owned process and is not retried
ok 305 - invalid or over-budget protocol oversized closes only its owned process and is not retried
---
duration_ms: 758.7768
type: 'test'
...
# Subtest: cancel and timeout do not resend a dispatched request and pre-cancel has no request trace
ok 306 - cancel and timeout do not resend a dispatched request and pre-cancel has no request trace
---
duration_ms: 741.0566
type: 'test'
...
# Subtest: startup failure remains undispatched and has no process PID to terminate
ok 307 - startup failure remains undispatched and has no process PID to terminate
---
duration_ms: 568.3954
type: 'test'
...
# Subtest: REA launch filters a fixture credential canary and rejects changed entry identity before a new connection
ok 308 - REA launch filters a fixture credential canary and rejects changed entry identity before a new connection
---
duration_ms: 964.5484
type: 'test'
...
# Subtest: schema1 connections remain readable without inventing observed capabilities or migrating original state
ok 309 - schema1 connections remain readable without inventing observed capabilities or migrating original state
---
duration_ms: 546.0156
type: 'test'
...
# Subtest: protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence
ok 310 - protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence
---
duration_ms: 563.0516
type: 'test'
...
# Subtest: ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing
ok 311 - ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing
---
duration_ms: 0.2844
type: 'test'
...
# Subtest: invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate
ok 312 - invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate
---
duration_ms: 486.2185
type: 'test'
...
# Subtest: model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
ok 313 - model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart
---
duration_ms: 1075.0425
type: 'test'
...
# Subtest: config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
ok 314 - config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts
---
duration_ms: 940.7613
type: 'test'
...
# Subtest: real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
ok 315 - real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity
---
duration_ms: 2577.4685
type: 'test'
...
# Subtest: pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
ok 316 - pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests
---
duration_ms: 3213.6172
type: 'test'
...
# Subtest: 401 blocks the credential revision; updating the key restores availability without leaking error echoes
ok 317 - 401 blocks the credential revision; updating the key restores availability without leaking error echoes
---
duration_ms: 1367.162
type: 'test'
...
# Subtest: queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
ok 318 - queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request
---
duration_ms: 766.6923
type: 'test'
...
# Subtest: compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
ok 319 - compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model
---
duration_ms: 2520.7678
type: 'test'
...
# Subtest: model registry disk failures restore routing, pool profiles and credential references without partial updates
ok 320 - model registry disk failures restore routing, pool profiles and credential references without partial updates
---
duration_ms: 539.6526
type: 'test'
...
# Subtest: model selection and saved configuration commit together and failures preserve the original mode and endpoint
ok 321 - model selection and saved configuration commit together and failures preserve the original mode and endpoint
---
duration_ms: 653.1577
type: 'test'
...
# Subtest: configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
ok 322 - configuration imports roll back the entire batch and retain one usable preview after validation or commit failure
---
duration_ms: 600.3118
type: 'test'
...
# Subtest: HTTP quota retains native code/type/param/request id, bounded original and allowlisted headers, never repeats that connection
ok 323 - HTTP quota retains native code/type/param/request id, bounded original and allowlisted headers, never repeats that connection
---
duration_ms: 1447.2217
type: 'test'
...
# Subtest: Retry-After above 90 seconds remains exact and a short local budget cannot trigger an early retry
ok 324 - Retry-After above 90 seconds remains exact and a short local budget cannot trigger an early retry
---
duration_ms: 1.2168
type: 'test'
...
# Subtest: Retry-After date, expired date, huge value and invalid header retain explicit semantics
ok 325 - Retry-After date, expired date, huge value and invalid header retain explicit semantics
---
duration_ms: 0.8579
type: 'test'
...
# Subtest: unclassified 429 remains unspecified and every bounded actual retry retains its own original error
ok 326 - unclassified 429 remains unspecified and every bounded actual retry retains its own original error
---
duration_ms: 1357.7174
type: 'test'
...
# Subtest: oversized HTTP error saves exactly the bounded prefix and labels its incomplete range
ok 327 - oversized HTTP error saves exactly the bounded prefix and labels its incomplete range
---
duration_ms: 1302.6953
type: 'test'
...
# Subtest: Chat SSE error preserves upstream fields, original failed event, partial tool and reported usage without executing or retrying
ok 328 - Chat SSE error preserves upstream fields, original failed event, partial tool and reported usage without executing or retrying
---
duration_ms: 1247.298
type: 'test'
...
# Subtest: Responses failed SSE retains original event/response identity and usage
ok 329 - Responses failed SSE retains original event/response identity and usage
---
duration_ms: 1240.8475
type: 'test'
...
# Subtest: Responses incomplete SSE retains original event/response identity and usage
ok 330 - Responses incomplete SSE retains original event/response identity and usage
---
duration_ms: 1233.607
type: 'test'
...
# Subtest: unsupported successful Responses output retains original JSON and usage with a local protocol origin
ok 331 - unsupported successful Responses output retains original JSON and usage with a local protocol origin
---
duration_ms: 1183.9272
type: 'test'
...
# Subtest: HTTP 200 native error is still an upstream failure rather than a fabricated successful answer
ok 332 - HTTP 200 native error is still an upstream failure rather than a fabricated successful answer
---
duration_ms: 0.9677
type: 'test'
...
# Subtest: JSON-escaped credential echoes are redacted in the original preview and capture as well as parsed fields
ok 333 - JSON-escaped credential echoes are redacted in the original preview and capture as well as parsed fields
---
duration_ms: 0.7074
type: 'test'
...
# Subtest: quota failover uses another independent pool member and never replays a failed stream
ok 334 - quota failover uses another independent pool member and never replays a failed stream
---
duration_ms: 1879.5539
type: 'test'
...
# Subtest: native parameters are isolated by pool member, preserve Responses state and bind the original output reservation
ok 335 - native parameters are isolated by pool member, preserve Responses state and bind the original output reservation
---
duration_ms: 0.336
type: 'test'
...
# Subtest: unsupported native fields and invalid values reject before dispatch instead of silently dropping or overriding constraints
ok 336 - unsupported native fields and invalid values reject before dispatch instead of silently dropping or overriding constraints
---
duration_ms: 0.304
type: 'test'
...
# Subtest: native settings for legacy and registered profiles persist without changing credentials or old records and reject stale edits
ok 337 - native settings for legacy and registered profiles persist without changing credentials or old records and reject stale edits
---
duration_ms: 1267.4238
type: 'test'
...
# Subtest: compiled native settings API saves/restores exact parameters and rejects reserved fields without mutating the profile
ok 338 - compiled native settings API saves/restores exact parameters and rejects reserved fields without mutating the profile
---
duration_ms: 2865.9622
type: 'test'
...
# Subtest: legacy connection test sends its saved native fields and selected output limit field without changing the configuration
ok 339 - legacy connection test sends its saved native fields and selected output limit field without changing the configuration
---
duration_ms: 2577.1415
type: 'test'
...
# Subtest: saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
ok 340 - saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance
---
duration_ms: 786.1971
type: 'test'
...
# Subtest: owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
ok 341 - owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched
---
duration_ms: 853.5096
type: 'test'
...
# Subtest: Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
ok 342 - Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes
---
duration_ms: 1892.6213
type: 'test'
...
# Subtest: mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
ok 343 - mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools
---
duration_ms: 2175.8154
type: 'test'
...
# Subtest: Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
# Subtest: Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
ok 1 - Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial"
---
duration_ms: 1334.1965
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
ok 2 - Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal
---
duration_ms: 1264.2733
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
ok 3 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal
---
duration_ms: 1432.0166
type: 'test'
...
# Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
ok 4 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte
---
duration_ms: 1284.2958
type: 'test'
...
1..4
ok 344 - Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
---
duration_ms: 5315.5685
type: 'test'
...
# Subtest: invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
# Subtest: chat-completions
ok 1 - chat-completions
---
duration_ms: 1409.8519
type: 'test'
...
# Subtest: responses
ok 2 - responses
---
duration_ms: 1277.3714
type: 'test'
...
1..2
ok 345 - invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
---
duration_ms: 2687.5802
type: 'test'
...
# Subtest: wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
ok 346 - wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint
---
duration_ms: 0.3564
type: 'test'
...
# Subtest: connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
ok 347 - connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions
---
duration_ms: 619.8901
type: 'test'
...
# Subtest: capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
ok 348 - capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run
---
duration_ms: 1305.6494
type: 'test'
...
# Subtest: all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
ok 349 - all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger
---
duration_ms: 965.4412
type: 'test'
...
# Subtest: explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
ok 350 - explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes
---
duration_ms: 748.6184
type: 'test'
...
# Subtest: plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
ok 351 - plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support
---
duration_ms: 973.6335
type: 'test'
...
# Subtest: a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
ok 352 - a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object
---
duration_ms: 774.289
type: 'test'
...
# Subtest: HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
ok 353 - HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8
---
duration_ms: 2858.9152
type: 'test'
...
# Subtest: terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
ok 354 - terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once
---
duration_ms: 2739.2324
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "" without dispatching any tool
ok 355 - reported SSE usage survives rejected required arguments "" without dispatching any tool
---
duration_ms: 1214.065
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
ok 356 - reported SSE usage survives rejected required arguments "{\\"path\\":" without dispatching any tool
---
duration_ms: 1309.2448
type: 'test'
...
# Subtest: reported SSE usage survives rejected required arguments "null" without dispatching any tool
ok 357 - reported SSE usage survives rejected required arguments "null" without dispatching any tool
---
duration_ms: 1320.3325
type: 'test'
...
# Subtest: a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
ok 358 - a stream without DONE retains reported usage but cannot adapt or execute even an optional tool
---
duration_ms: 1417.7877
type: 'test'
...
# Subtest: a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
ok 359 - a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens
---
duration_ms: 1547.7069
type: 'test'
...
# Subtest: real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
ok 360 - real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage
---
duration_ms: 2170.6086
type: 'test'
...
# Subtest: Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
ok 361 - Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair
---
duration_ms: 2680.912
type: 'test'
...
# Subtest: incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
ok 362 - incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools
---
duration_ms: 1450.396
type: 'test'
...
# Subtest: stopping an active HTTP stream closes only original request and keeps partial text without executing tools
ok 363 - stopping an active HTTP stream closes only original request and keeps partial text without executing tools
---
duration_ms: 1469.2353
type: 'test'
...
# Subtest: explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
ok 364 - explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt
---
duration_ms: 643.9117
type: 'test'
...
# Subtest: coalesced initial SSE events publish the latest partial state even when the upstream stays idle
ok 365 - coalesced initial SSE events publish the latest partial state even when the upstream stays idle
---
duration_ms: 1498.7255
type: 'test'
...
# Subtest: stream timeout closes the original HTTP response, preserves redacted capture and never retries
ok 366 - stream timeout closes the original HTTP response, preserves redacted capture and never retries
---
duration_ms: 935.6617
type: 'test'
...
# Subtest: stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
ok 367 - stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over
---
duration_ms: 1058.439
type: 'test'
...
# Subtest: SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
ok 368 - SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch
---
duration_ms: 0.7761
type: 'test'
...
# Subtest: stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
# Subtest: reject 0
ok 1 - reject 0
---
duration_ms: 0.2089
type: 'test'
...
# Subtest: reject 1
ok 2 - reject 1
---
duration_ms: 0.1534
type: 'test'
...
# Subtest: reject 2
ok 3 - reject 2
---
duration_ms: 0.1837
type: 'test'
...
# Subtest: reject 3
ok 4 - reject 3
---
duration_ms: 5.0118
type: 'test'
...
# Subtest: reject 4
ok 5 - reject 4
---
duration_ms: 0.1214
type: 'test'
...
# Subtest: reject 5
ok 6 - reject 5
---
duration_ms: 0.1359
type: 'test'
...
1..6
ok 369 - stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
---
duration_ms: 6.2901
type: 'test'
...
# Subtest: older configurations receive bounded wait defaults without changing the original object
ok 370 - older configurations receive bounded wait defaults without changing the original object
---
duration_ms: 1.2038
type: 'test'
...
# Subtest: active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
ok 371 - active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline
---
duration_ms: 0.8759
type: 'test'
...
# Subtest: silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
ok 372 - silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause
---
duration_ms: 1.3323
type: 'test'
...
# Subtest: waiting for headers is bounded independently of stream-idle time
ok 373 - waiting for headers is bounded independently of stream-idle time
---
duration_ms: 0.2392
type: 'test'
...
# Subtest: wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
ok 374 - wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact
---
duration_ms: 898.666
type: 'test'
...
# Subtest: paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
ok 375 - paged inspection finds a corrupted old artifact outside the recent fifty and retains original evidence without model/tool execution
---
duration_ms: 2646.0049
type: 'test'
...
# Subtest: inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
ok 376 - inspection rejects ambiguous/out-of-range pagination and reports unknown tool/task identity without resolving it
---
duration_ms: 643.2695
type: 'test'
...
# Subtest: exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
ok 377 - exact patches preserve BOM/CRLF, unicode and all unselected bytes and back up the original on apply
---
duration_ms: 581.4766
type: 'test'
...
# Subtest: several patches are matched against one original snapshot in any input order and keep LF
ok 378 - several patches are matched against one original snapshot in any input order and keep LF
---
duration_ms: 581.2709
type: 'test'
...
# Subtest: mixed line endings require exact anchors and preserve untouched formatting
ok 379 - mixed line endings require exact anchors and preserve untouched formatting
---
duration_ms: 550.1611
type: 'test'
...
# Subtest: ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
ok 380 - ambiguous, overlapping, missing and malformed patch anchors never create a proposal or write
---
duration_ms: 584.1708
type: 'test'
...
# Subtest: stale original hashes and changes before apply preserve owner edits and mark conflicts
ok 381 - stale original hashes and changes before apply preserve owner edits and mark conflicts
---
duration_ms: 572.541
type: 'test'
...
# Subtest: no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
ok 382 - no-op BOM patches/full content produce no change and replacements cannot split Unicode bytes
---
duration_ms: 608.4695
type: 'test'
...
# Subtest: an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
ok 383 - an actual shell command keeps Node and UTF-8 output while omitting host-only credentials
---
duration_ms: 775.1446
type: 'test'
...
# Subtest: real npm tests and build do not inherit arbitrary host credentials or Node injection settings
ok 384 - real npm tests and build do not inherit arbitrary host credentials or Node injection settings
---
duration_ms: 2298.6227
type: 'test'
...
# Subtest: real Python tests and compilation keep their sealed inputs without host credentials
ok 385 - real Python tests and compilation keep their sealed inputs without host credentials
---
duration_ms: 1903.807
type: 'test'
...
# Subtest: a process exiting between the Windows snapshot and owner query is absent only after a fresh query
ok 386 - a process exiting between the Windows snapshot and owner query is absent only after a fresh query
---
duration_ms: 2182.8779
type: 'test'
...
# Subtest: owner observation errors remain errors while a process is present, replaced, or cannot be rechecked
ok 387 - owner observation errors remain errors while a process is present, replaced, or cannot be rechecked
---
duration_ms: 1974.1276
type: 'test'
...
# Subtest: cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
ok 388 - cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
---
duration_ms: 2591.7257
type: 'test'
...
# Subtest: cache enablement and derived reuse survive a real host restart without becoming task recovery state
ok 389 - cache enablement and derived reuse survive a real host restart without becoming task recovery state
---
duration_ms: 6113.0622
type: 'test'
...
# Subtest: persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
ok 390 - persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
---
duration_ms: 1158.0124
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'main.ts', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'value.ts', LF will be replaced by CRLF the next time Git touches it
# Subtest: same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
ok 391 - same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
---
duration_ms: 1248.7703
type: 'test'
...
# Switched to a new branch 'other'
# Subtest: branch and commit changes invalidate even byte-identical sources
ok 392 - branch and commit changes invalidate even byte-identical sources
---
duration_ms: 2404.3783
type: 'test'
...
# Subtest: corrupt, malformed and schema-invalid records fall back to fresh parsing
ok 393 - corrupt, malformed and schema-invalid records fall back to fresh parsing
---
duration_ms: 946.275
type: 'test'
...
# Subtest: disable and clear persist without touching sources, sessions, configuration or original artifacts
ok 394 - disable and clear persist without touching sources, sessions, configuration or original artifacts
---
duration_ms: 567.9308
type: 'test'
...
# Subtest: cache capacity bounds disk and memory by bytes and LRU project count
ok 395 - cache capacity bounds disk and memory by bytes and LRU project count
---
duration_ms: 547.3001
type: 'test'
...
# Subtest: incomplete scans do not load or save cached entries; unavailable files leave the current result scope
ok 396 - incomplete scans do not load or save cached entries; unavailable files leave the current result scope
---
duration_ms: 611.8896
type: 'test'
...
# Subtest: project and cache junctions cannot expose or delete an outside directory
ok 397 - project and cache junctions cannot expose or delete an outside directory
---
duration_ms: 903.8196
type: 'test'
...
# Subtest: concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
ok 398 - concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
---
duration_ms: 720.5223
type: 'test'
...
# Subtest: file access mode changes invalidate parsed material even when bytes are unchanged
ok 399 - file access mode changes invalidate parsed material even when bytes are unchanged
---
duration_ms: 904.174
type: 'test'
...
# Subtest: tracked directory replaced by a junction invalidates access scope and never uses its old cache
ok 400 - tracked directory replaced by a junction invalidates access scope and never uses its old cache
---
duration_ms: 2091.0191
type: 'test'
...
# Subtest: JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
ok 401 - JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
---
duration_ms: 660.1306
type: 'test'
...
# Subtest: default expressions, named default exports and declared functions retain their AST evidence
ok 402 - default expressions, named default exports and declared functions retain their AST evidence
---
duration_ms: 588.422
type: 'test'
...
# Subtest: incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
ok 403 - incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
---
duration_ms: 907.4723
type: 'test'
...
# Subtest: Python candidates exclude comments and multiline strings and declare limited evidence
ok 404 - Python candidates exclude comments and multiline strings and declare limited evidence
---
duration_ms: 931.7188
type: 'test'
...
# Subtest: indexes isolate project identity and root and evict bounded caches without sharing results
ok 405 - indexes isolate project identity and root and evict bounded caches without sharing results
---
duration_ms: 884.1044
type: 'test'
...
# Subtest: Git ignore, credential paths and links stay outside the index and no project files are executed
ok 406 - Git ignore, credential paths and links stay outside the index and no project files are executed
---
duration_ms: 1536.6335
type: 'test'
...
# Subtest: malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
ok 407 - malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
---
duration_ms: 663.8553
type: 'test'
...
# Subtest: index query rejects invalid limits/types and does not imply reference or alias resolution
ok 408 - index query rejects invalid limits/types and does not imply reference or alias resolution
---
duration_ms: 521.8898
type: 'test'
...
# Subtest: read-only engineering inspection disables configured Git clean filters and preserves index bytes
ok 409 - read-only engineering inspection disables configured Git clean filters and preserves index bytes
---
duration_ms: 2841.7801
type: 'test'
...
# Subtest: Python multiline declarations retain candidate scope without interpreting expressions as declarations
ok 410 - Python multiline declarations retain candidate scope without interpreting expressions as declarations
---
duration_ms: 695.5372
type: 'test'
...
# Subtest: TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
ok 411 - TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
---
duration_ms: 654.8109
type: 'test'
...
# Subtest: actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
ok 412 - actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
---
duration_ms: 1428.8593
type: 'test'
...
# Subtest: actual HTTP request excludes archived, timed-out and foreign-project memories
ok 413 - actual HTTP request excludes archived, timed-out and foreign-project memories
---
duration_ms: 2244.2741
type: 'test'
...
# Subtest: actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
ok 414 - actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
---
duration_ms: 1911.4735
type: 'test'
...
# Subtest: incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
ok 415 - incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
---
duration_ms: 1940.2447
type: 'test'
...
# Subtest: corrupt original artifact expires its memory and cannot reach an HTTP model request
ok 416 - corrupt original artifact expires its memory and cannot reach an HTTP model request
---
duration_ms: 1494.022
type: 'test'
...
# Subtest: memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
ok 417 - memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
---
duration_ms: 2953.7069
type: 'test'
...
# Subtest: optional memory yields to the complete goal and original code evidence under the whole-request budget
ok 418 - optional memory yields to the complete goal and original code evidence under the whole-request budget
---
duration_ms: 1058.3817
type: 'test'
...
# Subtest: changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
ok 419 - changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
---
duration_ms: 1407.9695
type: 'test'
...
# Subtest: a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
ok 420 - a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
---
duration_ms: 1240.2669
type: 'test'
...
# Subtest: an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
ok 421 - an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
---
duration_ms: 834.2049
type: 'test'
...
# Subtest: project memories persist across restart, keep source provenance, and are visible across tasks
ok 422 - project memories persist across restart, keep source provenance, and are visible across tasks
---
duration_ms: 1094.8612
type: 'test'
...
# Subtest: source changes expire current project memories and keep the original evidence
ok 423 - source changes expire current project memories and keep the original evidence
---
duration_ms: 767.1073
type: 'test'
...
# Subtest: incomplete source scans mark current memories unverified without expiring or reusing them
ok 424 - incomplete source scans mark current memories unverified without expiring or reusing them
---
duration_ms: 802.6259
type: 'test'
...
# Subtest: explicit file provenance is rechecked even when the inventory excludes that path
ok 425 - explicit file provenance is rechecked even when the inventory excludes that path
---
duration_ms: 635.0577
type: 'test'
...
# Subtest: execution snapshots do not expose project memories before their source scope is validated
ok 426 - execution snapshots do not expose project memories before their source scope is validated
---
duration_ms: 883.4862
type: 'test'
...
# Subtest: project memory records stay isolated and archive requires the owning session
ok 427 - project memory records stay isolated and archive requires the owning session
---
duration_ms: 978.4368
type: 'test'
...
# Subtest: project memory HTTP API exposes read-only source status and explicit writes
ok 428 - project memory HTTP API exposes read-only source status and explicit writes
---
duration_ms: 2551.5266
type: 'test'
...
# Subtest: two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
ok 429 - two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
---
duration_ms: 569.7336
type: 'test'
...
# Subtest: incomplete, unsupported, relative and oversized sources cannot enable the experiment
ok 430 - incomplete, unsupported, relative and oversized sources cannot enable the experiment
---
duration_ms: 564.6164
type: 'test'
...
# Subtest: invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
ok 431 - invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
---
duration_ms: 2392.7393
type: 'test'
...
# Subtest: source edits between detection and plan are rejected without creating a parent Task
ok 432 - source edits between detection and plan are rejected without creating a parent Task
---
duration_ms: 2051.1175
type: 'test'
...
# Subtest: source edits after sealing cannot launch a child and do not reset its cumulative budget
ok 433 - source edits after sealing cannot launch a child and do not reset its cumulative budget
---
duration_ms: 13103.0073
type: 'test'
...
# Subtest: literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
ok 434 - literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
---
duration_ms: 30159.3296
type: 'test'
...
# Subtest: source changes after a model response stop before any native tool is accepted, retaining the actual usage once
ok 435 - source changes after a model response stop before any native tool is accepted, retaining the actual usage once
---
duration_ms: 14132.5408
type: 'test'
...
# Subtest: source changes while approval is pending invalidate the old permission before an engineering check starts
ok 436 - source changes while approval is pending invalidate the old permission before an engineering check starts
---
duration_ms: 32090.5355
type: 'test'
...
# Subtest: altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
ok 437 - altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
---
duration_ms: 10455.514
type: 'test'
...
# Subtest: the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
ok 438 - the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
---
duration_ms: 8964.2062
type: 'test'
...
# Subtest: a missing or duplicated experimental section in the actual input is rejected before any model dispatch
ok 439 - a missing or duplicated experimental section in the actual input is rejected before any model dispatch
---
duration_ms: 45242.0013
type: 'test'
...
# Subtest: experimental prompt overhead still participates in the original complete-input budget guard
ok 440 - experimental prompt overhead still participates in the original complete-input budget guard
---
duration_ms: 12413.9092
type: 'test'
...
# Subtest: source detection HTTP remains local-authenticated and read-only with no configured model requests
ok 441 - source detection HTTP remains local-authenticated and read-only with no configured model requests
---
duration_ms: 1784.6316
type: 'test'
...
# Subtest: Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
ok 442 - Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
---
duration_ms: 30720.2037
type: 'test'
...
# Subtest: an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
ok 443 - an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
---
duration_ms: 60430.0274
type: 'test'
...
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
ok 444 - Python static inspection does not import project code or probe a project interpreter before approval
---
duration_ms: 902.7701
type: 'test'
...
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
ok 445 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
---
duration_ms: 4116.9331
type: 'test'
...
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
ok 446 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
---
duration_ms: 2818.7784
type: 'test'
...
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
ok 447 - unittest empty, skipped, expected failure and class initialization errors never verify a task
---
duration_ms: 7180.5477
type: 'test'
...
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
ok 448 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
---
duration_ms: 2967.8325
type: 'test'
...
# Subtest: compilation reads actual Python source bytes without executing top-level project code
ok 449 - compilation reads actual Python source bytes without executing top-level project code
---
duration_ms: 3247.9819
type: 'test'
...
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
ok 450 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
---
duration_ms: 2466.0544
type: 'test'
...
# Subtest: changed project interpreters and forged Python plan bindings execute no check
ok 451 - changed project interpreters and forged Python plan bindings execute no check
---
duration_ms: 1370.783
type: 'test'
...
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
ok 452 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
---
duration_ms: 1045.5115
type: 'test'
...
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
ok 453 - stopping a real Python check terminates its child and keeps the completed result as cancelled
---
duration_ms: 2059.3816
type: 'test'
...
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
ok 454 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
---
duration_ms: 14917.2915
type: 'test'
...
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
ok 455 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
---
duration_ms: 8217.5974
type: 'test'
...
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
ok 456 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
---
duration_ms: 2909.8075
type: 'test'
...
# Subtest: continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
ok 457 - continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
---
duration_ms: 1.8735
type: 'test'
...
# Subtest: a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
ok 458 - a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
---
duration_ms: 0.6036
type: 'test'
...
# Subtest: budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
ok 459 - budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
---
duration_ms: 9.7411
type: 'test'
...
# Subtest: known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
ok 460 - known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
---
duration_ms: 0.3714
type: 'test'
...
# Subtest: actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
ok 461 - actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
---
duration_ms: 3704.758
type: 'test'
...
# Subtest: a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
ok 462 - a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
---
duration_ms: 5260.7704
type: 'test'
...
# Subtest: actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
ok 463 - actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
---
duration_ms: 5003.1073
type: 'test'
...
# Subtest: an installed app outside the source drive resolves registered SDK and Purge through actual input verification
ok 464 - an installed app outside the source drive resolves registered SDK and Purge through actual input verification
---
duration_ms: 944.5812
type: 'test'
...
# Subtest: standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
ok 465 - standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
---
duration_ms: 570.5921
type: 'test'
...
# Subtest: registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
ok 466 - registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
---
duration_ms: 793.0766
type: 'test'
...
# Subtest: unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
ok 467 - unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
---
duration_ms: 576.8457
type: 'test'
...
# Subtest: oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
ok 468 - oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
---
duration_ms: 739.8711
type: 'test'
...
# Subtest: a linked registry directory is rejected without reading or deleting its external source
ok 469 - a linked registry directory is rejected without reading or deleting its external source
---
duration_ms: 680.5415
type: 'test'
...
# Subtest: matching research declarations do not replace actual installed version and critical-source checks
ok 470 - matching research declarations do not replace actual installed version and critical-source checks
---
duration_ms: 634.9156
type: 'test'
...
# Subtest: context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
ok 471 - context APIs retain exact request identity, paginate archived groups and reject foreign sessions/runs
---
duration_ms: 3271.625
type: 'test'
...
# Subtest: delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
ok 472 - delivery reports verify request body, sealed plan and original archived bytes, and show corruption as needing verification
---
duration_ms: 2056.932
type: 'test'
...
# Subtest: direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
ok 473 - direct code evidence remains selected while recent historical-index browsing is archived within the complete request budget
---
duration_ms: 1489.5617
type: 'test'
...
# Subtest: one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
ok 474 - one long user turn becomes bounded complete groups with exact UTF-8 history and recent JSON arguments
---
duration_ms: 3472.5486
type: 'test'
...
# Subtest: tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
ok 475 - tool definitions, exact system bytes, output reserve and remaining Run/Task budget are accounted before requests
---
duration_ms: 691.6933
type: 'test'
...
# Subtest: oversized required user instructions pause intact and can be explicitly resumed after increasing the window
ok 476 - oversized required user instructions pause intact and can be explicitly resumed after increasing the window
---
duration_ms: 1441.3156
type: 'test'
...
# Subtest: all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
ok 477 - all task instructions, constraints and acceptance remain in the runtime system instead of an eight-item or byte prefix
---
duration_ms: 1300.3089
type: 'test'
...
# Subtest: a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
ok 478 - a newest manageable multi-tool group stays exact even beyond the working target; oversized earlier groups are archived
---
duration_ms: 815.5986
type: 'test'
...
# Subtest: invalid orphan result is rejected before archive or network preparation
ok 479 - invalid orphan result is rejected before archive or network preparation
---
duration_ms: 594.2588
type: 'test'
...
# Subtest: invalid missing result is rejected before archive or network preparation
ok 480 - invalid missing result is rejected before archive or network preparation
---
duration_ms: 814.3425
type: 'test'
...
# Subtest: invalid wrong result is rejected before archive or network preparation
ok 481 - invalid wrong result is rejected before archive or network preparation
---
duration_ms: 675.3366
type: 'test'
...
# Subtest: invalid duplicate call is rejected before archive or network preparation
ok 482 - invalid duplicate call is rejected before archive or network preparation
---
duration_ms: 548.4779
type: 'test'
...
# Subtest: a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
ok 483 - a group larger than the artifact limit uses verified Unicode-safe chunks without replacing tool JSON
---
duration_ms: 1690.857
type: 'test'
...
# Subtest: changed or missing archived evidence stops reuse and is never silently recreated
ok 484 - changed or missing archived evidence stops reuse and is never silently recreated
---
duration_ms: 858.1594
type: 'test'
...
# Subtest: transaction failure prevents publishing a plan and any corresponding model request
ok 485 - transaction failure prevents publishing a plan and any corresponding model request
---
duration_ms: 925.5584
type: 'test'
...
# Subtest: the Provider rejects body mutation after a sealed plan before calling HTTP
ok 486 - the Provider rejects body mutation after a sealed plan before calling HTTP
---
duration_ms: 662.5303
type: 'test'
...
# Subtest: HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
ok 487 - HTTP failure and explicit same-Task resume reuse exact completed results and request hashes without repeating a command
---
duration_ms: 5852.9833
type: 'test'
...
# Subtest: a real process exit after plan persistence marks interruption and never issues an automatic model request
ok 488 - a real process exit after plan persistence marks interruption and never issues an automatic model request
---
duration_ms: 1614.0237
type: 'test'
...
# Subtest: deep Windows data directories keep REA output within the external path allowance and retain owned evidence
ok 489 - deep Windows data directories keep REA output within the external path allowance and retain owned evidence
---
duration_ms: 1972.2552
type: 'test'
...
# Subtest: user research registration creates an owned Task without model requests and seals the exact artifact identity
ok 490 - user research registration creates an owned Task without model requests and seals the exact artifact identity
---
duration_ms: 995.7862
type: 'test'
...
# Subtest: complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
ok 491 - complete research binds original Evidence and Bundle, pages exact fields and reuses verified results after reload
---
duration_ms: 2422.3528
type: 'test'
...
# Subtest: artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
ok 492 - artifact changes before analysis refuse dispatch and changes during analysis preserve unverified original responses
---
duration_ms: 3185.8014
type: 'test'
...
# Subtest: owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
ok 493 - owned cancellation closes the connection, concurrent and automatic retries are refused, explicit new analysis preserves history
---
duration_ms: 2144.9281
type: 'test'
...
# Subtest: a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
ok 494 - a dispatched transport timeout stays unknown and reload never launches or kills a saved PID
---
duration_ms: 1545.3532
type: 'test'
...
# Subtest: corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
ok 495 - corrupt Evidence parts and changed binding records are refused instead of silently re-analysed
---
duration_ms: 2139.1869
type: 'test'
...
# Subtest: research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
ok 496 - research documents over the single-artifact limit preserve exact Unicode bytes with owned verifiable parts
---
duration_ms: 1083.1838
type: 'test'
...
# Subtest: research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
ok 497 - research tools are only sent for registered Task artifacts and actual HTTP uses the sealed tool contract without replay
---
duration_ms: 6340.8089
type: 'test'
...
# Subtest: file identity rejects directory and invalid formats without running a target
ok 498 - file identity rejects directory and invalid formats without running a target
---
duration_ms: 877.902
type: 'test'
...
# Subtest: a stop from the event loop interrupts immediate model replies before later tools
ok 499 - a stop from the event loop interrupts immediate model replies before later tools
---
duration_ms: 1919.2497
type: 'test'
...
# Subtest: a stop after the first tool preserves a complete interrupted multi-call protocol group
ok 500 - a stop after the first tool preserves a complete interrupted multi-call protocol group
---
duration_ms: 2470.5675
type: 'test'
...
# Subtest: the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
ok 501 - the compatible HTTP loop preserves call IDs, validates errors and waits before executing commands
---
duration_ms: 5770.428
type: 'test'
...
# Subtest: denial prevents command execution and produces a paired denied result
ok 502 - denial prevents command execution and produces a paired denied result
---
duration_ms: 2151.4228
type: 'test'
...
# Subtest: stopping during approval interrupts pending calls without executing or replaying them
ok 503 - stopping during approval interrupts pending calls without executing or replaying them
---
duration_ms: 1467.9064
type: 'test'
...
# Subtest: stopping a running fixture command terminates its own process tree and retains uncertain state
ok 504 - stopping a running fixture command terminates its own process tree and retains uncertain state
---
duration_ms: 2271.2431
type: 'test'
...
# Subtest: command output decodes split UTF-8 and excludes the workbench key from child environment
ok 505 - command output decodes split UTF-8 and excludes the workbench key from child environment
---
duration_ms: 1143.9068
type: 'test'
...
# Subtest: model-list testing uses a tentative key without changing the saved connection and redacts service errors
ok 506 - model-list testing uses a tentative key without changing the saved connection and redacts service errors
---
duration_ms: 8.0708
type: 'test'
...
# Subtest: truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
ok 507 - truncated or repeated model calls fail before execution; tool input validation rejects unknown capabilities
---
duration_ms: 3269.6847
type: 'test'
...
# Subtest: request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
ok 508 - request projection keeps exact tool pairs and complete recent user instructions while preserving disk history
---
duration_ms: 1642.8634
type: 'test'
...
# Subtest: local skill revisions require explicit enable, retain original text, survive restart and stay within the selected project
ok 509 - local skill revisions require explicit enable, retain original text, survive restart and stay within the selected project
---
duration_ms: 1330.6168
type: 'test'
...
# Subtest: registration rejects non-SKILL paths, oversized/non-UTF8 files, duplicate sources and wrong field shapes without running project code
ok 510 - registration rejects non-SKILL paths, oversized/non-UTF8 files, duplicate sources and wrong field shapes without running project code
---
duration_ms: 827.2094
type: 'test'
...
# Subtest: actual HTTP models receive only enabled current-project metadata, then a redacted owned skill page with complete tool pairing
ok 511 - actual HTTP models receive only enabled current-project metadata, then a redacted owned skill page with complete tool pairing
---
duration_ms: 3072.5612
type: 'test'
...
# Subtest: source edits after a catalog request prevent the read and appear as changed on the next request without replay
ok 512 - source edits after a catalog request prevent the read and appear as changed on the next request without replay
---
duration_ms: 2514.7646
type: 'test'
...
# Subtest: disabled and foreign skills cannot be read by guessing their IDs from another project
ok 513 - disabled and foreign skills cannot be read by guessing their IDs from another project
---
duration_ms: 2890.6751
type: 'test'
...
# Subtest: skill catalog takes remaining escaped JSON budget and cannot evict the user goal or current code
ok 514 - skill catalog takes remaining escaped JSON budget and cannot evict the user goal or current code
---
duration_ms: 1186.1174
type: 'test'
...
# Subtest: multilingual skill body pages fit actual tool JSON bytes and every page uses the same immutable artifact
ok 515 - multilingual skill body pages fit actual tool JSON bytes and every page uses the same immutable artifact
---
duration_ms: 4380.4712
type: 'test'
...
# Subtest: registry failures roll back enable and refresh state; corrupted snapshots block requests before network
ok 516 - registry failures roll back enable and refresh state; corrupted snapshots block requests before network
---
duration_ms: 1281.9991
type: 'test'
...
# Subtest: saved skill catalogs retain SHA-bound historical evidence and reject corrupt catalog blobs
ok 517 - saved skill catalogs retain SHA-bound historical evidence and reject corrupt catalog blobs
---
duration_ms: 8978.3477
type: 'test'
...
# Subtest: HTTP skill administration enforces project scope, revision checks and idle mutation without model calls
ok 518 - HTTP skill administration enforces project scope, revision checks and idle mutation without model calls
---
duration_ms: 6284.524
type: 'test'
...
# Subtest: JSON state keeps an atomic backup and preserves corrupt primary files
ok 519 - JSON state keeps an atomic backup and preserves corrupt primary files
---
duration_ms: 973.3512
type: 'test'
...
# Subtest: tool-pair recovery fills missing results and drops orphan or duplicate results
ok 520 - tool-pair recovery fills missing results and drops orphan or duplicate results
---
duration_ms: 0.331
type: 'test'
...
# Subtest: restart pauses unfinished work, retains proposals and never replays a command
ok 521 - restart pauses unfinished work, retains proposals and never replays a command
---
duration_ms: 962.8887
type: 'test'
...
# Subtest: public snapshots carry increasing revisions without the private provider transcript or config key
ok 522 - public snapshots carry increasing revisions without the private provider transcript or config key
---
duration_ms: 877.4424
type: 'test'
...
# Subtest: a checkpoint seals all task requirements and original results without a model request and explicit continuation keeps the same Task without replay
ok 523 - a checkpoint seals all task requirements and original results without a model request and explicit continuation keeps the same Task without replay
---
duration_ms: 4126.5641
type: 'test'
...
# Subtest: checkpoint sources, requirements, plan and original tool changes block continuation and leave original checkpoint bytes intact
ok 524 - checkpoint sources, requirements, plan and original tool changes block continuation and leave original checkpoint bytes intact
---
duration_ms: 3286.9399
type: 'test'
...
# Subtest: unknown tool effects and pending proposals stay blocked in recovery packages rather than being changed into completed work
ok 525 - unknown tool effects and pending proposals stay blocked in recovery packages rather than being changed into completed work
---
duration_ms: 3444.6904
type: 'test'
...
# Subtest: checkpoint and referenced result corruption are rejected before dispatch and historical blobs are never rebuilt
ok 526 - checkpoint and referenced result corruption are rejected before dispatch and historical blobs are never rebuilt
---
duration_ms: 5592.5951
type: 'test'
...
# Subtest: checkpoint ownership, exact confirmation and concurrent operations reject foreign or stale resumes
ok 527 - checkpoint ownership, exact confirmation and concurrent operations reject foreign or stale resumes
---
duration_ms: 9964.0452
type: 'test'
...
# Subtest: Git identity changes and altered plan proofs cannot be accepted as the sealed recovery state
ok 528 - Git identity changes and altered plan proofs cannot be accepted as the sealed recovery state
---
duration_ms: 3744.799
type: 'test'
...
# Subtest: checkpoint records survive SQLite reopen and do not trigger automatic model or tool replay
ok 529 - checkpoint records survive SQLite reopen and do not trigger automatic model or tool replay
---
duration_ms: 3064.5374
type: 'test'
...
# Subtest: incomplete scans and in-progress project activity refuse checkpoint creation while private credentials are redacted from saved requirements
ok 530 - incomplete scans and in-progress project activity refuse checkpoint creation while private credentials are redacted from saved requirements
---
duration_ms: 2844.315
type: 'test'
...
# Subtest: oversized recovery evidence is refused before reading or publishing the checkpoint
ok 531 - oversized recovery evidence is refused before reading or publishing the checkpoint
---
duration_ms: 2421.6905
type: 'test'
...
# Subtest: compiled checkpoint HTTP APIs bind current Task/Run, isolate sessions and only resume on an explicit matching confirmation
ok 532 - compiled checkpoint HTTP APIs bind current Task/Run, isolate sessions and only resume on an explicit matching confirmation
---
duration_ms: 8005.9958
type: 'test'
...
# Subtest: actual process exit before checkpoint commit retains only durable records without replay
ok 533 - actual process exit before checkpoint commit retains only durable records without replay
---
duration_ms: 3232.469
type: 'test'
...
# Subtest: actual process exit after checkpoint commit retains only durable records without replay
ok 534 - actual process exit after checkpoint commit retains only durable records without replay
---
duration_ms: 3135.4589
type: 'test'
...
# Subtest: operational questions are diagnostic while explicit repair requests remain execution instructions
ok 535 - operational questions are diagnostic while explicit repair requests remain execution instructions
---
duration_ms: 1.0331
type: 'test'
...
# Subtest: file delivery requires a positive instruction, not saved evidence or a prohibited write
ok 536 - file delivery requires a positive instruction, not saved evidence or a prohibited write
---
duration_ms: 1.1942
type: 'test'
...
# Subtest: an unsubstantiated text claim cannot complete a requested file delivery
ok 537 - an unsubstantiated text claim cannot complete a requested file delivery
---
duration_ms: 1339.7978
type: 'test'
...
# Subtest: HTML without tests ends at reviewed file delivery and never offers automatic rechecking
ok 538 - HTML without tests ends at reviewed file delivery and never offers automatic rechecking
---
duration_ms: 2567.1057
type: 'test'
...
# Subtest: diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
ok 539 - diagnostic answers retain the unfinished task, limits and check result, and enforce read-only tools
---
duration_ms: 3425.9904
type: 'test'
...
# Subtest: review continuation is a system action and adds no testing demand or fake user instruction
ok 540 - review continuation is a system action and adds no testing demand or fake user instruction
---
duration_ms: 2450.3886
type: 'test'
...
# Subtest: a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
ok 541 - a provider cannot execute tests against an explicit no-test task even if it ignores advertised tools
---
duration_ms: 1613.9831
type: 'test'
...
# Subtest: a budget pause becomes visible only after its input snapshot can be sealed with the original Run
ok 542 - a budget pause becomes visible only after its input snapshot can be sealed with the original Run
---
duration_ms: 1408.6143
type: 'test'
...
# Subtest: alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
ok 543 - alternating duplicate file reads and listing files still pauses without treating new pages as duplicates
---
duration_ms: 16380.1661
type: 'test'
...
# Subtest: task-plan HTTP mutations bind current Task/Run and retain original evidence through real host restart
ok 544 - task-plan HTTP mutations bind current Task/Run and retain original evidence through real host restart
---
duration_ms: 5689.6923
type: 'test'
...
# Subtest: concurrent stale HTTP plan revisions cannot replace conditions or attach proofs to a different plan
ok 545 - concurrent stale HTTP plan revisions cannot replace conditions or attach proofs to a different plan
---
duration_ms: 3688.2757
type: 'test'
...
# Subtest: a real escaped long-file tool message keeps its proof identity within a tight request budget
ok 546 - a real escaped long-file tool message keeps its proof identity within a tight request budget
---
duration_ms: 962.5677
type: 'test'
...
# Subtest: task plans reject fabricated completion, invalid scopes and cyclic or missing dependencies
ok 547 - task plans reject fabricated completion, invalid scopes and cyclic or missing dependencies
---
duration_ms: 0.4929
type: 'test'
...
# Subtest: sealed plans retain goal, contract hash and original steps through SQLite reopen without executing tools
ok 548 - sealed plans retain goal, contract hash and original steps through SQLite reopen without executing tools
---
duration_ms: 1602.8285
type: 'test'
...
# Subtest: proofs require original owned reads, honor dependencies and reject altered invocation arguments and bytes
ok 549 - proofs require original owned reads, honor dependencies and reject altered invocation arguments and bytes
---
duration_ms: 1204.1756
type: 'test'
...
# Subtest: new user requirements invalidate current proofs and reseal the same original operations in a new revision
ok 550 - new user requirements invalidate current proofs and reseal the same original operations in a new revision
---
duration_ms: 1302.3607
type: 'test'
...
# Subtest: applied change-set evidence binds reviewed current files and invalidates dependent steps after outside edits
ok 551 - applied change-set evidence binds reviewed current files and invalidates dependent steps after outside edits
---
duration_ms: 2060.0994
type: 'test'
...
# Subtest: actual npm checks are verified by original counted logs and current source, with failure history retained
ok 552 - actual npm checks are verified by original counted logs and current source, with failure history retained
---
duration_ms: 8552.8588
type: 'test'
...
# Subtest: real desktop and mobile browser proofs bind required actions and PNGs, rejecting source changes, a later failed plan and changed builds
ok 553 - real desktop and mobile browser proofs bind required actions and PNGs, rejecting source changes, a later failed plan and changed builds
---
duration_ms: 11717.9305
type: 'test'
...
# Subtest: Git delivery blocks incomplete plans and changed preview bindings, preserving HEAD and owner index before a fresh verified commit
ok 554 - Git delivery blocks incomplete plans and changed preview bindings, preserving HEAD and owner index before a fresh verified commit
---
duration_ms: 16641.0544
type: 'test'
...
# Subtest: the runtime supplies owned read IDs and completes a plan only after original step evidence verification
ok 555 - the runtime supplies owned read IDs and completes a plan only after original step evidence verification
---
duration_ms: 2137.1041
type: 'test'
...
# Subtest: premature model completion pauses the original Task and resume preserves the existing plan without replay
ok 556 - premature model completion pauses the original Task and resume preserves the existing plan without replay
---
duration_ms: 3029.1674
type: 'test'
...
# Subtest: plan operations participate in project activity and orderly shutdown
ok 557 - plan operations participate in project activity and orderly shutdown
---
duration_ms: 715.7455
type: 'test'
...
# Subtest: actual process exit before plan save restores only committed plan evidence without replay
ok 558 - actual process exit before plan save restores only committed plan evidence without replay
---
duration_ms: 1471.7044
type: 'test'
...
# Subtest: actual process exit after plan save restores only committed plan evidence without replay
ok 559 - actual process exit after plan save restores only committed plan evidence without replay
---
duration_ms: 1312.3347
type: 'test'
...
# Subtest: actual process exit before proof save restores only committed plan evidence without replay
ok 560 - actual process exit before proof save restores only committed plan evidence without replay
---
duration_ms: 1202.2777
type: 'test'
...
# Subtest: actual process exit after proof save restores only committed plan evidence without replay
ok 561 - actual process exit after proof save restores only committed plan evidence without replay
---
duration_ms: 1121.3561
type: 'test'
...
# Subtest: the latest oversized session result reaches the next request together with already read source modules
ok 562 - the latest oversized session result reaches the next request together with already read source modules
---
duration_ms: 2541.3243
type: 'test'
...
# Subtest: every call in a large latest group keeps its actual outcome, including denied and unknown results
ok 563 - every call in a large latest group keeps its actual outcome, including denied and unknown results
---
duration_ms: 2097.8235
type: 'test'
...
# Subtest: a small complete latest tool group is sent once and needs no duplicate feedback view
ok 564 - a small complete latest tool group is sent once and needs no duplicate feedback view
---
duration_ms: 1035.7931
type: 'test'
...
# Subtest: real HTTP repeated state inspection pauses after three identical engineering outcomes and preserves tool pairing
ok 565 - real HTTP repeated state inspection pauses after three identical engineering outcomes and preserves tool pairing
---
duration_ms: 2757.1988
type: 'test'
...
# Subtest: a live SQLite host with the actual 1.9 artifact object upgrades, keeps its original blobs and verifies real browser PNG bytes
ok 566 - a live SQLite host with the actual 1.9 artifact object upgrades, keeps its original blobs and verifies real browser PNG bytes
---
duration_ms: 4168.8119
type: 'test'
...
# Subtest: failed upgrade restores the original artifact object, provider and request handler
ok 567 - failed upgrade restores the original artifact object, provider and request handler
---
duration_ms: 1830.3561
type: 'test'
...
# Subtest: claiming the same runtime owner twice preserves its original metadata and every database row
ok 568 - claiming the same runtime owner twice preserves its original metadata and every database row
---
duration_ms: 668.2828
type: 'test'
...
# Subtest: sessions without controlled-engine history retain their prior export shape and never expose another session record
ok 569 - sessions without controlled-engine history retain their prior export shape and never expose another session record
---
duration_ms: 647.8944
type: 'test'
...
# Subtest: live workers, controlled drivers, or MCP operations refuse an upgrade before changing handlers, managers or database rows
ok 570 - live workers, controlled drivers, or MCP operations refuse an upgrade before changing handlers, managers or database rows
---
duration_ms: 656.3089
type: 'test'
...
# Subtest: an idle upgrade loads the newly introduced engine record map, resets obsolete managers and preserves original rows, sessions and provider objects
ok 571 - an idle upgrade loads the newly introduced engine record map, resets obsolete managers and preserves original rows, sessions and provider objects
---
duration_ms: 768.9179
type: 'test'
...
# Subtest: an installation failure restores old managers, original record maps, handlers and all existing database rows
ok 572 - an installation failure restores old managers, original record maps, handlers and all existing database rows
---
duration_ms: 1557.3156
type: 'test'
...
# Subtest: the owned controlled driver remains an active session and project even after outer task activity has ended
ok 573 - the owned controlled driver remains an active session and project even after outer task activity has ended
---
duration_ms: 617.5102
type: 'test'
...
# Subtest: release and upgrade help or invalid arguments have no file or network setup side effects in an independent directory
ok 574 - release and upgrade help or invalid arguments have no file or network setup side effects in an independent directory
---
duration_ms: 783.6379
type: 'test'
...
# Subtest: hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing
ok 575 - hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing
---
duration_ms: 1287.0052
type: 'test'
...
# Subtest: failed adoption restores the original virtual data-root name and original open database
ok 576 - failed adoption restores the original virtual data-root name and original open database
---
duration_ms: 782.8167
type: 'test'
...
# Subtest: hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
ok 577 - hot upgrade refreshes retained model and importer methods while preserving credential and routing objects
---
duration_ms: 826.362
type: 'test'
...
# Subtest: hot upgrade refuses active probes and restores retained model methods if installation fails
ok 578 - hot upgrade refuses active probes and restores retained model methods if installation fails
---
duration_ms: 813.6255
type: 'test'
...
# Subtest: HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
ok 579 - HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
---
duration_ms: 18731.2309
type: 'test'
...
# Subtest: HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
ok 580 - HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
---
duration_ms: 27301.0395
type: 'test'
...
# Subtest: verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
ok 581 - verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
---
duration_ms: 75138.9087
type: 'test'
...
# Subtest: overlapping worker paths are explicit conflicts even if each independent task checks successfully
ok 582 - overlapping worker paths are explicit conflicts even if each independent task checks successfully
---
duration_ms: 44451.4817
type: 'test'
...
# Subtest: source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
ok 583 - source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
---
duration_ms: 42003.2931
type: 'test'
...
# Subtest: changed child bytes after parent preview block the entire batch before any parent write
ok 584 - changed child bytes after parent preview block the entire batch before any parent write
---
duration_ms: 59449.0733
type: 'test'
...
# Subtest: corrupt original check logs cannot become collected outputs or a parent review
ok 585 - corrupt original check logs cannot become collected outputs or a parent review
---
duration_ms: 42971.0427
type: 'test'
...
# Subtest: stopping a parent accounts late responses and executes none of their proposed tools
ok 586 - stopping a parent accounts late responses and executes none of their proposed tools
---
duration_ms: 22218.9122
type: 'test'
...
# Subtest: unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
ok 587 - unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
---
duration_ms: 21737.5106
type: 'test'
...
# Subtest: a deadline before worker request dispatch records no invented usage and cannot reset on resume
ok 588 - a deadline before worker request dispatch records no invented usage and cannot reset on resume
---
duration_ms: 21307.3279
type: 'test'
...
# Subtest: a response exceeding the cumulative token allocation stops before registering or executing its tools
ok 589 - a response exceeding the cumulative token allocation stops before registering or executing its tools
---
duration_ms: 20730.663
type: 'test'
...
# Subtest: cumulative tool allocation rejects the entire returned batch before any tool side effect
ok 590 - cumulative tool allocation rejects the entire returned batch before any tool side effect
---
duration_ms: 21223.4729
type: 'test'
...
# Subtest: single response 16 tool ceiling rejects the entire returned batch before any tool side effect
ok 591 - single response 16 tool ceiling rejects the entire returned batch before any tool side effect
---
duration_ms: 20590.6775
type: 'test'
...
# Subtest: consumed request steps remain consumed across explicit worker resumes
ok 592 - consumed request steps remain consumed across explicit worker resumes
---
duration_ms: 23480.8208
type: 'test'
...
# Subtest: a saved completed response with missing usage is conservatively accounted exactly once during recovery
ok 593 - a saved completed response with missing usage is conservatively accounted exactly once during recovery
---
duration_ms: 18678.6398
type: 'test'
...
# Subtest: an unexecuted second workspace plan resumes its original identity without recreating the first checkout
ok 594 - an unexecuted second workspace plan resumes its original identity without recreating the first checkout
---
duration_ms: 22925.9389
type: 'test'
...
# Subtest: a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
ok 595 - a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
---
duration_ms: 71695.6721
type: 'test'
...
# Subtest: recovery attaches a sealed parent batch saved before its group reference without creating another batch
ok 596 - recovery attaches a sealed parent batch saved before its group reference without creating another batch
---
duration_ms: 63427.2065
type: 'test'
...
# Subtest: explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
ok 597 - explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
---
duration_ms: 60773.8502
type: 'test'
...
# Subtest: unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
ok 598 - unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
---
duration_ms: 63822.1891
type: 'test'
...