feat: connect controlled engines to owned Tasks, approvals and budget ledger
This commit is contained in:
@@ -0,0 +1,412 @@
|
||||
TAP version 13
|
||||
# Subtest: controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
|
||||
ok 1 - controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
|
||||
---
|
||||
duration_ms: 816.2291
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
|
||||
ok 2 - controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
|
||||
---
|
||||
duration_ms: 0.5492
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
|
||||
ok 3 - owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
|
||||
---
|
||||
duration_ms: 5.4234
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
|
||||
ok 4 - bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
|
||||
---
|
||||
duration_ms: 950.2421
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
|
||||
ok 5 - bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
|
||||
---
|
||||
duration_ms: 679.3481
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
|
||||
ok 6 - bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
|
||||
---
|
||||
duration_ms: 697.0703
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: stopped and oversized bridge requests never reach a local model or tool callback
|
||||
ok 7 - stopped and oversized bridge requests never reach a local model or tool callback
|
||||
---
|
||||
duration_ms: 590.4988
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
|
||||
ok 8 - engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
|
||||
---
|
||||
duration_ms: 2573.4285
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
|
||||
ok 9 - HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
|
||||
---
|
||||
duration_ms: 2958.6899
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: native text and call IDs preserve original result pairing while unsupported content fails closed
|
||||
ok 10 - native text and call IDs preserve original result pairing while unsupported content fails closed
|
||||
---
|
||||
duration_ms: 0.7762
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: one engine child freezes real installation identity before creating tasks and rejects a changed source
|
||||
ok 11 - one engine child freezes real installation identity before creating tasks and rejects a changed source
|
||||
---
|
||||
duration_ms: 5899.1837
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
|
||||
ok 12 - owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
|
||||
---
|
||||
duration_ms: 17601.082
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
|
||||
ok 13 - forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
|
||||
---
|
||||
duration_ms: 9063.3297
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: duplicate native IDs are rejected without replaying a saved tool
|
||||
ok 14 - duplicate native IDs are rejected without replaying a saved tool
|
||||
---
|
||||
duration_ms: 8481.8966
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: native input exceeding the context budget is retained and sends no model request
|
||||
ok 15 - native input exceeding the context budget is retained and sends no model request
|
||||
---
|
||||
duration_ms: 7140.3817
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: stop retains a late reported model usage once and executes no tool from that output
|
||||
ok 16 - stop retains a late reported model usage once and executes no tool from that output
|
||||
---
|
||||
duration_ms: 7565.0223
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a source change after the original model intent stops before native tools execute
|
||||
ok 17 - a source change after the original model intent stops before native tools execute
|
||||
---
|
||||
duration_ms: 7435.7032
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
|
||||
ok 18 - missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
|
||||
---
|
||||
duration_ms: 0.5515
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: closed root with an original live descendant remains unknown and retains its process tree
|
||||
ok 19 - closed root with an original live descendant remains unknown and retains its process tree
|
||||
---
|
||||
duration_ms: 0.2928
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
|
||||
ok 20 - host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
|
||||
---
|
||||
duration_ms: 10865.7804
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: corrupted model reservation cannot reduce recovered budget or permit a new engine request
|
||||
ok 21 - corrupted model reservation cannot reduce recovered budget or permit a new engine request
|
||||
---
|
||||
duration_ms: 8811.645
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
|
||||
ok 22 - engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
|
||||
---
|
||||
duration_ms: 731.2372
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
|
||||
ok 23 - owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
|
||||
---
|
||||
duration_ms: 1384.3111
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: an invalid startup nonce is rejected before initialize and preserves the process close and partial report
|
||||
ok 24 - an invalid startup nonce is rejected before initialize and preserves the process close and partial report
|
||||
---
|
||||
duration_ms: 1236.3923
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: SDK identity and session directory mismatches retain raw responses and never become verified
|
||||
ok 25 - SDK identity and session directory mismatches retain raw responses and never become verified
|
||||
---
|
||||
duration_ms: 3841.0501
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
|
||||
ok 26 - cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
|
||||
---
|
||||
duration_ms: 1337.7515
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: cancel before readiness sends no protocol request and a user retry creates a different process and record
|
||||
ok 27 - cancel before readiness sends no protocol request and a user retry creates a different process and record
|
||||
---
|
||||
duration_ms: 1766.3237
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: source or scratch changes and unexpected model traffic fail after preserving the actual observed result
|
||||
ok 28 - source or scratch changes and unexpected model traffic fail after preserving the actual observed result
|
||||
---
|
||||
duration_ms: 3876.5429
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
|
||||
ok 29 - unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
|
||||
---
|
||||
duration_ms: 2487.8291
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
|
||||
ok 30 - engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
|
||||
---
|
||||
duration_ms: 1244.7198
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
|
||||
ok 31 - foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
|
||||
---
|
||||
duration_ms: 1117.1807
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: restart never replays an active engine check or stops a historical PID, and keeps prior task state
|
||||
ok 32 - restart never replays an active engine check or stops a historical PID, and keeps prior task state
|
||||
---
|
||||
duration_ms: 1359.5664
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: model argument validation and runtime activity do not grant external engine prompt or project execution
|
||||
ok 33 - model argument validation and runtime activity do not grant external engine prompt or project execution
|
||||
---
|
||||
duration_ms: 661.7343
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
|
||||
ok 34 - a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
|
||||
---
|
||||
duration_ms: 1925.1735
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
|
||||
ok 35 - HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
|
||||
---
|
||||
duration_ms: 10680.8387
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
|
||||
ok 36 - HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
|
||||
---
|
||||
duration_ms: 13802.8412
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
|
||||
ok 37 - verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
|
||||
---
|
||||
duration_ms: 34905.4242
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: overlapping worker paths are explicit conflicts even if each independent task checks successfully
|
||||
ok 38 - overlapping worker paths are explicit conflicts even if each independent task checks successfully
|
||||
---
|
||||
duration_ms: 23076.2678
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
|
||||
ok 39 - source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
|
||||
---
|
||||
duration_ms: 21509.2095
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: changed child bytes after parent preview block the entire batch before any parent write
|
||||
ok 40 - changed child bytes after parent preview block the entire batch before any parent write
|
||||
---
|
||||
duration_ms: 28009.8619
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: corrupt original check logs cannot become collected outputs or a parent review
|
||||
ok 41 - corrupt original check logs cannot become collected outputs or a parent review
|
||||
---
|
||||
duration_ms: 21518.3373
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: stopping a parent accounts late responses and executes none of their proposed tools
|
||||
ok 42 - stopping a parent accounts late responses and executes none of their proposed tools
|
||||
---
|
||||
duration_ms: 10380.3694
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
|
||||
ok 43 - unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
|
||||
---
|
||||
duration_ms: 10919.4728
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a response exceeding the cumulative token allocation stops before registering or executing its tools
|
||||
ok 44 - a response exceeding the cumulative token allocation stops before registering or executing its tools
|
||||
---
|
||||
duration_ms: 10330.442
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: cumulative tool allocation rejects the entire returned batch before any tool side effect
|
||||
ok 45 - cumulative tool allocation rejects the entire returned batch before any tool side effect
|
||||
---
|
||||
duration_ms: 10120.0901
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: single response 16 tool ceiling rejects the entire returned batch before any tool side effect
|
||||
ok 46 - single response 16 tool ceiling rejects the entire returned batch before any tool side effect
|
||||
---
|
||||
duration_ms: 10288.9937
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: consumed request steps remain consumed across explicit worker resumes
|
||||
ok 47 - consumed request steps remain consumed across explicit worker resumes
|
||||
---
|
||||
duration_ms: 11051.708
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a saved completed response with missing usage is conservatively accounted exactly once during recovery
|
||||
ok 48 - a saved completed response with missing usage is conservatively accounted exactly once during recovery
|
||||
---
|
||||
duration_ms: 8958.148
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: an unexecuted second workspace plan resumes its original identity without recreating the first checkout
|
||||
ok 49 - an unexecuted second workspace plan resumes its original identity without recreating the first checkout
|
||||
---
|
||||
duration_ms: 9815.1841
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
|
||||
ok 50 - a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
|
||||
---
|
||||
duration_ms: 32012.3475
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: recovery attaches a sealed parent batch saved before its group reference without creating another batch
|
||||
ok 51 - recovery attaches a sealed parent batch saved before its group reference without creating another batch
|
||||
---
|
||||
duration_ms: 28124.7263
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
|
||||
ok 52 - explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
|
||||
---
|
||||
duration_ms: 28818.7589
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
|
||||
ok 53 - unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
|
||||
---
|
||||
duration_ms: 31832.0692
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: after a restart the batch application lazily reinstates the worker result guard before any parent write
|
||||
ok 54 - after a restart the batch application lazily reinstates the worker result guard before any parent write
|
||||
---
|
||||
duration_ms: 27876.2984
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: unknown original tool inputs must match before acknowledgement, and reviewed checkpoint IDs preserve the unknown fact
|
||||
ok 55 - unknown original tool inputs must match before acknowledgement, and reviewed checkpoint IDs preserve the unknown fact
|
||||
---
|
||||
duration_ms: 11211.8706
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a parent stop observes and waits for a manually approved child check and its real descendant process
|
||||
ok 56 - a parent stop observes and waits for a manually approved child check and its real descendant process
|
||||
---
|
||||
duration_ms: 10807.5113
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a real host crash preserves unknown checks, refuses a still living owned PID and never replays a model or tool
|
||||
ok 57 - a real host crash preserves unknown checks, refuses a still living owned PID and never replays a model or tool
|
||||
---
|
||||
duration_ms: 19019.2047
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a persisted child initialization resumes the original control run after a failure before its worker record
|
||||
ok 58 - a persisted child initialization resumes the original control run after a failure before its worker record
|
||||
---
|
||||
duration_ms: 9889.5335
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: failed request intent persistence never dispatches a worker request or changes source
|
||||
ok 59 - failed request intent persistence never dispatches a worker request or changes source
|
||||
---
|
||||
duration_ms: 10482.6794
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: failed usage persistence rolls back the uncommitted usage and conservatively reserves one unknown request without tools
|
||||
ok 60 - failed usage persistence rolls back the uncommitted usage and conservatively reserves one unknown request without tools
|
||||
---
|
||||
duration_ms: 10040.0269
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a child file change after observation prevents acknowledgement even when the tool inputs did not change
|
||||
ok 61 - a child file change after observation prevents acknowledgement even when the tool inputs did not change
|
||||
---
|
||||
duration_ms: 10021.0669
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: worker scopes and allocated budgets reject aliases, extra permissions and aggregate overflow
|
||||
ok 62 - worker scopes and allocated budgets reject aliases, extra permissions and aggregate overflow
|
||||
---
|
||||
duration_ms: 653.4276
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: two sequential Git workspaces freeze a new parent goal, separate owned tasks and preserve all source bytes
|
||||
ok 63 - two sequential Git workspaces freeze a new parent goal, separate owned tasks and preserve all source bytes
|
||||
---
|
||||
duration_ms: 8956.1164
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: real isolated changes, approvals and npm checks produce original owned outputs, not model completion claims
|
||||
ok 64 - real isolated changes, approvals and npm checks produce original owned outputs, not model completion claims
|
||||
---
|
||||
duration_ms: 22042.2963
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: forged worker tools cannot execute terminal or Git even when absent from the advertised tool list
|
||||
ok 65 - forged worker tools cannot execute terminal or Git even when absent from the advertised tool list
|
||||
---
|
||||
duration_ms: 9099.6576
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: a completion-only model pauses each worker without fabricated changes or checks
|
||||
ok 66 - a completion-only model pauses each worker without fabricated changes or checks
|
||||
---
|
||||
duration_ms: 10901.1151
|
||||
type: 'test'
|
||||
...
|
||||
# Subtest: restart retains frozen scope and marks interrupted parent and workers unknown without sending requests
|
||||
ok 67 - restart retains frozen scope and marks interrupted parent and workers unknown without sending requests
|
||||
---
|
||||
duration_ms: 8780.2684
|
||||
type: 'test'
|
||||
...
|
||||
1..67
|
||||
# tests 67
|
||||
# suites 0
|
||||
# pass 67
|
||||
# fail 0
|
||||
# cancelled 0
|
||||
# skipped 0
|
||||
# todo 0
|
||||
# duration_ms 643018.4941
|
||||
Reference in New Issue
Block a user