Files
Agent-Workbench/docs/controlled-engine-worker-compatible.tap

413 lines
18 KiB
Plaintext

TAP version 13
# Subtest: controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
ok 1 - controlled installation pins the native kernel and bridge independently of the existing connection-probe identity
---
duration_ms: 816.2291
type: 'test'
...
# Subtest: controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
ok 2 - controlled profiles disable every native project/terminal provider and native model/retry route using the actual include patch contract
---
duration_ms: 0.5492
type: 'test'
...
# Subtest: owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
ok 3 - owned tool catalogues seal full schemas canonically and reject duplicate or malformed declarations
---
duration_ms: 5.4234
type: 'test'
...
# Subtest: bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
ok 4 - bridge authentication, current Run, process, SDK session and browser-origin checks reject before dispatch
---
duration_ms: 950.2421
type: 'test'
...
# Subtest: bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
ok 5 - bridge duplicates, unknown tools, malformed arguments and source changes are refused before a second side effect
---
duration_ms: 679.3481
type: 'test'
...
# Subtest: bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
ok 6 - bridge model requests bind the exact catalogue, route and output bound and preserve raw request/result identity
---
duration_ms: 697.0703
type: 'test'
...
# Subtest: stopped and oversized bridge requests never reach a local model or tool callback
ok 7 - stopped and oversized bridge requests never reach a local model or tool callback
---
duration_ms: 590.4988
type: 'test'
...
# Subtest: engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
ok 8 - engine HTTP checks bind the detected installation and current task, page original bytes and preserve them across host restart
---
duration_ms: 2573.4285
type: 'test'
...
# Subtest: HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
ok 9 - HTTP stop seals a pending SDK call, rejects automatic replay and keeps failures attached to the original session
---
duration_ms: 2958.6899
type: 'test'
...
# Subtest: native text and call IDs preserve original result pairing while unsupported content fails closed
ok 10 - native text and call IDs preserve original result pairing while unsupported content fails closed
---
duration_ms: 0.7762
type: 'test'
...
# Subtest: one engine child freezes real installation identity before creating tasks and rejects a changed source
ok 11 - one engine child freezes real installation identity before creating tasks and rejects a changed source
---
duration_ms: 5899.1837
type: 'test'
...
# Subtest: owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
ok 12 - owned native tools return saved results, use real approvals/checks and account each actual request once across new engine Runs
---
duration_ms: 17601.082
type: 'test'
...
# Subtest: forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
ok 13 - forged native scope cannot change a parent file and a final completion claim cannot replace worker proof
---
duration_ms: 9063.3297
type: 'test'
...
# Subtest: duplicate native IDs are rejected without replaying a saved tool
ok 14 - duplicate native IDs are rejected without replaying a saved tool
---
duration_ms: 8481.8966
type: 'test'
...
# Subtest: native input exceeding the context budget is retained and sends no model request
ok 15 - native input exceeding the context budget is retained and sends no model request
---
duration_ms: 7140.3817
type: 'test'
...
# Subtest: stop retains a late reported model usage once and executes no tool from that output
ok 16 - stop retains a late reported model usage once and executes no tool from that output
---
duration_ms: 7565.0223
type: 'test'
...
# Subtest: a source change after the original model intent stops before native tools execute
ok 17 - a source change after the original model intent stops before native tools execute
---
duration_ms: 7435.7032
type: 'test'
...
# Subtest: missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
ok 18 - missing or noncompleted turn end cannot be adopted even with an owned receipt and assistant text
---
duration_ms: 0.5515
type: 'test'
...
# Subtest: closed root with an original live descendant remains unknown and retains its process tree
ok 19 - closed root with an original live descendant remains unknown and retains its process tree
---
duration_ms: 0.2928
type: 'test'
...
# Subtest: host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
ok 20 - host recovery reserves original pending attempts exactly once and explicit review preserves unknown outcomes
---
duration_ms: 10865.7804
type: 'test'
...
# Subtest: corrupted model reservation cannot reduce recovered budget or permit a new engine request
ok 21 - corrupted model reservation cannot reduce recovered budget or permit a new engine request
---
duration_ms: 8811.645
type: 'test'
...
# Subtest: engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
ok 22 - engine detection seals the actual CLI, SDK, profile and Node and rejects mixed versions without launch
---
duration_ms: 731.2372
type: 'test'
...
# Subtest: owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
ok 23 - owned engine probe waits for real ready identity, verifies six native responses and saves immutable task evidence
---
duration_ms: 1384.3111
type: 'test'
...
# Subtest: an invalid startup nonce is rejected before initialize and preserves the process close and partial report
ok 24 - an invalid startup nonce is rejected before initialize and preserves the process close and partial report
---
duration_ms: 1236.3923
type: 'test'
...
# Subtest: SDK identity and session directory mismatches retain raw responses and never become verified
ok 25 - SDK identity and session directory mismatches retain raw responses and never become verified
---
duration_ms: 3841.0501
type: 'test'
...
# Subtest: cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
ok 26 - cancel during a pending initialize closes only the owned process without sending an unsupported MCP cancellation
---
duration_ms: 1337.7515
type: 'test'
...
# Subtest: cancel before readiness sends no protocol request and a user retry creates a different process and record
ok 27 - cancel before readiness sends no protocol request and a user retry creates a different process and record
---
duration_ms: 1766.3237
type: 'test'
...
# Subtest: source or scratch changes and unexpected model traffic fail after preserving the actual observed result
ok 28 - source or scratch changes and unexpected model traffic fail after preserving the actual observed result
---
duration_ms: 3876.5429
type: 'test'
...
# Subtest: unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
ok 29 - unowned idle notifications stay quarantined and server requests receive a rejection without granting operations
---
duration_ms: 2487.8291
type: 'test'
...
# Subtest: engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
ok 30 - engine probe environment excludes parent secrets and NODE_OPTIONS while preserving operating system paths
---
duration_ms: 1244.7198
type: 'test'
...
# Subtest: foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
ok 31 - foreign sessions and altered reports or task bindings cannot reuse verified engine evidence
---
duration_ms: 1117.1807
type: 'test'
...
# Subtest: restart never replays an active engine check or stops a historical PID, and keeps prior task state
ok 32 - restart never replays an active engine check or stops a historical PID, and keeps prior task state
---
duration_ms: 1359.5664
type: 'test'
...
# Subtest: model argument validation and runtime activity do not grant external engine prompt or project execution
ok 33 - model argument validation and runtime activity do not grant external engine prompt or project execution
---
duration_ms: 661.7343
type: 'test'
...
# Subtest: a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
ok 34 - a follow-up question receives the actual failed engine check from its original Task and keeps its report unchanged
---
duration_ms: 1925.1735
type: 'test'
...
# Subtest: HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
ok 35 - HTTP worker identities require a current sealed plan, reject overrides and close unused plans without touching source
---
duration_ms: 10680.8387
type: 'test'
...
# Subtest: HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
ok 36 - HTTP unknown recovery only accepts the original evidence SHA and preserves changed source for explicit retention
---
duration_ms: 13802.8412
type: 'test'
...
# Subtest: verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
ok 37 - verified isolated outputs form a new parent batch, rerun real checks and commit only reviewed source
---
duration_ms: 34905.4242
type: 'test'
...
# Subtest: overlapping worker paths are explicit conflicts even if each independent task checks successfully
ok 38 - overlapping worker paths are explicit conflicts even if each independent task checks successfully
---
duration_ms: 23076.2678
type: 'test'
...
# Subtest: source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
ok 39 - source edits after isolated work preserve the owner file and invalidate collection without proposing a merge
---
duration_ms: 21509.2095
type: 'test'
...
# Subtest: changed child bytes after parent preview block the entire batch before any parent write
ok 40 - changed child bytes after parent preview block the entire batch before any parent write
---
duration_ms: 28009.8619
type: 'test'
...
# Subtest: corrupt original check logs cannot become collected outputs or a parent review
ok 41 - corrupt original check logs cannot become collected outputs or a parent review
---
duration_ms: 21518.3373
type: 'test'
...
# Subtest: stopping a parent accounts late responses and executes none of their proposed tools
ok 42 - stopping a parent accounts late responses and executes none of their proposed tools
---
duration_ms: 10380.3694
type: 'test'
...
# Subtest: unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
ok 43 - unreported interrupted requests reserve estimated usage and the total deadline cannot reset on resume
---
duration_ms: 10919.4728
type: 'test'
...
# Subtest: a response exceeding the cumulative token allocation stops before registering or executing its tools
ok 44 - a response exceeding the cumulative token allocation stops before registering or executing its tools
---
duration_ms: 10330.442
type: 'test'
...
# Subtest: cumulative tool allocation rejects the entire returned batch before any tool side effect
ok 45 - cumulative tool allocation rejects the entire returned batch before any tool side effect
---
duration_ms: 10120.0901
type: 'test'
...
# Subtest: single response 16 tool ceiling rejects the entire returned batch before any tool side effect
ok 46 - single response 16 tool ceiling rejects the entire returned batch before any tool side effect
---
duration_ms: 10288.9937
type: 'test'
...
# Subtest: consumed request steps remain consumed across explicit worker resumes
ok 47 - consumed request steps remain consumed across explicit worker resumes
---
duration_ms: 11051.708
type: 'test'
...
# Subtest: a saved completed response with missing usage is conservatively accounted exactly once during recovery
ok 48 - a saved completed response with missing usage is conservatively accounted exactly once during recovery
---
duration_ms: 8958.148
type: 'test'
...
# Subtest: an unexecuted second workspace plan resumes its original identity without recreating the first checkout
ok 49 - an unexecuted second workspace plan resumes its original identity without recreating the first checkout
---
duration_ms: 9815.1841
type: 'test'
...
# Subtest: a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
ok 50 - a verified interrupted parent proposal resumes sealing without duplicating or replacing its original change
---
duration_ms: 32012.3475
type: 'test'
...
# Subtest: recovery attaches a sealed parent batch saved before its group reference without creating another batch
ok 51 - recovery attaches a sealed parent batch saved before its group reference without creating another batch
---
duration_ms: 28124.7263
type: 'test'
...
# Subtest: explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
ok 52 - explicitly retaining an unexecuted parent merge cancels its batch and frees the next parent goal
---
duration_ms: 28818.7589
type: 'test'
...
# Subtest: unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
ok 53 - unknown collaboration blocks ordinary proposals but permits only original batch recovery and rollback
---
duration_ms: 31832.0692
type: 'test'
...
# Subtest: after a restart the batch application lazily reinstates the worker result guard before any parent write
ok 54 - after a restart the batch application lazily reinstates the worker result guard before any parent write
---
duration_ms: 27876.2984
type: 'test'
...
# Subtest: unknown original tool inputs must match before acknowledgement, and reviewed checkpoint IDs preserve the unknown fact
ok 55 - unknown original tool inputs must match before acknowledgement, and reviewed checkpoint IDs preserve the unknown fact
---
duration_ms: 11211.8706
type: 'test'
...
# Subtest: a parent stop observes and waits for a manually approved child check and its real descendant process
ok 56 - a parent stop observes and waits for a manually approved child check and its real descendant process
---
duration_ms: 10807.5113
type: 'test'
...
# Subtest: a real host crash preserves unknown checks, refuses a still living owned PID and never replays a model or tool
ok 57 - a real host crash preserves unknown checks, refuses a still living owned PID and never replays a model or tool
---
duration_ms: 19019.2047
type: 'test'
...
# Subtest: a persisted child initialization resumes the original control run after a failure before its worker record
ok 58 - a persisted child initialization resumes the original control run after a failure before its worker record
---
duration_ms: 9889.5335
type: 'test'
...
# Subtest: failed request intent persistence never dispatches a worker request or changes source
ok 59 - failed request intent persistence never dispatches a worker request or changes source
---
duration_ms: 10482.6794
type: 'test'
...
# Subtest: failed usage persistence rolls back the uncommitted usage and conservatively reserves one unknown request without tools
ok 60 - failed usage persistence rolls back the uncommitted usage and conservatively reserves one unknown request without tools
---
duration_ms: 10040.0269
type: 'test'
...
# Subtest: a child file change after observation prevents acknowledgement even when the tool inputs did not change
ok 61 - a child file change after observation prevents acknowledgement even when the tool inputs did not change
---
duration_ms: 10021.0669
type: 'test'
...
# Subtest: worker scopes and allocated budgets reject aliases, extra permissions and aggregate overflow
ok 62 - worker scopes and allocated budgets reject aliases, extra permissions and aggregate overflow
---
duration_ms: 653.4276
type: 'test'
...
# Subtest: two sequential Git workspaces freeze a new parent goal, separate owned tasks and preserve all source bytes
ok 63 - two sequential Git workspaces freeze a new parent goal, separate owned tasks and preserve all source bytes
---
duration_ms: 8956.1164
type: 'test'
...
# Subtest: real isolated changes, approvals and npm checks produce original owned outputs, not model completion claims
ok 64 - real isolated changes, approvals and npm checks produce original owned outputs, not model completion claims
---
duration_ms: 22042.2963
type: 'test'
...
# Subtest: forged worker tools cannot execute terminal or Git even when absent from the advertised tool list
ok 65 - forged worker tools cannot execute terminal or Git even when absent from the advertised tool list
---
duration_ms: 9099.6576
type: 'test'
...
# Subtest: a completion-only model pauses each worker without fabricated changes or checks
ok 66 - a completion-only model pauses each worker without fabricated changes or checks
---
duration_ms: 10901.1151
type: 'test'
...
# Subtest: restart retains frozen scope and marks interrupted parent and workers unknown without sending requests
ok 67 - restart retains frozen scope and marks interrupted parent and workers unknown without sending requests
---
duration_ms: 8780.2684
type: 'test'
...
1..67
# tests 67
# suites 0
# pass 67
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 643018.4941