TAP version 13 # Subtest: a starter is copied into user data once; restarting from another program version preserves existing projects and editable bytes ok 1 - a starter is copied into user data once; restarting from another program version preserves existing projects and editable bytes --- duration_ms: 1510.008 type: 'test' ... # Subtest: startup does not insert a demo or rewrite/reorder an existing user project registry ok 2 - startup does not insert a demo or rewrite/reorder an existing user project registry --- duration_ms: 772.3858 type: 'test' ... # Subtest: PNG bytes are fully decoded, metadata-free and bounded; JPEG EXIF orientation is applied to the sent PNG ok 3 - PNG bytes are fully decoded, metadata-free and bounded; JPEG EXIF orientation is applied to the sent PNG --- duration_ms: 105.6938 type: 'test' ... # Subtest: forged type, short headers, CRC damage, incomplete chunks, trailing payloads, animation and dimension bombs reject ok 4 - forged type, short headers, CRC damage, incomplete chunks, trailing payloads, animation and dimension bombs reject --- duration_ms: 22.2298 type: 'test' ... # Subtest: draft image ownership, withdrawal, reload and atomic Task binding retain original SHA and original bytes ok 5 - draft image ownership, withdrawal, reload and atomic Task binding retain original SHA and original bytes --- duration_ms: 1438.8777 type: 'test' ... # Subtest: a failed session transaction restores draft status and cannot leave a Run consuming the attachment ok 6 - a failed session transaction restores draft status and cannot leave a Run consuming the attachment --- duration_ms: 688.7361 type: 'test' ... # Subtest: draft limits, duplicate selection, source changes and cross-Task association reject before dispatch ok 7 - draft limits, duplicate selection, source changes and cross-Task association reject before dispatch --- duration_ms: 1415.6448 type: 'test' ... # Subtest: demo and legacy paths refuse image dispatch without creating a Task or consuming the draft ok 8 - demo and legacy paths refuse image dispatch without creating a Task or consuming the draft --- duration_ms: 694.5616 type: 'test' ... # Subtest: chat-completions sends one owned image per actual request, pairs original tools and verifies exact sealed bytes ok 9 - chat-completions sends one owned image per actual request, pairs original tools and verifies exact sealed bytes --- duration_ms: 2656.2304 type: 'test' ... # Subtest: responses sends one owned image per actual request, pairs original tools and verifies exact sealed bytes ok 10 - responses sends one owned image per actual request, pairs original tools and verifies exact sealed bytes --- duration_ms: 2554.976 type: 'test' ... # Subtest: mixed pool excludes unknown vision before lease and sends zero HTTP to the incompatible member ok 11 - mixed pool excludes unknown vision before lease and sends zero HTTP to the incompatible member --- duration_ms: 2020.2061 type: 'test' ... # Subtest: vision probe requires correct randomized pixel order and evidence expires when the connection revision changes ok 12 - vision probe requires correct randomized pixel order and evidence expires when the connection revision changes --- duration_ms: 1014.2689 type: 'test' ... # Subtest: HTTP upload/read/withdraw uses session authorization, returns byte SHA and refuses unknown ownership ok 13 - HTTP upload/read/withdraw uses session authorization, returns byte SHA and refuses unknown ownership --- duration_ms: 884.5552 type: 'test' ... # Subtest: image accounting excludes Base64 as text but seals every original request byte and reserves image input separately ok 14 - image accounting excludes Base64 as text but seals every original request byte and reserves image input separately --- duration_ms: 3.8624 type: 'test' ... # Subtest: MCP registration stays disabled until an explicit real stdio probe and schema-based tool selection, with actual process cleanup ok 15 - MCP registration stays disabled until an explicit real stdio probe and schema-based tool selection, with actual process cleanup --- duration_ms: 2020.3606 type: 'test' ... # Subtest: MCP probe holds the project operation lock until its owned process and report are settled ok 16 - MCP probe holds the project operation lock until its owned process and report are settled --- duration_ms: 1714.9008 type: 'test' ... # Subtest: MCP validates the declared JSON schema subset and rejects unsupported schemas before external dispatch ok 17 - MCP validates the declared JSON schema subset and rejects unsupported schemas before external dispatch --- duration_ms: 0.7635 type: 'test' ... # Subtest: actual model MCP call approves long schema-valid arguments, validates the sent catalog and stores one original result without leaking environment secrets ok 18 - actual model MCP call approves long schema-valid arguments, validates the sent catalog and stores one original result without leaking environment secrets --- duration_ms: 5000.8811 type: 'test' ... # Subtest: denying an MCP call never starts another process or executes the external tool ok 19 - denying an MCP call never starts another process or executes the external tool --- duration_ms: 3977.1824 type: 'test' ... # Subtest: actual handshake drift rejects tools/call even if program entry hash is unchanged ok 20 - actual handshake drift rejects tools/call even if program entry hash is unchanged --- duration_ms: 4595.4047 type: 'test' ... # Subtest: cancelled dispatched external side effect stays unknown, closes its owned process and cannot replay on reopen ok 21 - cancelled dispatched external side effect stays unknown, closes its owned process and cannot replay on reopen --- duration_ms: 3782.5164 type: 'test' ... # Subtest: changed executable input, foreign project IDs and corrupted original contracts block enable and dispatch ok 22 - changed executable input, foreign project IDs and corrupted original contracts block enable and dispatch --- duration_ms: 1976.1076 type: 'test' ... # Subtest: registered MCP HTTP API uses fixed execution contracts and project-owned probe records with no model requests ok 23 - registered MCP HTTP API uses fixed execution contracts and project-owned probe records with no model requests --- duration_ms: 3627.5799 type: 'test' ... # Subtest: unknown MCP pauses later tool calls and all project writers; fingerprinted acknowledgement clears only the review gates and explicit resume does not replay ok 24 - unknown MCP pauses later tool calls and all project writers; fingerprinted acknowledgement clears only the review gates and explicit resume does not replay --- duration_ms: 6578.111 type: 'test' ... # Subtest: MCP acknowledgement persistence failure restores both job and tool review gates; corrupt evidence cannot be acknowledged ok 25 - MCP acknowledgement persistence failure restores both job and tool review gates; corrupt evidence cannot be acknowledged --- duration_ms: 5102.9073 type: 'test' ... # Subtest: actual host exit after an external effect restores unknown jobs without a fabricated report, allows source-bound review and never replays the call ok 26 - actual host exit after an external effect restores unknown jobs without a fabricated report, allows source-bound review and never replays the call --- duration_ms: 3942.5577 type: 'test' ... # Subtest: changed enabled MCP programs can be explicitly disabled without launching or trusting their changed source ok 27 - changed enabled MCP programs can be explicitly disabled without launching or trusting their changed source --- duration_ms: 1976.0775 type: 'test' ... # Subtest: stdio preserves split UTF-8 frames and final replies drained after process exit ok 28 - stdio preserves split UTF-8 frames and final replies drained after process exit --- duration_ms: 1724.8718 type: 'test' ... # Subtest: server-initiated model requests are refused instead of inheriting provider privileges ok 29 - server-initiated model requests are refused instead of inheriting provider privileges --- duration_ms: 761.5789 type: 'test' ... # Subtest: invalid or over-budget protocol invalid closes only its owned process and is not retried ok 30 - invalid or over-budget protocol invalid closes only its owned process and is not retried --- duration_ms: 893.525 type: 'test' ... # Subtest: invalid or over-budget protocol oversized closes only its owned process and is not retried ok 31 - invalid or over-budget protocol oversized closes only its owned process and is not retried --- duration_ms: 862.9942 type: 'test' ... # Subtest: cancel and timeout do not resend a dispatched request and pre-cancel has no request trace ok 32 - cancel and timeout do not resend a dispatched request and pre-cancel has no request trace --- duration_ms: 807.7147 type: 'test' ... # Subtest: startup failure remains undispatched and has no process PID to terminate ok 33 - startup failure remains undispatched and has no process PID to terminate --- duration_ms: 675.5724 type: 'test' ... # Subtest: REA launch filters a fixture credential canary and rejects changed entry identity before a new connection ok 34 - REA launch filters a fixture credential canary and rejects changed entry identity before a new connection --- duration_ms: 1019.0636 type: 'test' ... # Subtest: schema1 connections remain readable without inventing observed capabilities or migrating original state ok 35 - schema1 connections remain readable without inventing observed capabilities or migrating original state --- duration_ms: 721.3207 type: 'test' ... # Subtest: protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence ok 36 - protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence --- duration_ms: 973.6663 type: 'test' ... # Subtest: ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing ok 37 - ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing --- duration_ms: 0.2782 type: 'test' ... # Subtest: invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate ok 38 - invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate --- duration_ms: 647.8705 type: 'test' ... # Subtest: model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart ok 39 - model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart --- duration_ms: 1183.26 type: 'test' ... # Subtest: config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts ok 40 - config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts --- duration_ms: 721.1615 type: 'test' ... # Subtest: real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity ok 41 - real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity --- duration_ms: 3365.9943 type: 'test' ... # Subtest: pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests ok 42 - pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests --- duration_ms: 4197.7843 type: 'test' ... # Subtest: 401 blocks the credential revision; updating the key restores availability without leaking error echoes ok 43 - 401 blocks the credential revision; updating the key restores availability without leaking error echoes --- duration_ms: 1903.8234 type: 'test' ... # Subtest: queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request ok 44 - queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request --- duration_ms: 861.7519 type: 'test' ... # Subtest: compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model ok 45 - compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model --- duration_ms: 2421.7997 type: 'test' ... # Subtest: model registry disk failures restore routing, pool profiles and credential references without partial updates ok 46 - model registry disk failures restore routing, pool profiles and credential references without partial updates --- duration_ms: 547.8723 type: 'test' ... # Subtest: model selection and saved configuration commit together and failures preserve the original mode and endpoint ok 47 - model selection and saved configuration commit together and failures preserve the original mode and endpoint --- duration_ms: 794.0243 type: 'test' ... # Subtest: configuration imports roll back the entire batch and retain one usable preview after validation or commit failure ok 48 - configuration imports roll back the entire batch and retain one usable preview after validation or commit failure --- duration_ms: 678.5991 type: 'test' ... # Subtest: HTTP quota retains native code/type/param/request id, bounded original and allowlisted headers, never repeats that connection ok 49 - HTTP quota retains native code/type/param/request id, bounded original and allowlisted headers, never repeats that connection --- duration_ms: 1926.1208 type: 'test' ... # Subtest: Retry-After above 90 seconds remains exact and a short local budget cannot trigger an early retry ok 50 - Retry-After above 90 seconds remains exact and a short local budget cannot trigger an early retry --- duration_ms: 1.6355 type: 'test' ... # Subtest: Retry-After date, expired date, huge value and invalid header retain explicit semantics ok 51 - Retry-After date, expired date, huge value and invalid header retain explicit semantics --- duration_ms: 0.971 type: 'test' ... # Subtest: unclassified 429 remains unspecified and every bounded actual retry retains its own original error ok 52 - unclassified 429 remains unspecified and every bounded actual retry retains its own original error --- duration_ms: 1720.7395 type: 'test' ... # Subtest: oversized HTTP error saves exactly the bounded prefix and labels its incomplete range ok 53 - oversized HTTP error saves exactly the bounded prefix and labels its incomplete range --- duration_ms: 1707.0658 type: 'test' ... # Subtest: Chat SSE error preserves upstream fields, original failed event, partial tool and reported usage without executing or retrying ok 54 - Chat SSE error preserves upstream fields, original failed event, partial tool and reported usage without executing or retrying --- duration_ms: 2217.3098 type: 'test' ... # Subtest: Responses failed SSE retains original event/response identity and usage ok 55 - Responses failed SSE retains original event/response identity and usage --- duration_ms: 2291.545 type: 'test' ... # Subtest: Responses incomplete SSE retains original event/response identity and usage ok 56 - Responses incomplete SSE retains original event/response identity and usage --- duration_ms: 2044.0741 type: 'test' ... # Subtest: unsupported successful Responses output retains original JSON and usage with a local protocol origin ok 57 - unsupported successful Responses output retains original JSON and usage with a local protocol origin --- duration_ms: 2224.9664 type: 'test' ... # Subtest: HTTP 200 native error is still an upstream failure rather than a fabricated successful answer ok 58 - HTTP 200 native error is still an upstream failure rather than a fabricated successful answer --- duration_ms: 1.3568 type: 'test' ... # Subtest: JSON-escaped credential echoes are redacted in the original preview and capture as well as parsed fields ok 59 - JSON-escaped credential echoes are redacted in the original preview and capture as well as parsed fields --- duration_ms: 0.6537 type: 'test' ... # Subtest: quota failover uses another independent pool member and never replays a failed stream ok 60 - quota failover uses another independent pool member and never replays a failed stream --- duration_ms: 2813.3849 type: 'test' ... # Subtest: native parameters are isolated by pool member, preserve Responses state and bind the original output reservation ok 61 - native parameters are isolated by pool member, preserve Responses state and bind the original output reservation --- duration_ms: 0.6327 type: 'test' ... # Subtest: unsupported native fields and invalid values reject before dispatch instead of silently dropping or overriding constraints ok 62 - unsupported native fields and invalid values reject before dispatch instead of silently dropping or overriding constraints --- duration_ms: 0.6017 type: 'test' ... # Subtest: native settings for legacy and registered profiles persist without changing credentials or old records and reject stale edits ok 63 - native settings for legacy and registered profiles persist without changing credentials or old records and reject stale edits --- duration_ms: 1198.9506 type: 'test' ... # Subtest: compiled native settings API saves/restores exact parameters and rejects reserved fields without mutating the profile ok 64 - compiled native settings API saves/restores exact parameters and rejects reserved fields without mutating the profile --- duration_ms: 2466.1458 type: 'test' ... # Subtest: legacy connection test sends its saved native fields and selected output limit field without changing the configuration ok 65 - legacy connection test sends its saved native fields and selected output limit field without changing the configuration --- duration_ms: 2287.4046 type: 'test' ... # Subtest: saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance ok 66 - saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance --- duration_ms: 1054.3221 type: 'test' ... # Subtest: owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched ok 67 - owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched --- duration_ms: 1262.1876 type: 'test' ... # Subtest: Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes ok 68 - Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes --- duration_ms: 3309.4321 type: 'test' ... # Subtest: mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools ok 69 - mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools --- duration_ms: 4090.8423 type: 'test' ... # Subtest: Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool # Subtest: Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" ok 1 - Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" --- duration_ms: 2119.2308 type: 'test' ... # Subtest: Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal ok 2 - Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal --- duration_ms: 1931.869 type: 'test' ... # Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal ok 3 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal --- duration_ms: 1511.922 type: 'test' ... # Subtest: Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte ok 4 - Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte --- duration_ms: 1264.3483 type: 'test' ... 1..4 ok 70 - Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool --- duration_ms: 6828.3294 type: 'test' ... # Subtest: invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay # Subtest: chat-completions ok 1 - chat-completions --- duration_ms: 1451.7311 type: 'test' ... # Subtest: responses ok 2 - responses --- duration_ms: 1464.8932 type: 'test' ... 1..2 ok 71 - invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay --- duration_ms: 2917.0655 type: 'test' ... # Subtest: wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint ok 72 - wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint --- duration_ms: 0.2409 type: 'test' ... # Subtest: connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions ok 73 - connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions --- duration_ms: 538.1646 type: 'test' ... 1..73 # tests 79 # suites 0 # pass 79 # fail 0 # cancelled 0 # skipped 0 # todo 0 # duration_ms 67511.5502