157 lines
16 KiB
Plaintext
157 lines
16 KiB
Plaintext
✔ Messages builds native system/tool history, bounds images, and seals a distinct mixed-pool variant (6.7516ms)
|
||
✔ Messages URL and native parameter contracts preserve other protocol paths and hard output budget (0.524ms)
|
||
✔ native usage includes both cache buckets once, retains raw and rejects invalid counters (0.1777ms)
|
||
✔ real HTTP Messages JSON executes one tool, retains opaque history, actual URL and cache accounting (3013.2609ms)
|
||
✔ real HTTP Messages SSE executes one tool, retains opaque history, actual URL and cache accounting (2190.1543ms)
|
||
✔ Messages api-key authentication is explicit; mismatched model remains blocked with original usage (5.1733ms)
|
||
✔ Messages bearer authentication is explicit; mismatched model remains blocked with original usage (4.0284ms)
|
||
✔ Messages redirect is not followed, either credential stays at the original server (3.9361ms)
|
||
✔ strict native SSE reads the nested start model and retains mismatch source without retries (3.4398ms)
|
||
✔ a closed native tool block cannot execute before message_stop, then executes exactly once (2543.4174ms)
|
||
✔ mixed Chat/Messages pool seals both variants and preserves one completed tool on failover (3149.3977ms)
|
||
✔ native JSON rejects incomplete stops, duplicate tools and hosted content (0.3491ms)
|
||
▶ strict SSE validates all blocks, terminal, event names, UTF8 and tool JSON before dispatch
|
||
✔ reject native stream 0 (1.1702ms)
|
||
✔ reject native stream 1 (0.2582ms)
|
||
✔ reject native stream 2 (0.2249ms)
|
||
✔ reject native stream 3 (0.2055ms)
|
||
✔ reject native stream 4 (0.1722ms)
|
||
✔ reject native stream 5 (0.2107ms)
|
||
✔ reject native stream 6 (0.1566ms)
|
||
✔ reject native stream 7 (0.1862ms)
|
||
✔ reject native stream 8 (0.3112ms)
|
||
✔ strict SSE validates all blocks, terminal, event names, UTF8 and tool JSON before dispatch (3.6467ms)
|
||
✔ upstream SSE error retains original type/request ID and initial usage, never retries (6.7765ms)
|
||
✔ stop cancels the owned stream and retains partial consumption without running tool or replaying (60.2562ms)
|
||
✔ saved Messages import preserves auth choice, rejects endpoint duplication, and keeps source file untouched (533.9392ms)
|
||
✔ a Windows virtual data-directory name binds new storage and credentials to its actual physical root (2038.9747ms)
|
||
✔ physical data-root adoption still rejects explicit junctions at the directory or any ancestor (668.77ms)
|
||
✔ actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy (1500.2543ms)
|
||
✔ only explicitly supplied keys persist; new provider restores original revisions and public views contain no key (2398.5932ms)
|
||
✔ registry and cipher commit failure restores original routing, keys, block and every database row (1696.1901ms)
|
||
✔ a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview (1964.8414ms)
|
||
✔ connection revision changes retain the original saved block and report a source mismatch on restart (2246.5277ms)
|
||
✔ disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both (2828.5029ms)
|
||
✔ corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext (2543.9984ms)
|
||
✔ legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save (2579.6184ms)
|
||
✔ owned plaintext keys never reach SQLite pages, WAL, config or public execution exports (1401.7126ms)
|
||
✔ schema1 connections remain readable without inventing observed capabilities or migrating original state (562.0547ms)
|
||
✔ protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence (955.8479ms)
|
||
✔ ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing (0.2814ms)
|
||
✔ invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate (500.5654ms)
|
||
✔ model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart (838.9311ms)
|
||
✔ config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts (912.9089ms)
|
||
✔ real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity (2941.1691ms)
|
||
✔ pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests (3703.9223ms)
|
||
✔ 401 blocks the credential revision; updating the key restores availability without leaking error echoes (1884.1572ms)
|
||
✔ queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request (1058.8129ms)
|
||
✔ compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model (2194.2978ms)
|
||
✔ model registry disk failures restore routing, pool profiles and credential references without partial updates (778.8009ms)
|
||
✔ model selection and saved configuration commit together and failures preserve the original mode and endpoint (924.2998ms)
|
||
✔ configuration imports roll back the entire batch and retain one usable preview after validation or commit failure (729.3175ms)
|
||
✔ HTTP quota retains native code/type/param/request id, bounded original and allowlisted headers, never repeats that connection (2046.2917ms)
|
||
✔ Retry-After above 90 seconds remains exact and a short local budget cannot trigger an early retry (1.8063ms)
|
||
✔ Retry-After date, expired date, huge value and invalid header retain explicit semantics (1.1943ms)
|
||
✔ unclassified 429 remains unspecified and every bounded actual retry retains its own original error (2049.0124ms)
|
||
✔ oversized HTTP error saves exactly the bounded prefix and labels its incomplete range (2072.3122ms)
|
||
✔ Chat SSE error preserves upstream fields, original failed event, partial tool and reported usage without executing or retrying (2192.2207ms)
|
||
✔ Responses failed SSE retains original event/response identity and usage (1856.3933ms)
|
||
✔ Responses incomplete SSE retains original event/response identity and usage (1965.2924ms)
|
||
✔ unsupported successful Responses output retains original JSON and usage with a local protocol origin (2218.8801ms)
|
||
✔ HTTP 200 native error is still an upstream failure rather than a fabricated successful answer (1.4139ms)
|
||
✔ JSON-escaped credential echoes are redacted in the original preview and capture as well as parsed fields (0.917ms)
|
||
✔ quota failover uses another independent pool member and never replays a failed stream (2913.9022ms)
|
||
✔ native parameters are isolated by pool member, preserve Responses state and bind the original output reservation (0.6217ms)
|
||
✔ unsupported native fields and invalid values reject before dispatch instead of silently dropping or overriding constraints (0.795ms)
|
||
✔ native settings for legacy and registered profiles persist without changing credentials or old records and reject stale edits (1044.1796ms)
|
||
✔ compiled native settings API saves/restores exact parameters and rejects reserved fields without mutating the profile (2529.4652ms)
|
||
✔ legacy connection test sends its saved native fields and selected output limit field without changing the configuration (2151.2787ms)
|
||
✔ identity distinguishes missing, invalid, mixed, exact and explicitly declared aliases without guessing (1.3064ms)
|
||
✔ chat-completions JSON rejects a different model before tool dispatch, retaining source and reported usage (1988.3643ms)
|
||
✔ chat-completions SSE rejects a different model before tool dispatch, retaining source and reported usage (1999.8304ms)
|
||
✔ responses JSON rejects a different model before tool dispatch, retaining source and reported usage (2363.2123ms)
|
||
✔ responses SSE rejects a different model before tool dispatch, retaining source and reported usage (2234.5137ms)
|
||
✔ record policy accepts missing identity but keeps it explicit, and strict declared mapping is frozen in the consumption (2.6047ms)
|
||
✔ mixed streamed identities cannot pass strict mode, and interrupted streams retain observed identifiers without authenticating them (1.4246ms)
|
||
✔ identity refusal never fails over to another pool member and raw response model cannot leak known credentials (2214.1019ms)
|
||
✔ strict refusal remains visible even when the same original response exhausts the budget (1284.4646ms)
|
||
✔ strict identity crosses the controlled engine bridge with its original source and zero tool dispatch (12058.5436ms)
|
||
✔ frozen direct connection policy and delivery reports preserve response identity without filling historical gaps (2538.228ms)
|
||
✔ saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance (718.3841ms)
|
||
✔ owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched (895.1361ms)
|
||
✔ Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes (2086.0016ms)
|
||
✔ mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools (2687.1053ms)
|
||
▶ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
|
||
✔ Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" (1713.742ms)
|
||
✔ Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal (1739.4353ms)
|
||
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal (1618.842ms)
|
||
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte (1903.8158ms)
|
||
✔ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool (6976.7273ms)
|
||
▶ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
|
||
✔ chat-completions (2636.4581ms)
|
||
✔ responses (2974.6155ms)
|
||
✔ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay (5611.4804ms)
|
||
✔ wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint (0.2337ms)
|
||
✔ connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions (1230.8034ms)
|
||
✔ reservation uses actual known usage from the same route, never lowers estimates or rewrites original receipts (1.6681ms)
|
||
✔ reservation verification binds original Task/Run consumption and rejects changed usage or foreign provenance (0.4715ms)
|
||
✔ known high input calibrates the next request and stops before dispatch while preserving the completed read (2433.1102ms)
|
||
✔ one reported overrun stops legacy requests and keeps actual use and excess (1983.3313ms)
|
||
✔ one reported overrun stops pool requests and keeps actual use and excess (2819.3236ms)
|
||
✔ one reported overrun stops connection requests and keeps actual use and excess (2492.4876ms)
|
||
✔ reported usage below the limit prevents an unaffordable legacy retry before another dispatch (1999.818ms)
|
||
✔ reported usage below the limit prevents an unaffordable pool retry before another dispatch (3188.8902ms)
|
||
✔ native bridge seals calibrated refusal with original consumption and preserves versioned request verification (14678.9961ms)
|
||
✔ capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run (2096.2784ms)
|
||
✔ all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger (1882.1025ms)
|
||
✔ explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes (1293.9178ms)
|
||
✔ plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support (1547.33ms)
|
||
✔ a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object (1062.8668ms)
|
||
✔ selected connection owns the actual endpoint, credential, wire model and mismatch even when legacy is configured for GPT (3918.3035ms)
|
||
✔ budget-only API and demo/real selection preserve routes, reject injected endpoint fields and publish authoritative selection without keys (2898.388ms)
|
||
✔ another session cannot change default model, mode or budgets while a request is active (3509.7689ms)
|
||
✔ HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8 (2306.3075ms)
|
||
✔ terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once (3213.0203ms)
|
||
✔ reported SSE usage survives rejected required arguments "" without dispatching any tool (1802.1044ms)
|
||
✔ reported SSE usage survives rejected required arguments "{\"path\":" without dispatching any tool (1939.8046ms)
|
||
✔ reported SSE usage survives rejected required arguments "null" without dispatching any tool (2021.5647ms)
|
||
✔ a stream without DONE retains reported usage but cannot adapt or execute even an optional tool (1415.2064ms)
|
||
✔ a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens (2238.2249ms)
|
||
✔ real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage (3912.5031ms)
|
||
✔ Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair (3332.6811ms)
|
||
✔ incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools (2187.7844ms)
|
||
✔ stopping an active HTTP stream closes only original request and keeps partial text without executing tools (2097.4713ms)
|
||
✔ explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt (1045.8503ms)
|
||
✔ coalesced initial SSE events publish the latest partial state even when the upstream stays idle (1463.6045ms)
|
||
✔ stream timeout closes the original HTTP response, preserves redacted capture and never retries (864.4765ms)
|
||
✔ stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over (999.8465ms)
|
||
✔ SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch (0.8034ms)
|
||
▶ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
|
||
✔ reject 0 (0.2359ms)
|
||
✔ reject 1 (0.1577ms)
|
||
✔ reject 2 (0.1405ms)
|
||
✔ reject 3 (5.1929ms)
|
||
✔ reject 4 (0.3284ms)
|
||
✔ reject 5 (0.1975ms)
|
||
✔ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data (6.7618ms)
|
||
✔ compiled host retains interrupted HTTP 200 and explicitly resumes after the recorded cooldown (8752.526ms)
|
||
✔ compiled host retains interrupted HTTP 503 and explicitly resumes after the recorded cooldown (9281.6574ms)
|
||
✔ owned IPv4 service works after a failed IPv6 candidate without a second model POST or global DNS change (25.684ms)
|
||
✔ environment HTTP proxy tunnels the owned request and NO_PROXY sends a separate direct request (10.6211ms)
|
||
✔ original connect timeout has a bounded nested cause and does not masquerade as response generation timeout (0.7106ms)
|
||
✔ POST accepted then reset is unknown, is charged once and never automatically retried (4.0045ms)
|
||
✔ partial HTTP bodies retain original request id and bytes, and an unknown pool attempt never switches model (2414.8937ms)
|
||
✔ response wait timeout after an accepted POST is unknown; cancellation closes the owned socket and permits explicit reuse (148.1235ms)
|
||
✔ hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing (1405.9648ms)
|
||
✔ failed adoption restores the original virtual data-root name and original open database (811.6903ms)
|
||
✔ hot upgrade refreshes retained model and importer methods while preserving credential and routing objects (915.3991ms)
|
||
✔ hot upgrade refuses active probes and restores retained model methods if installation fails (881.921ms)
|
||
ℹ tests 144
|
||
ℹ suites 0
|
||
ℹ pass 144
|
||
ℹ fail 0
|
||
ℹ cancelled 0
|
||
ℹ skipped 0
|
||
ℹ todo 0
|
||
ℹ duration_ms 115256.5562
|