Files
Agent-Workbench/docs/messages-m-evidence/development/final-related.log
T

157 lines
16 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
✔ Messages builds native system/tool history, bounds images, and seals a distinct mixed-pool variant (6.7516ms)
✔ Messages URL and native parameter contracts preserve other protocol paths and hard output budget (0.524ms)
✔ native usage includes both cache buckets once, retains raw and rejects invalid counters (0.1777ms)
✔ real HTTP Messages JSON executes one tool, retains opaque history, actual URL and cache accounting (3013.2609ms)
✔ real HTTP Messages SSE executes one tool, retains opaque history, actual URL and cache accounting (2190.1543ms)
✔ Messages api-key authentication is explicit; mismatched model remains blocked with original usage (5.1733ms)
✔ Messages bearer authentication is explicit; mismatched model remains blocked with original usage (4.0284ms)
✔ Messages redirect is not followed, either credential stays at the original server (3.9361ms)
✔ strict native SSE reads the nested start model and retains mismatch source without retries (3.4398ms)
✔ a closed native tool block cannot execute before message_stop, then executes exactly once (2543.4174ms)
✔ mixed Chat/Messages pool seals both variants and preserves one completed tool on failover (3149.3977ms)
✔ native JSON rejects incomplete stops, duplicate tools and hosted content (0.3491ms)
▶ strict SSE validates all blocks, terminal, event names, UTF8 and tool JSON before dispatch
✔ reject native stream 0 (1.1702ms)
✔ reject native stream 1 (0.2582ms)
✔ reject native stream 2 (0.2249ms)
✔ reject native stream 3 (0.2055ms)
✔ reject native stream 4 (0.1722ms)
✔ reject native stream 5 (0.2107ms)
✔ reject native stream 6 (0.1566ms)
✔ reject native stream 7 (0.1862ms)
✔ reject native stream 8 (0.3112ms)
✔ strict SSE validates all blocks, terminal, event names, UTF8 and tool JSON before dispatch (3.6467ms)
✔ upstream SSE error retains original type/request ID and initial usage, never retries (6.7765ms)
✔ stop cancels the owned stream and retains partial consumption without running tool or replaying (60.2562ms)
✔ saved Messages import preserves auth choice, rejects endpoint duplication, and keeps source file untouched (533.9392ms)
✔ a Windows virtual data-directory name binds new storage and credentials to its actual physical root (2038.9747ms)
✔ physical data-root adoption still rejects explicit junctions at the directory or any ancestor (668.77ms)
✔ actual Windows CurrentUser DPAPI roundtrips owned UTF-8 and rejects damaged bytes and wrong entropy (1500.2543ms)
✔ only explicitly supplied keys persist; new provider restores original revisions and public views contain no key (2398.5932ms)
✔ registry and cipher commit failure restores original routing, keys, block and every database row (1696.1901ms)
✔ a two-key import with a protection failure rolls back all registry and cipher entries and retains its preview (1964.8414ms)
✔ connection revision changes retain the original saved block and report a source mismatch on restart (2246.5277ms)
✔ disable skips real restart loading, explicit enable restores, delete preserves memory and forget removes both (2828.5029ms)
✔ corrupt saved block and another SID do not load; failures are visible without returning ciphertext or plaintext (2543.9984ms)
✔ legacy persistence requires a new explicit key and binds config and credential revisions; stale requests cannot save (2579.6184ms)
✔ owned plaintext keys never reach SQLite pages, WAL, config or public execution exports (1401.7126ms)
✔ schema1 connections remain readable without inventing observed capabilities or migrating original state (562.0547ms)
✔ protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence (955.8479ms)
✔ ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing (0.2814ms)
✔ invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate (500.5654ms)
✔ model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart (838.9311ms)
✔ config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts (912.9089ms)
✔ real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity (2941.1691ms)
✔ pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests (3703.9223ms)
✔ 401 blocks the credential revision; updating the key restores availability without leaking error echoes (1884.1572ms)
✔ queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request (1058.8129ms)
✔ compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model (2194.2978ms)
✔ model registry disk failures restore routing, pool profiles and credential references without partial updates (778.8009ms)
✔ model selection and saved configuration commit together and failures preserve the original mode and endpoint (924.2998ms)
✔ configuration imports roll back the entire batch and retain one usable preview after validation or commit failure (729.3175ms)
✔ HTTP quota retains native code/type/param/request id, bounded original and allowlisted headers, never repeats that connection (2046.2917ms)
✔ Retry-After above 90 seconds remains exact and a short local budget cannot trigger an early retry (1.8063ms)
✔ Retry-After date, expired date, huge value and invalid header retain explicit semantics (1.1943ms)
✔ unclassified 429 remains unspecified and every bounded actual retry retains its own original error (2049.0124ms)
✔ oversized HTTP error saves exactly the bounded prefix and labels its incomplete range (2072.3122ms)
✔ Chat SSE error preserves upstream fields, original failed event, partial tool and reported usage without executing or retrying (2192.2207ms)
✔ Responses failed SSE retains original event/response identity and usage (1856.3933ms)
✔ Responses incomplete SSE retains original event/response identity and usage (1965.2924ms)
✔ unsupported successful Responses output retains original JSON and usage with a local protocol origin (2218.8801ms)
✔ HTTP 200 native error is still an upstream failure rather than a fabricated successful answer (1.4139ms)
✔ JSON-escaped credential echoes are redacted in the original preview and capture as well as parsed fields (0.917ms)
✔ quota failover uses another independent pool member and never replays a failed stream (2913.9022ms)
✔ native parameters are isolated by pool member, preserve Responses state and bind the original output reservation (0.6217ms)
✔ unsupported native fields and invalid values reject before dispatch instead of silently dropping or overriding constraints (0.795ms)
✔ native settings for legacy and registered profiles persist without changing credentials or old records and reject stale edits (1044.1796ms)
✔ compiled native settings API saves/restores exact parameters and rejects reserved fields without mutating the profile (2529.4652ms)
✔ legacy connection test sends its saved native fields and selected output limit field without changing the configuration (2151.2787ms)
✔ identity distinguishes missing, invalid, mixed, exact and explicitly declared aliases without guessing (1.3064ms)
✔ chat-completions JSON rejects a different model before tool dispatch, retaining source and reported usage (1988.3643ms)
✔ chat-completions SSE rejects a different model before tool dispatch, retaining source and reported usage (1999.8304ms)
✔ responses JSON rejects a different model before tool dispatch, retaining source and reported usage (2363.2123ms)
✔ responses SSE rejects a different model before tool dispatch, retaining source and reported usage (2234.5137ms)
✔ record policy accepts missing identity but keeps it explicit, and strict declared mapping is frozen in the consumption (2.6047ms)
✔ mixed streamed identities cannot pass strict mode, and interrupted streams retain observed identifiers without authenticating them (1.4246ms)
✔ identity refusal never fails over to another pool member and raw response model cannot leak known credentials (2214.1019ms)
✔ strict refusal remains visible even when the same original response exhausts the budget (1284.4646ms)
✔ strict identity crosses the controlled engine bridge with its original source and zero tool dispatch (12058.5436ms)
✔ frozen direct connection policy and delivery reports preserve response identity without filling historical gaps (2538.228ms)
✔ saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance (718.3841ms)
✔ owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched (895.1361ms)
✔ Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes (2086.0016ms)
✔ mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools (2687.1053ms)
▶ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
✔ Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" (1713.742ms)
✔ Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal (1739.4353ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal (1618.842ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte (1903.8158ms)
✔ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool (6976.7273ms)
▶ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
✔ chat-completions (2636.4581ms)
✔ responses (2974.6155ms)
✔ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay (5611.4804ms)
✔ wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint (0.2337ms)
✔ connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions (1230.8034ms)
✔ reservation uses actual known usage from the same route, never lowers estimates or rewrites original receipts (1.6681ms)
✔ reservation verification binds original Task/Run consumption and rejects changed usage or foreign provenance (0.4715ms)
✔ known high input calibrates the next request and stops before dispatch while preserving the completed read (2433.1102ms)
✔ one reported overrun stops legacy requests and keeps actual use and excess (1983.3313ms)
✔ one reported overrun stops pool requests and keeps actual use and excess (2819.3236ms)
✔ one reported overrun stops connection requests and keeps actual use and excess (2492.4876ms)
✔ reported usage below the limit prevents an unaffordable legacy retry before another dispatch (1999.818ms)
✔ reported usage below the limit prevents an unaffordable pool retry before another dispatch (3188.8902ms)
✔ native bridge seals calibrated refusal with original consumption and preserves versioned request verification (14678.9961ms)
✔ capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run (2096.2784ms)
✔ all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger (1882.1025ms)
✔ explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes (1293.9178ms)
✔ plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support (1547.33ms)
✔ a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object (1062.8668ms)
✔ selected connection owns the actual endpoint, credential, wire model and mismatch even when legacy is configured for GPT (3918.3035ms)
✔ budget-only API and demo/real selection preserve routes, reject injected endpoint fields and publish authoritative selection without keys (2898.388ms)
✔ another session cannot change default model, mode or budgets while a request is active (3509.7689ms)
✔ HTTP download preserves original malformed SSE bytes and artifact SHA instead of decoding invalid UTF8 (2306.3075ms)
✔ terminated SSE adapts empty optional tool arguments, retains the exact wire bytes and executes the validated batch once (3213.0203ms)
✔ reported SSE usage survives rejected required arguments "" without dispatching any tool (1802.1044ms)
✔ reported SSE usage survives rejected required arguments "{\"path\":" without dispatching any tool (1939.8046ms)
✔ reported SSE usage survives rejected required arguments "null" without dispatching any tool (2021.5647ms)
✔ a stream without DONE retains reported usage but cannot adapt or execute even an optional tool (1415.2064ms)
✔ a timeout after reasoning-only fragments creates one unknown receipt and never invents reported tokens (2238.2249ms)
✔ real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage (3912.5031ms)
✔ Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair (3332.6811ms)
✔ incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools (2187.7844ms)
✔ stopping an active HTTP stream closes only original request and keeps partial text without executing tools (2097.4713ms)
✔ explicit streaming probe uses actual SSE despite unknown declaration and binds its own original attempt (1045.8503ms)
✔ coalesced initial SSE events publish the latest partial state even when the upstream stays idle (1463.6045ms)
✔ stream timeout closes the original HTTP response, preserves redacted capture and never retries (864.4765ms)
✔ stream idle timeout preserves incomplete tool arguments, records unknown use and never fails over (999.8465ms)
✔ SSE accepts CR-only final event boundaries and retains exact invalid UTF8 bytes without dispatch (0.8034ms)
▶ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
✔ reject 0 (0.2359ms)
✔ reject 1 (0.1577ms)
✔ reject 2 (0.1405ms)
✔ reject 3 (5.1929ms)
✔ reject 4 (0.3284ms)
✔ reject 5 (0.1975ms)
✔ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data (6.7618ms)
✔ compiled host retains interrupted HTTP 200 and explicitly resumes after the recorded cooldown (8752.526ms)
✔ compiled host retains interrupted HTTP 503 and explicitly resumes after the recorded cooldown (9281.6574ms)
✔ owned IPv4 service works after a failed IPv6 candidate without a second model POST or global DNS change (25.684ms)
✔ environment HTTP proxy tunnels the owned request and NO_PROXY sends a separate direct request (10.6211ms)
✔ original connect timeout has a bounded nested cause and does not masquerade as response generation timeout (0.7106ms)
✔ POST accepted then reset is unknown, is charged once and never automatically retried (4.0045ms)
✔ partial HTTP bodies retain original request id and bytes, and an unknown pool attempt never switches model (2414.8937ms)
✔ response wait timeout after an accepted POST is unknown; cancellation closes the owned socket and permits explicit reuse (148.1235ms)
✔ hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing (1405.9648ms)
✔ failed adoption restores the original virtual data-root name and original open database (811.6903ms)
✔ hot upgrade refreshes retained model and importer methods while preserving credential and routing objects (915.3991ms)
✔ hot upgrade refuses active probes and restores retained model methods if installation fails (881.921ms)
ℹ tests 144
ℹ suites 0
ℹ pass 144
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 115256.5562