Files
Agent-Workbench/docs/network-q-evidence/logs/network-q-regression.log
T
2026-11-03 23:53:31 +08:00

80 lines
8.6 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
✔ model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart (1212.4998ms)
✔ config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts (935.6421ms)
✔ real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity (3944.0751ms)
✔ pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests (5221.7042ms)
✔ 401 blocks the credential revision; updating the key restores availability without leaking error echoes (1601.996ms)
✔ queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request (1049.5114ms)
✔ compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model (2340.8516ms)
✔ model registry disk failures restore routing, pool profiles and credential references without partial updates (528.304ms)
✔ model selection and saved configuration commit together and failures preserve the original mode and endpoint (569.9199ms)
✔ configuration imports roll back the entire batch and retain one usable preview after validation or commit failure (615.0078ms)
✔ identity distinguishes missing, invalid, mixed, exact and explicitly declared aliases without guessing (1.2109ms)
✔ chat-completions JSON rejects a different model before tool dispatch, retaining source and reported usage (2267.6142ms)
✔ chat-completions SSE rejects a different model before tool dispatch, retaining source and reported usage (1949.1466ms)
✔ responses JSON rejects a different model before tool dispatch, retaining source and reported usage (2032.6097ms)
✔ responses SSE rejects a different model before tool dispatch, retaining source and reported usage (2038.6688ms)
✔ record policy accepts missing identity but keeps it explicit, and strict declared mapping is frozen in the consumption (1.4629ms)
✔ mixed streamed identities cannot pass strict mode, and interrupted streams retain observed identifiers without authenticating them (1.2657ms)
✔ identity refusal never fails over to another pool member and raw response model cannot leak known credentials (1727.0246ms)
✔ strict refusal remains visible even when the same original response exhausts the budget (1675.2894ms)
✔ strict identity crosses the controlled engine bridge with its original source and zero tool dispatch (15584.904ms)
✔ frozen direct connection policy and delivery reports preserve response identity without filling historical gaps (2828.121ms)
✔ saved engine budgets verify all Chat/Responses route variants and reject a mismatched output allowance (572.0972ms)
✔ owned CC Switch SQLite imports the selected TOML Responses wire_api and leaves unknown clients untouched (719.0372ms)
✔ Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes (1846.5694ms)
✔ mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools (2215.2194ms)
▶ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
✔ Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" (1288.7645ms)
✔ Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal (1409.6191ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal (1804.0093ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte (1684.6094ms)
✔ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool (6187.8619ms)
▶ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay
✔ chat-completions (1838.8817ms)
✔ responses (2184.0373ms)
✔ invalid JSON in a nonstream Chat or Responses tool group prevents every tool and pool replay (4023.3854ms)
✔ wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint (0.3009ms)
✔ connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions (781.158ms)
✔ capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run (1976.6647ms)
✔ all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger (1466.125ms)
✔ explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes (932.7386ms)
✔ plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support (1084.2536ms)
✔ a disabled connection invalidates an in-flight probe even when toggle mutates its original registry object (913.635ms)
✔ selected connection owns the actual endpoint, credential, wire model and mismatch even when legacy is configured for GPT (3605.4767ms)
✔ budget-only API and demo/real selection preserve routes, reject injected endpoint fields and publish authoritative selection without keys (2641.5094ms)
✔ another session cannot change default model, mode or budgets while a request is active (4591.1286ms)
✔ owned IPv4 service works after a failed IPv6 candidate without a second model POST or global DNS change (25.3584ms)
✔ environment HTTP proxy tunnels the owned request and NO_PROXY sends a separate direct request (10.5611ms)
✔ original connect timeout has a bounded nested cause and does not masquerade as response generation timeout (0.808ms)
✔ POST accepted then reset is unknown, is charged once and never automatically retried (3.7444ms)
✔ partial HTTP bodies retain original request id and bytes, and an unknown pool attempt never switches model (2191.1393ms)
✔ response wait timeout after an accepted POST is unknown; cancellation closes the owned socket and permits explicit reuse (143.3542ms)
✔ older configurations receive bounded wait defaults without changing the original object (1.016ms)
✔ active stream survives sixty seconds; byte activity resets idle but cannot extend total deadline (0.7984ms)
✔ silent stream has its own accurate deadline; caller cancellation and cleanup preserve their cause (1.7826ms)
✔ waiting for headers is bounded independently of stream-idle time (0.2255ms)
✔ wait settings persist, pin new runs and leave model pool, credentials and old run snapshots intact (717.2764ms)
✔ plain endpoint checks only TCP, records family coverage and never reads model credentials or writes routing/health/attempts (1106.2369ms)
✔ local DNS failure is separate from TCP/TLS and arbitrary input, stale revision and TLS overrides are rejected (669.9139ms)
✔ refused TCP socket preserves its stage and cannot masquerade as a TLS or API response (808.4455ms)
✔ TLS validation succeeds for a trusted owned certificate and rejects the same untrusted certificate (1722.0253ms)
✔ a TCP peer that never answers TLS is bounded, and cancellation waits for owned sockets to close (1372.0119ms)
✔ a stalled lookup is cancellable and the overall deadline bounds DNS without late socket work (820.0204ms)
✔ dual-stack fallback and explicit family results remain separate and never change global DNS defaults (1135.8582ms)
✔ proxy settings are reported as scope only; diagnostics do not contact the proxy or leak its credentials (1237.3817ms)
✔ history is bounded, survives reopening, marks interrupted work and reports changed revisions without rewriting frozen targets (1135.7222ms)
✔ HTTP API, host activity, configuration edits, model start and upgrade honor the same active diagnostic and stop operation (940.1191ms)
✔ provider shutdown cancels diagnostics and permits explicit reuse after a failed host stop (967.7105ms)
✔ hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing (1442.1466ms)
✔ failed adoption restores the original virtual data-root name and original open database (784.9474ms)
✔ hot upgrade refreshes retained model and importer methods while preserving credential and routing objects (808.5393ms)
✔ hot upgrade refuses active probes and restores retained model methods if installation fails (763.7999ms)
ℹ tests 69
ℹ suites 0
ℹ pass 69
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 52605.6788