Files
Agent-Workbench/docs/model-protocols-current-specialists.txt

53 lines
5.1 KiB
Plaintext
Raw Permalink Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
✔ schema1 connections remain readable without inventing observed capabilities or migrating original state (892.4845ms)
✔ protocol, unsupported capabilities and stream choice persist; client claims cannot forge verified evidence (966.5389ms)
✔ ability evidence belongs to exact connection and credential revision; unknown and unsupported reject required routing (0.3516ms)
✔ invalid declarations and inconsistent stream settings reject before registry, revision and credentials mutate (681.927ms)
✔ model registry keeps original credentials/endpoint intact, rejects stale edits, and forgets only volatile keys on restart (1259.4085ms)
✔ config import previews exact revisions, keeps secrets volatile, syncs only when enabled and preserves manual edits on conflicts (996.4614ms)
✔ real HTTP pool fails over 429 to another model and never repeats completed tools; attempts seal actual request bytes and Run identity (4172.9802ms)
✔ pool rotation and weights select members on new Runs; disabled and missing credentials are excluded without requests (5369.0176ms)
✔ 401 blocks the credential revision; updating the key restores availability without leaking error echoes (2136.1904ms)
✔ queued request cancellation and in-flight disable release only owned leases and do not dispatch another HTTP request (1285.1659ms)
✔ compiled model-center HTTP API persists public profiles, blocks forged origins, and local operations never invoke a model (2522.6777ms)
✔ model registry disk failures restore routing, pool profiles and credential references without partial updates (1125.4403ms)
✔ model selection and saved configuration commit together and failures preserve the original mode and endpoint (1857.4609ms)
✔ configuration imports roll back the entire batch and retain one usable preview after validation or commit failure (874.6812ms)
✔ Responses executes one original tool through Runtime, carries encrypted Items, reports raw usage and seals exact wire bytes (3872.5619ms)
✔ mixed-protocol pool keeps both actual variants and changes route on 429 without re-executing completed tools (3712.8468ms)
▶ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool
✔ Reject {"body":{"id":"resp_owned","status":"incomplete","output":[{"type":"function_call","id":"fc_partial" (2077.5477ms)
✔ Reject {"body":{"id":"resp_owned","status":"failed","output":[{"type":"function_call","id":"fc_failed","cal (2176.6625ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"function_call","id":"fc_bad","cal (2038.6461ms)
✔ Reject {"body":{"id":"resp_owned","status":"completed","output":[{"type":"computer_call","id":"not-supporte (1629.5944ms)
✔ Responses incomplete, failed, missing call identity and unsupported hosted outputs never dispatch a tool (7923.2614ms)
✔ wire adapter preserves tool IDs but never passes Responses-private Items to Chat or another endpoint (0.1597ms)
✔ connection JSON import accepts explicit Responses protocol and continues to reject unknown protocols without reading client sessions (982.9388ms)
✔ capability routing skips text-only members before acquiring a lease and records exact refusal in the original Run (3118.5909ms)
✔ all incompatible members reject with no network request, no lease, preserved Task and explicit non-dispatched ledger (1579.9588ms)
✔ explicit synthetic tool probe verifies only actual matching call, never executes it and loses verification on revision changes (997.4663ms)
✔ plain text probe cannot verify tools; wrong tool nonce and client supplied evidence cannot claim verified support (1226.9391ms)
✔ real Chat SSE carries UTF8 and split tool JSON; Runtime executes only after DONE, stores partial progress and original usage (4102.3699ms)
✔ Responses typed SSE validates original item identity, terminal data, raw usage and tool result pair (3736.7539ms)
✔ incomplete network stream retains unknown attempt and never automatically switches pool or dispatches fragment tools (2254.8904ms)
✔ stopping an active HTTP stream closes only original request and keeps partial text without executing tools (1331.031ms)
▶ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data
✔ reject 0 (0.6407ms)
✔ reject 1 (0.1739ms)
✔ reject 2 (0.2062ms)
✔ reject 3 (4.8471ms)
✔ reject 4 (0.1743ms)
✔ reject 5 (0.1468ms)
✔ stream parser rejects truncation, finish length, malformed JSON, duplicate sequence, changed final item and oversized data (6.8946ms)
✔ hot upgrade adopts a retained virtual data root without reopening SQLite or changing rows, Provider or routing (1591.9706ms)
✔ failed adoption restores the original virtual data-root name and original open database (834.5372ms)
✔ hot upgrade refreshes retained model and importer methods while preserving credential and routing objects (1088.6735ms)
✔ hot upgrade refuses active probes and restores retained model methods if installation fails (900.0117ms)
ℹ tests 42
ℹ suites 0
ℹ pass 42
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 33273.7612