Files
Agent-Workbench/docs/reliability-1.25.2-evidence/development/read-throughput.tap
T

166 lines
19 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
✔ unchanged proposals cannot hide repeated original-log reads or identical session inspections (7524.9346ms)
✔ reusing a verified proof never resets identical-state detection or creates a new proof (5825.1227ms)
✔ coverage merges adjacent pages, separates changed sources and never claims old Run coverage in a continuation (1.0118ms)
✔ a mixed turn with new bytes and three repeated modules advances, while repeat-only and independent no-op guards still pause (1.0325ms)
✔ runtime sends the next real HTTP request after a W-shaped mixed-progress turn instead of stopping on its trailing repeats (6189.0538ms)
✔ continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause (1.3052ms)
✔ a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget (0.3914ms)
✔ budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters (8.6978ms)
✔ known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress (0.3633ms)
✖ actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools (6254.7991ms)
✔ a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly (7772.2398ms)
✔ actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay (8372.4262ms)
✔ continuations distinguish unread source, later original line ranges and already returned result wrappers (652.6425ms)
✔ pure-file batch returns unused small-page space while mixed and historical allocation stays conservative (0.38ms)
✔ v3 pools mixed file/log reads, serves small sources first and leaves historical/mutating batches unchanged (0.2891ms)
✔ v3 W-shaped mixed reading returns complete small modules and substantially larger first test pages in the next bounded request (4865.3042ms)
✔ observed upstream high input pauses before a new request, preserves reported usage and distinguishes the limiting ledger (753.51ms)
✖ chat-completions: complete actual Unicode/CRLF pages and small source survive the next bounded wire request (4079.4203ms)
✖ responses: complete actual Unicode/CRLF pages and small source survive the next bounded wire request (4067.0213ms)
✖ anthropic-messages: complete actual Unicode/CRLF pages and small source survive the next bounded wire request (5666.2108ms)
✔ all actually returned same-version fragments reach the bounded request, including overlap and Unicode, with independent original provenance (7072.8705ms)
✔ unread gaps and different range origins remain separate; partial sending names the precise missing already-observed range (1292.5662ms)
✔ same-SHA conflicting overlaps and invalid coordinates fail closed, while a new SHA never inherits old fragments (2313.2389ms)
✔ versioned old views keep the original single-page semantics and verification (1082.6003ms)
✔ small code and actual failed command stay visible when their original multi-tool group cannot fit (1247.0403ms)
✔ mixed group retains six distinct small file observations with exact multilingual text and bounded request bytes (1764.5619ms)
✔ working observations are bound to the current Task and stop treating a pre-application file revision as current evidence (1972.4217ms)
✔ a sealed observation rejects changed or missing original result artifacts instead of recreating evidence (1353.1856ms)
✔ a real passed-check observation is excluded after a source edit invalidates the check, while its historical sent evidence remains valid (4770.5144ms)
✔ budgeted file pages reconstruct UTF-8 text including long single lines and surrogate boundaries (4.5482ms)
✔ actual HTTP multi-tool reads survive an oversized runtime snapshot and the sealed evidence survives reopening (8714.2881ms)
✔ actual HTTP file pagination advances over a long file with each returned page visible in the next request (6786.2512ms)
✖ later mixed history pages cannot displace the actual module sources and complete requirements (5345.4434ms)
✔ a later narrow page of the same file revision cannot evict the wider actual observation (3130.1466ms)
✔ six small source files stay complete across metadata turns even when mandatory evidence exceeds the soft target (3292.4164ms)
✔ historical read-artifact navigation points to the original artifact and next page, never its result wrapper (1214.947ms)
✔ a 1.6.1 full-provenance sent view remains verifiable after introducing the compact view (1181.4466ms)
✔ actual HTTP requests keep four observed modules after a later large history read and preserve all source bytes (9991.9037ms)
ℹ tests 38
ℹ suites 0
ℹ pass 33
ℹ fail 5
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 91511.5469
✖ failing tests:
test at tests\read-budget.test.mjs:124:1
✖ actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools (6254.7991ms)
AssertionError [ERR_ASSERTION]: {"failure":{"id":"ae4aef18-d806-442b-a982-35aa55c997b8","source":"model_connection","origin":"upstream","stage":"model_request","kind":"service","httpStatus":500,"endpoint":"http://127.0.0.1:62670/v1","model":"page-budget-fixture","route":"/chat/completions","attempts":3,"occurredAt":"2026-11-04T11:48:50.926Z","retryable":true,"title":"模型服务暂时无法处理请求","upstream":{"schema":1,"scope":"http-body","httpStatus":500,"code":null,"type":null,"message":"Newest actual result must be sent, not archived before the model sees it","param":null,"reason":null,"requestId":null,"responseId":null,"eventType":null,"headers":{"content-type":"application/json","date":"Wed, 04 Nov 2026 11:48:50 GMT"},"retryAfter":null,"retryAfterMs":null,"rawPreview":"{\"error\":{\"message\":\"Newest actual result must be sent, not archived before the model sees it\"}}","previewTruncated":false,"capture":{"scope":"http-body","receivedBytes":96,"capturedBytes":96,"storedBytes":96,"retention":"artifact","complete":true,"truncated":false,"interrupted":false,"capturedRange":[0,96],"redacted":false,"sha256":"bc1dd20cfb838626ba925ecf33e0b0ee15648ee4b11c588226aac3517a6f7a2d"},"artifactId":"21a9686b-9b42-4890-8a19-308183346b61","artifactSha256":"bc1dd20cfb838626ba925ecf33e0b0ee15648ee4b11c588226aac3517a6f7a2d","artifactScope":"http-body","sessionId":"58598cc2-383d-41e8-b61c-48ed661601fb"},"upstreamRequestId":null,"code":null,"type":null,"limitReason":null,"wireAttemptId":"215d9199-eef9-4d5f-89de-424178289936","message":"模型服务暂时无法处理请求(HTTP 500)。 Newest actual result must be sent, not archived before the model sees it","detail":"Newest actual result must be sent, not archived before the model sees it","suggestion":"稍后重试,或检查模型服务状态。","requestUrl":"http://127.0.0.1:62670/v1/chat/completions","responseUrl":"http://127.0.0.1:62670/v1/chat/completions","redirected":false,"redirectMode":"manual","retryDecision":"attempt_limit","remainingWaitBudgetMs":296918,"projectId":"60f67989-d84a-4471-b692-8158e93a9c67","sessionId":"58598cc2-383d-41e8-b61c-48ed661601fb","taskId":"c04a8fcf-3c7d-48b0-baf3-3fbfba441da7","runId":"2da0566f-edcc-413b-9a8f-282ad8c834e1","messageId":"0b4a8b8f-fb92-47b2-80df-0784705a5d88"},"requests":4,"pages":[]}
+ actual - expected
+ 'failed'
- 'completed'
at TestContext.<anonymous> (file:///D:/Ai-project/REA%E9%80%86%E5%90%91/Agent-Workbench/tests/read-budget.test.mjs:145:10)
at runNextTicks (node:internal/process/task_queues:65:5)
at process.processTimers (node:internal/timers:615:9)
at async Test.run (node:internal/test_runner/test:1409:7)
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: 'failed',
expected: 'completed',
operator: 'strictEqual',
diff: 'simple'
}
test at tests\reading-reliability.test.mjs:118:3
✖ chat-completions: complete actual Unicode/CRLF pages and small source survive the next bounded wire request (4079.4203ms)
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
3 !== 2
at TestContext.<anonymous> (file:///D:/Ai-project/REA%E9%80%86%E5%90%91/Agent-Workbench/tests/reading-reliability.test.mjs:154:14)
at runNextTicks (node:internal/process/task_queues:65:5)
at process.processTimers (node:internal/timers:615:9)
at async Test.run (node:internal/test_runner/test:1409:7)
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 3,
expected: 2,
operator: 'strictEqual',
diff: 'simple'
}
test at tests\reading-reliability.test.mjs:118:3
✖ responses: complete actual Unicode/CRLF pages and small source survive the next bounded wire request (4067.0213ms)
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
3 !== 2
at TestContext.<anonymous> (file:///D:/Ai-project/REA%E9%80%86%E5%90%91/Agent-Workbench/tests/reading-reliability.test.mjs:154:14)
at runNextTicks (node:internal/process/task_queues:65:5)
at process.processTimers (node:internal/timers:615:9)
at async Test.run (node:internal/test_runner/test:1409:7)
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 3,
expected: 2,
operator: 'strictEqual',
diff: 'simple'
}
test at tests\reading-reliability.test.mjs:118:3
✖ anthropic-messages: complete actual Unicode/CRLF pages and small source survive the next bounded wire request (5666.2108ms)
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
3 !== 2
at TestContext.<anonymous> (file:///D:/Ai-project/REA%E9%80%86%E5%90%91/Agent-Workbench/tests/reading-reliability.test.mjs:154:14)
at runNextTicks (node:internal/process/task_queues:65:5)
at process.processTimers (node:internal/timers:615:9)
at async Test.run (node:internal/test_runner/test:1409:7)
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 3,
expected: 2,
operator: 'strictEqual',
diff: 'simple'
}
test at tests\working-set.test.mjs:244:1
✖ later mixed history pages cannot displace the actual module sources and complete requirements (5345.4434ms)
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
+ actual - expected
... Skipped lines
'A sealed actual test assertion with Unicode 雪🙂.\n' +
'A sealed actual test assertion with Unicode 雪🙂.\n' +
'A sealed actual test assertion with Unicode 雪🙂.\n' +
'A sealed actual test assertion with Unicode 雪🙂.\n' +
'A sealed actual test assertion with Unicode 雪🙂.\n' +
...
'A sealed actual test assertion with Unicode 雪🙂.\n' +
+ 'A sealed actual test assertion with Unicode 雪🙂'
- 'A sealed actual test assertion with Unicode 雪🙂.\n' +
- 'A sealed actual test assertion with Unicode 雪🙂.\n' +
- 'A sealed actual test assertion with Unicode 雪🙂.\n' +
- 'A sealed actual test assertion with Unicode 雪🙂.\n' +
- 'A sealed actual test assertion with Unicode 雪🙂.\n' +
- 'A sealed actual test assertion with Unicode 雪🙂.\n' +
- 'A sealed actual test assertion with Unicode 雪🙂.\n' +
- 'A sealed actual test assertion with Unicode 雪🙂.\n'
at TestContext.<anonymous> (file:///D:/Ai-project/REA%E9%80%86%E5%90%91/Agent-Workbench/tests/working-set.test.mjs:266:12)
at Test.runInAsyncScope (node:async_hooks:227:14)
at Test.run (node:internal/test_runner/test:1402:25)
at Test.processPendingSubtests (node:internal/test_runner/test:974:18)
at Test.postRun (node:internal/test_runner/test:1542:19)
at Test.run (node:internal/test_runner/test:1467:12)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 'A sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂',
expected: 'A sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\nA sealed actual test assertion with Unicode 雪🙂.\n',
operator: 'strictEqual',
diff: 'simple'
}