Files
Agent-Workbench/docs/embedded-browser-c-rejected-candidate-evidence/source/tests-07.tap
T

429 lines
18 KiB
Plaintext

TAP version 13
# Subtest: cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
ok 1 - cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
---
duration_ms: 2216.2195
type: 'test'
...
# Subtest: cache enablement and derived reuse survive a real host restart without becoming task recovery state
ok 2 - cache enablement and derived reuse survive a real host restart without becoming task recovery state
---
duration_ms: 4006.8067
type: 'test'
...
# Subtest: persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
ok 3 - persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
---
duration_ms: 764.4752
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'main.ts', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'value.ts', LF will be replaced by CRLF the next time Git touches it
# Subtest: same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
ok 4 - same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
---
duration_ms: 659.2354
type: 'test'
...
# Switched to a new branch 'other'
# Subtest: branch and commit changes invalidate even byte-identical sources
ok 5 - branch and commit changes invalidate even byte-identical sources
---
duration_ms: 1990.3138
type: 'test'
...
# Subtest: corrupt, malformed and schema-invalid records fall back to fresh parsing
ok 6 - corrupt, malformed and schema-invalid records fall back to fresh parsing
---
duration_ms: 623.0969
type: 'test'
...
# Subtest: disable and clear persist without touching sources, sessions, configuration or original artifacts
ok 7 - disable and clear persist without touching sources, sessions, configuration or original artifacts
---
duration_ms: 651.5014
type: 'test'
...
# Subtest: cache capacity bounds disk and memory by bytes and LRU project count
ok 8 - cache capacity bounds disk and memory by bytes and LRU project count
---
duration_ms: 541.864
type: 'test'
...
# Subtest: incomplete scans do not load or save cached entries; unavailable files leave the current result scope
ok 9 - incomplete scans do not load or save cached entries; unavailable files leave the current result scope
---
duration_ms: 525.7419
type: 'test'
...
# Subtest: project and cache junctions cannot expose or delete an outside directory
ok 10 - project and cache junctions cannot expose or delete an outside directory
---
duration_ms: 758.597
type: 'test'
...
# Subtest: concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
ok 11 - concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
---
duration_ms: 911.2404
type: 'test'
...
# Subtest: file access mode changes invalidate parsed material even when bytes are unchanged
ok 12 - file access mode changes invalidate parsed material even when bytes are unchanged
---
duration_ms: 890.0473
type: 'test'
...
# Subtest: tracked directory replaced by a junction invalidates access scope and never uses its old cache
ok 13 - tracked directory replaced by a junction invalidates access scope and never uses its old cache
---
duration_ms: 2602.7499
type: 'test'
...
# Subtest: JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
ok 14 - JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
---
duration_ms: 746.5217
type: 'test'
...
# Subtest: default expressions, named default exports and declared functions retain their AST evidence
ok 15 - default expressions, named default exports and declared functions retain their AST evidence
---
duration_ms: 864.7296
type: 'test'
...
# Subtest: incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
ok 16 - incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
---
duration_ms: 1011.2166
type: 'test'
...
# Subtest: Python candidates exclude comments and multiline strings and declare limited evidence
ok 17 - Python candidates exclude comments and multiline strings and declare limited evidence
---
duration_ms: 732.4105
type: 'test'
...
# Subtest: indexes isolate project identity and root and evict bounded caches without sharing results
ok 18 - indexes isolate project identity and root and evict bounded caches without sharing results
---
duration_ms: 1193.5608
type: 'test'
...
# Subtest: Git ignore, credential paths and links stay outside the index and no project files are executed
ok 19 - Git ignore, credential paths and links stay outside the index and no project files are executed
---
duration_ms: 1467.1212
type: 'test'
...
# Subtest: malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
ok 20 - malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
---
duration_ms: 706.4957
type: 'test'
...
# Subtest: index query rejects invalid limits/types and does not imply reference or alias resolution
ok 21 - index query rejects invalid limits/types and does not imply reference or alias resolution
---
duration_ms: 763.7917
type: 'test'
...
# Subtest: read-only engineering inspection disables configured Git clean filters and preserves index bytes
ok 22 - read-only engineering inspection disables configured Git clean filters and preserves index bytes
---
duration_ms: 2389.8343
type: 'test'
...
# Subtest: Python multiline declarations retain candidate scope without interpreting expressions as declarations
ok 23 - Python multiline declarations retain candidate scope without interpreting expressions as declarations
---
duration_ms: 671.0478
type: 'test'
...
# Subtest: TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
ok 24 - TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
---
duration_ms: 718.9657
type: 'test'
...
# Subtest: actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
ok 25 - actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
---
duration_ms: 1882.9834
type: 'test'
...
# Subtest: actual HTTP request excludes archived, timed-out and foreign-project memories
ok 26 - actual HTTP request excludes archived, timed-out and foreign-project memories
---
duration_ms: 2514.6159
type: 'test'
...
# Subtest: actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
ok 27 - actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
---
duration_ms: 2662.4005
type: 'test'
...
# Subtest: incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
ok 28 - incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
---
duration_ms: 2449.5417
type: 'test'
...
# Subtest: corrupt original artifact expires its memory and cannot reach an HTTP model request
ok 29 - corrupt original artifact expires its memory and cannot reach an HTTP model request
---
duration_ms: 1880.0086
type: 'test'
...
# Subtest: memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
ok 30 - memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
---
duration_ms: 2562.6423
type: 'test'
...
# Subtest: optional memory yields to the complete goal and original code evidence under the whole-request budget
ok 31 - optional memory yields to the complete goal and original code evidence under the whole-request budget
---
duration_ms: 883.6204
type: 'test'
...
# Subtest: changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
ok 32 - changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
---
duration_ms: 1882.8626
type: 'test'
...
# Subtest: a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
ok 33 - a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
---
duration_ms: 1760.301
type: 'test'
...
# Subtest: an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
ok 34 - an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
---
duration_ms: 960.8277
type: 'test'
...
# Subtest: project memories persist across restart, keep source provenance, and are visible across tasks
ok 35 - project memories persist across restart, keep source provenance, and are visible across tasks
---
duration_ms: 1098.0291
type: 'test'
...
# Subtest: source changes expire current project memories and keep the original evidence
ok 36 - source changes expire current project memories and keep the original evidence
---
duration_ms: 951.8562
type: 'test'
...
# Subtest: incomplete source scans mark current memories unverified without expiring or reusing them
ok 37 - incomplete source scans mark current memories unverified without expiring or reusing them
---
duration_ms: 976.5763
type: 'test'
...
# Subtest: explicit file provenance is rechecked even when the inventory excludes that path
ok 38 - explicit file provenance is rechecked even when the inventory excludes that path
---
duration_ms: 965.1708
type: 'test'
...
# Subtest: execution snapshots do not expose project memories before their source scope is validated
ok 39 - execution snapshots do not expose project memories before their source scope is validated
---
duration_ms: 783.7698
type: 'test'
...
# Subtest: project memory records stay isolated and archive requires the owning session
ok 40 - project memory records stay isolated and archive requires the owning session
---
duration_ms: 1024.0775
type: 'test'
...
# Subtest: project memory HTTP API exposes read-only source status and explicit writes
ok 41 - project memory HTTP API exposes read-only source status and explicit writes
---
duration_ms: 2413.3824
type: 'test'
...
# Subtest: two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
ok 42 - two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
---
duration_ms: 776.2628
type: 'test'
...
# Subtest: incomplete, unsupported, relative and oversized sources cannot enable the experiment
ok 43 - incomplete, unsupported, relative and oversized sources cannot enable the experiment
---
duration_ms: 683.0708
type: 'test'
...
# Subtest: invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
ok 44 - invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
---
duration_ms: 2381.5158
type: 'test'
...
# Subtest: source edits between detection and plan are rejected without creating a parent Task
ok 45 - source edits between detection and plan are rejected without creating a parent Task
---
duration_ms: 1902.67
type: 'test'
...
# Subtest: source edits after sealing cannot launch a child and do not reset its cumulative budget
ok 46 - source edits after sealing cannot launch a child and do not reset its cumulative budget
---
duration_ms: 12082.3659
type: 'test'
...
# Subtest: literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
ok 47 - literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
---
duration_ms: 33809.4047
type: 'test'
...
# Subtest: source changes after a model response stop before any native tool is accepted, retaining the actual usage once
ok 48 - source changes after a model response stop before any native tool is accepted, retaining the actual usage once
---
duration_ms: 13517.039
type: 'test'
...
# Subtest: source changes while approval is pending invalidate the old permission before an engineering check starts
ok 49 - source changes while approval is pending invalidate the old permission before an engineering check starts
---
duration_ms: 17598.3398
type: 'test'
...
# Subtest: altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
ok 50 - altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
---
duration_ms: 1910.7223
type: 'test'
...
# Subtest: the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
ok 51 - the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
---
duration_ms: 1790.9481
type: 'test'
...
# Subtest: a missing or duplicated experimental section in the actual input is rejected before any model dispatch
ok 52 - a missing or duplicated experimental section in the actual input is rejected before any model dispatch
---
duration_ms: 23624.3076
type: 'test'
...
# Subtest: experimental prompt overhead still participates in the original complete-input budget guard
ok 53 - experimental prompt overhead still participates in the original complete-input budget guard
---
duration_ms: 11408.3302
type: 'test'
...
# Subtest: source detection HTTP remains local-authenticated and read-only with no configured model requests
ok 54 - source detection HTTP remains local-authenticated and read-only with no configured model requests
---
duration_ms: 1519.2641
type: 'test'
...
# Subtest: Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
ok 55 - Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
---
duration_ms: 10100.9924
type: 'test'
...
# Subtest: an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
ok 56 - an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
---
duration_ms: 41228.3793
type: 'test'
...
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
ok 57 - Python static inspection does not import project code or probe a project interpreter before approval
---
duration_ms: 1038.9528
type: 'test'
...
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
ok 58 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
---
duration_ms: 4466.1736
type: 'test'
...
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
ok 59 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
---
duration_ms: 2677.3498
type: 'test'
...
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
ok 60 - unittest empty, skipped, expected failure and class initialization errors never verify a task
---
duration_ms: 7020.0159
type: 'test'
...
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
ok 61 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
---
duration_ms: 2950.2153
type: 'test'
...
# Subtest: compilation reads actual Python source bytes without executing top-level project code
ok 62 - compilation reads actual Python source bytes without executing top-level project code
---
duration_ms: 3115.6642
type: 'test'
...
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
ok 63 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
---
duration_ms: 2400.6503
type: 'test'
...
# Subtest: changed project interpreters and forged Python plan bindings execute no check
ok 64 - changed project interpreters and forged Python plan bindings execute no check
---
duration_ms: 1306.9328
type: 'test'
...
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
ok 65 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
---
duration_ms: 978.9113
type: 'test'
...
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
ok 66 - stopping a real Python check terminates its child and keeps the completed result as cancelled
---
duration_ms: 1885.0225
type: 'test'
...
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
ok 67 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
---
duration_ms: 14162.6352
type: 'test'
...
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
ok 68 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
---
duration_ms: 7908.722
type: 'test'
...
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
ok 69 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
---
duration_ms: 2630.9486
type: 'test'
...
1..69
# tests 69
# suites 0
# pass 69
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 149220.2699