Files
Agent-Workbench/docs/embedded-browser-rejected-candidate-evidence/source/tests-07.tap
T

429 lines
18 KiB
Plaintext

TAP version 13
# Subtest: cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
ok 1 - cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
---
duration_ms: 2162.5083
type: 'test'
...
# Subtest: cache enablement and derived reuse survive a real host restart without becoming task recovery state
ok 2 - cache enablement and derived reuse survive a real host restart without becoming task recovery state
---
duration_ms: 4126.564
type: 'test'
...
# Subtest: persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
ok 3 - persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
---
duration_ms: 783.9527
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'main.ts', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'value.ts', LF will be replaced by CRLF the next time Git touches it
# Subtest: same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
ok 4 - same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
---
duration_ms: 801.0321
type: 'test'
...
# Switched to a new branch 'other'
# Subtest: branch and commit changes invalidate even byte-identical sources
ok 5 - branch and commit changes invalidate even byte-identical sources
---
duration_ms: 2457.4718
type: 'test'
...
# Subtest: corrupt, malformed and schema-invalid records fall back to fresh parsing
ok 6 - corrupt, malformed and schema-invalid records fall back to fresh parsing
---
duration_ms: 816.1401
type: 'test'
...
# Subtest: disable and clear persist without touching sources, sessions, configuration or original artifacts
ok 7 - disable and clear persist without touching sources, sessions, configuration or original artifacts
---
duration_ms: 595.0717
type: 'test'
...
# Subtest: cache capacity bounds disk and memory by bytes and LRU project count
ok 8 - cache capacity bounds disk and memory by bytes and LRU project count
---
duration_ms: 712.8027
type: 'test'
...
# Subtest: incomplete scans do not load or save cached entries; unavailable files leave the current result scope
ok 9 - incomplete scans do not load or save cached entries; unavailable files leave the current result scope
---
duration_ms: 885.1157
type: 'test'
...
# Subtest: project and cache junctions cannot expose or delete an outside directory
ok 10 - project and cache junctions cannot expose or delete an outside directory
---
duration_ms: 955.7198
type: 'test'
...
# Subtest: concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
ok 11 - concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
---
duration_ms: 894.6766
type: 'test'
...
# Subtest: file access mode changes invalidate parsed material even when bytes are unchanged
ok 12 - file access mode changes invalidate parsed material even when bytes are unchanged
---
duration_ms: 800.4585
type: 'test'
...
# Subtest: tracked directory replaced by a junction invalidates access scope and never uses its old cache
ok 13 - tracked directory replaced by a junction invalidates access scope and never uses its old cache
---
duration_ms: 2237.4575
type: 'test'
...
# Subtest: JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
ok 14 - JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
---
duration_ms: 784.7135
type: 'test'
...
# Subtest: default expressions, named default exports and declared functions retain their AST evidence
ok 15 - default expressions, named default exports and declared functions retain their AST evidence
---
duration_ms: 923.6536
type: 'test'
...
# Subtest: incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
ok 16 - incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
---
duration_ms: 1108.2717
type: 'test'
...
# Subtest: Python candidates exclude comments and multiline strings and declare limited evidence
ok 17 - Python candidates exclude comments and multiline strings and declare limited evidence
---
duration_ms: 813.6549
type: 'test'
...
# Subtest: indexes isolate project identity and root and evict bounded caches without sharing results
ok 18 - indexes isolate project identity and root and evict bounded caches without sharing results
---
duration_ms: 941.305
type: 'test'
...
# Subtest: Git ignore, credential paths and links stay outside the index and no project files are executed
ok 19 - Git ignore, credential paths and links stay outside the index and no project files are executed
---
duration_ms: 1502.5014
type: 'test'
...
# Subtest: malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
ok 20 - malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
---
duration_ms: 845.0756
type: 'test'
...
# Subtest: index query rejects invalid limits/types and does not imply reference or alias resolution
ok 21 - index query rejects invalid limits/types and does not imply reference or alias resolution
---
duration_ms: 666.3049
type: 'test'
...
# Subtest: read-only engineering inspection disables configured Git clean filters and preserves index bytes
ok 22 - read-only engineering inspection disables configured Git clean filters and preserves index bytes
---
duration_ms: 2069.1779
type: 'test'
...
# Subtest: Python multiline declarations retain candidate scope without interpreting expressions as declarations
ok 23 - Python multiline declarations retain candidate scope without interpreting expressions as declarations
---
duration_ms: 671.0952
type: 'test'
...
# Subtest: TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
ok 24 - TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
---
duration_ms: 967.5468
type: 'test'
...
# Subtest: actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
ok 25 - actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
---
duration_ms: 2209.5794
type: 'test'
...
# Subtest: actual HTTP request excludes archived, timed-out and foreign-project memories
ok 26 - actual HTTP request excludes archived, timed-out and foreign-project memories
---
duration_ms: 2687.1884
type: 'test'
...
# Subtest: actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
ok 27 - actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
---
duration_ms: 2963.6431
type: 'test'
...
# Subtest: incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
ok 28 - incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
---
duration_ms: 2796.5641
type: 'test'
...
# Subtest: corrupt original artifact expires its memory and cannot reach an HTTP model request
ok 29 - corrupt original artifact expires its memory and cannot reach an HTTP model request
---
duration_ms: 1846.3726
type: 'test'
...
# Subtest: memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
ok 30 - memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
---
duration_ms: 3417.5351
type: 'test'
...
# Subtest: optional memory yields to the complete goal and original code evidence under the whole-request budget
ok 31 - optional memory yields to the complete goal and original code evidence under the whole-request budget
---
duration_ms: 935.4735
type: 'test'
...
# Subtest: changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
ok 32 - changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
---
duration_ms: 1717.0603
type: 'test'
...
# Subtest: a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
ok 33 - a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
---
duration_ms: 1623.0888
type: 'test'
...
# Subtest: an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
ok 34 - an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
---
duration_ms: 1047.0378
type: 'test'
...
# Subtest: project memories persist across restart, keep source provenance, and are visible across tasks
ok 35 - project memories persist across restart, keep source provenance, and are visible across tasks
---
duration_ms: 1046.8056
type: 'test'
...
# Subtest: source changes expire current project memories and keep the original evidence
ok 36 - source changes expire current project memories and keep the original evidence
---
duration_ms: 940.3467
type: 'test'
...
# Subtest: incomplete source scans mark current memories unverified without expiring or reusing them
ok 37 - incomplete source scans mark current memories unverified without expiring or reusing them
---
duration_ms: 1025.8109
type: 'test'
...
# Subtest: explicit file provenance is rechecked even when the inventory excludes that path
ok 38 - explicit file provenance is rechecked even when the inventory excludes that path
---
duration_ms: 808.6435
type: 'test'
...
# Subtest: execution snapshots do not expose project memories before their source scope is validated
ok 39 - execution snapshots do not expose project memories before their source scope is validated
---
duration_ms: 886.1165
type: 'test'
...
# Subtest: project memory records stay isolated and archive requires the owning session
ok 40 - project memory records stay isolated and archive requires the owning session
---
duration_ms: 988.3317
type: 'test'
...
# Subtest: project memory HTTP API exposes read-only source status and explicit writes
ok 41 - project memory HTTP API exposes read-only source status and explicit writes
---
duration_ms: 2406.4616
type: 'test'
...
# Subtest: two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
ok 42 - two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
---
duration_ms: 614.8631
type: 'test'
...
# Subtest: incomplete, unsupported, relative and oversized sources cannot enable the experiment
ok 43 - incomplete, unsupported, relative and oversized sources cannot enable the experiment
---
duration_ms: 657.4323
type: 'test'
...
# Subtest: invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
ok 44 - invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
---
duration_ms: 2217.342
type: 'test'
...
# Subtest: source edits between detection and plan are rejected without creating a parent Task
ok 45 - source edits between detection and plan are rejected without creating a parent Task
---
duration_ms: 2018.606
type: 'test'
...
# Subtest: source edits after sealing cannot launch a child and do not reset its cumulative budget
ok 46 - source edits after sealing cannot launch a child and do not reset its cumulative budget
---
duration_ms: 11395.861
type: 'test'
...
# Subtest: literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
ok 47 - literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
---
duration_ms: 30776.2438
type: 'test'
...
# Subtest: source changes after a model response stop before any native tool is accepted, retaining the actual usage once
ok 48 - source changes after a model response stop before any native tool is accepted, retaining the actual usage once
---
duration_ms: 14180.1125
type: 'test'
...
# Subtest: source changes while approval is pending invalidate the old permission before an engineering check starts
ok 49 - source changes while approval is pending invalidate the old permission before an engineering check starts
---
duration_ms: 16284.9776
type: 'test'
...
# Subtest: altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
ok 50 - altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
---
duration_ms: 1871.8449
type: 'test'
...
# Subtest: the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
ok 51 - the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
---
duration_ms: 1660.0979
type: 'test'
...
# Subtest: a missing or duplicated experimental section in the actual input is rejected before any model dispatch
ok 52 - a missing or duplicated experimental section in the actual input is rejected before any model dispatch
---
duration_ms: 23902.3483
type: 'test'
...
# Subtest: experimental prompt overhead still participates in the original complete-input budget guard
ok 53 - experimental prompt overhead still participates in the original complete-input budget guard
---
duration_ms: 11455.9305
type: 'test'
...
# Subtest: source detection HTTP remains local-authenticated and read-only with no configured model requests
ok 54 - source detection HTTP remains local-authenticated and read-only with no configured model requests
---
duration_ms: 1497.8325
type: 'test'
...
# Subtest: Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
ok 55 - Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
---
duration_ms: 9966.5452
type: 'test'
...
# Subtest: an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
ok 56 - an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
---
duration_ms: 41399.2037
type: 'test'
...
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
ok 57 - Python static inspection does not import project code or probe a project interpreter before approval
---
duration_ms: 762.1404
type: 'test'
...
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
ok 58 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
---
duration_ms: 4518.2396
type: 'test'
...
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
ok 59 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
---
duration_ms: 3271.2175
type: 'test'
...
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
ok 60 - unittest empty, skipped, expected failure and class initialization errors never verify a task
---
duration_ms: 7121.6666
type: 'test'
...
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
ok 61 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
---
duration_ms: 2423.0915
type: 'test'
...
# Subtest: compilation reads actual Python source bytes without executing top-level project code
ok 62 - compilation reads actual Python source bytes without executing top-level project code
---
duration_ms: 2641.1189
type: 'test'
...
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
ok 63 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
---
duration_ms: 2530.6599
type: 'test'
...
# Subtest: changed project interpreters and forged Python plan bindings execute no check
ok 64 - changed project interpreters and forged Python plan bindings execute no check
---
duration_ms: 1423.57
type: 'test'
...
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
ok 65 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
---
duration_ms: 1301.6834
type: 'test'
...
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
ok 66 - stopping a real Python check terminates its child and keeps the completed result as cancelled
---
duration_ms: 2222.0441
type: 'test'
...
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
ok 67 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
---
duration_ms: 14139.9444
type: 'test'
...
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
ok 68 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
---
duration_ms: 7653.9974
type: 'test'
...
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
ok 69 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
---
duration_ms: 2586.7489
type: 'test'
...
1..69
# tests 69
# suites 0
# pass 69
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 144732.6535