Files
Agent-Workbench/docs/embedded-browser-b-rejected-candidate-evidence/source/tests-07.tap
T

429 lines
18 KiB
Plaintext

TAP version 13
# Subtest: cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
ok 1 - cache controls require desktop authority, exact inputs and owned project identity while preserving task evidence
---
duration_ms: 2346.891
type: 'test'
...
# Subtest: cache enablement and derived reuse survive a real host restart without becoming task recovery state
ok 2 - cache enablement and derived reuse survive a real host restart without becoming task recovery state
---
duration_ms: 4037.5506
type: 'test'
...
# Subtest: persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
ok 3 - persistent parsing is project/SHA/config bound and produces identical semantic indexes after restart
---
duration_ms: 924.3615
type: 'test'
...
# warning: in the working copy of 'README.md', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'main.ts', LF will be replaced by CRLF the next time Git touches it
# warning: in the working copy of 'value.ts', LF will be replaced by CRLF the next time Git touches it
# Subtest: same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
ok 4 - same-size restored-mtime changes, additions, renames and deletions cannot reuse stale entries or import targets
---
duration_ms: 663.7505
type: 'test'
...
# Switched to a new branch 'other'
# Subtest: branch and commit changes invalidate even byte-identical sources
ok 5 - branch and commit changes invalidate even byte-identical sources
---
duration_ms: 1998.4567
type: 'test'
...
# Subtest: corrupt, malformed and schema-invalid records fall back to fresh parsing
ok 6 - corrupt, malformed and schema-invalid records fall back to fresh parsing
---
duration_ms: 661.8763
type: 'test'
...
# Subtest: disable and clear persist without touching sources, sessions, configuration or original artifacts
ok 7 - disable and clear persist without touching sources, sessions, configuration or original artifacts
---
duration_ms: 680.4393
type: 'test'
...
# Subtest: cache capacity bounds disk and memory by bytes and LRU project count
ok 8 - cache capacity bounds disk and memory by bytes and LRU project count
---
duration_ms: 572.0046
type: 'test'
...
# Subtest: incomplete scans do not load or save cached entries; unavailable files leave the current result scope
ok 9 - incomplete scans do not load or save cached entries; unavailable files leave the current result scope
---
duration_ms: 552.9422
type: 'test'
...
# Subtest: project and cache junctions cannot expose or delete an outside directory
ok 10 - project and cache junctions cannot expose or delete an outside directory
---
duration_ms: 682.3338
type: 'test'
...
# Subtest: concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
ok 11 - concurrent file changes refuse a snapshot and clear during pending work cannot repopulate it
---
duration_ms: 789.7956
type: 'test'
...
# Subtest: file access mode changes invalidate parsed material even when bytes are unchanged
ok 12 - file access mode changes invalidate parsed material even when bytes are unchanged
---
duration_ms: 876.5406
type: 'test'
...
# Subtest: tracked directory replaced by a junction invalidates access scope and never uses its old cache
ok 13 - tracked directory replaced by a junction invalidates access scope and never uses its old cache
---
duration_ms: 2333.1137
type: 'test'
...
# Subtest: JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
ok 14 - JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
---
duration_ms: 922.8107
type: 'test'
...
# Subtest: default expressions, named default exports and declared functions retain their AST evidence
ok 15 - default expressions, named default exports and declared functions retain their AST evidence
---
duration_ms: 771.75
type: 'test'
...
# Subtest: incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
ok 16 - incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
---
duration_ms: 986.2183
type: 'test'
...
# Subtest: Python candidates exclude comments and multiline strings and declare limited evidence
ok 17 - Python candidates exclude comments and multiline strings and declare limited evidence
---
duration_ms: 710.9333
type: 'test'
...
# Subtest: indexes isolate project identity and root and evict bounded caches without sharing results
ok 18 - indexes isolate project identity and root and evict bounded caches without sharing results
---
duration_ms: 873.8426
type: 'test'
...
# Subtest: Git ignore, credential paths and links stay outside the index and no project files are executed
ok 19 - Git ignore, credential paths and links stay outside the index and no project files are executed
---
duration_ms: 1507.9335
type: 'test'
...
# Subtest: malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
ok 20 - malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
---
duration_ms: 691.159
type: 'test'
...
# Subtest: index query rejects invalid limits/types and does not imply reference or alias resolution
ok 21 - index query rejects invalid limits/types and does not imply reference or alias resolution
---
duration_ms: 730.7088
type: 'test'
...
# Subtest: read-only engineering inspection disables configured Git clean filters and preserves index bytes
ok 22 - read-only engineering inspection disables configured Git clean filters and preserves index bytes
---
duration_ms: 2422.1425
type: 'test'
...
# Subtest: Python multiline declarations retain candidate scope without interpreting expressions as declarations
ok 23 - Python multiline declarations retain candidate scope without interpreting expressions as declarations
---
duration_ms: 707.7085
type: 'test'
...
# Subtest: TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
ok 24 - TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
---
duration_ms: 652.5222
type: 'test'
...
# Subtest: actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
ok 25 - actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
---
duration_ms: 1869.9432
type: 'test'
...
# Subtest: actual HTTP request excludes archived, timed-out and foreign-project memories
ok 26 - actual HTTP request excludes archived, timed-out and foreign-project memories
---
duration_ms: 2513.4577
type: 'test'
...
# Subtest: actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
ok 27 - actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
---
duration_ms: 2397.4539
type: 'test'
...
# Subtest: incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
ok 28 - incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
---
duration_ms: 2665.748
type: 'test'
...
# Subtest: corrupt original artifact expires its memory and cannot reach an HTTP model request
ok 29 - corrupt original artifact expires its memory and cannot reach an HTTP model request
---
duration_ms: 1841.4681
type: 'test'
...
# Subtest: memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
ok 30 - memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
---
duration_ms: 2867.9413
type: 'test'
...
# Subtest: optional memory yields to the complete goal and original code evidence under the whole-request budget
ok 31 - optional memory yields to the complete goal and original code evidence under the whole-request budget
---
duration_ms: 1055.5606
type: 'test'
...
# Subtest: changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
ok 32 - changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
---
duration_ms: 1880.3822
type: 'test'
...
# Subtest: a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
ok 33 - a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
---
duration_ms: 1438.2184
type: 'test'
...
# Subtest: an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
ok 34 - an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
---
duration_ms: 1321.3451
type: 'test'
...
# Subtest: project memories persist across restart, keep source provenance, and are visible across tasks
ok 35 - project memories persist across restart, keep source provenance, and are visible across tasks
---
duration_ms: 1183.9789
type: 'test'
...
# Subtest: source changes expire current project memories and keep the original evidence
ok 36 - source changes expire current project memories and keep the original evidence
---
duration_ms: 802.5977
type: 'test'
...
# Subtest: incomplete source scans mark current memories unverified without expiring or reusing them
ok 37 - incomplete source scans mark current memories unverified without expiring or reusing them
---
duration_ms: 1035.1675
type: 'test'
...
# Subtest: explicit file provenance is rechecked even when the inventory excludes that path
ok 38 - explicit file provenance is rechecked even when the inventory excludes that path
---
duration_ms: 833.0367
type: 'test'
...
# Subtest: execution snapshots do not expose project memories before their source scope is validated
ok 39 - execution snapshots do not expose project memories before their source scope is validated
---
duration_ms: 926.1835
type: 'test'
...
# Subtest: project memory records stay isolated and archive requires the owning session
ok 40 - project memory records stay isolated and archive requires the owning session
---
duration_ms: 955.0049
type: 'test'
...
# Subtest: project memory HTTP API exposes read-only source status and explicit writes
ok 41 - project memory HTTP API exposes read-only source status and explicit writes
---
duration_ms: 2632.4091
type: 'test'
...
# Subtest: two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
ok 42 - two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
---
duration_ms: 753.1062
type: 'test'
...
# Subtest: incomplete, unsupported, relative and oversized sources cannot enable the experiment
ok 43 - incomplete, unsupported, relative and oversized sources cannot enable the experiment
---
duration_ms: 666.8238
type: 'test'
...
# Subtest: invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
ok 44 - invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
---
duration_ms: 2158.9743
type: 'test'
...
# Subtest: source edits between detection and plan are rejected without creating a parent Task
ok 45 - source edits between detection and plan are rejected without creating a parent Task
---
duration_ms: 2080.2563
type: 'test'
...
# Subtest: source edits after sealing cannot launch a child and do not reset its cumulative budget
ok 46 - source edits after sealing cannot launch a child and do not reset its cumulative budget
---
duration_ms: 11319.2502
type: 'test'
...
# Subtest: literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
ok 47 - literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
---
duration_ms: 31672.8114
type: 'test'
...
# Subtest: source changes after a model response stop before any native tool is accepted, retaining the actual usage once
ok 48 - source changes after a model response stop before any native tool is accepted, retaining the actual usage once
---
duration_ms: 13586.4589
type: 'test'
...
# Subtest: source changes while approval is pending invalidate the old permission before an engineering check starts
ok 49 - source changes while approval is pending invalidate the old permission before an engineering check starts
---
duration_ms: 16705.3602
type: 'test'
...
# Subtest: altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
ok 50 - altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
---
duration_ms: 2050.5668
type: 'test'
...
# Subtest: the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
ok 51 - the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
---
duration_ms: 2156.274
type: 'test'
...
# Subtest: a missing or duplicated experimental section in the actual input is rejected before any model dispatch
ok 52 - a missing or duplicated experimental section in the actual input is rejected before any model dispatch
---
duration_ms: 23917.0868
type: 'test'
...
# Subtest: experimental prompt overhead still participates in the original complete-input budget guard
ok 53 - experimental prompt overhead still participates in the original complete-input budget guard
---
duration_ms: 10866.7157
type: 'test'
...
# Subtest: source detection HTTP remains local-authenticated and read-only with no configured model requests
ok 54 - source detection HTTP remains local-authenticated and read-only with no configured model requests
---
duration_ms: 1463.1097
type: 'test'
...
# Subtest: Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
ok 55 - Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
---
duration_ms: 9792.7269
type: 'test'
...
# Subtest: an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
ok 56 - an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
---
duration_ms: 38383.1309
type: 'test'
...
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
ok 57 - Python static inspection does not import project code or probe a project interpreter before approval
---
duration_ms: 923.0171
type: 'test'
...
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
ok 58 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
---
duration_ms: 4415.9998
type: 'test'
...
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
ok 59 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
---
duration_ms: 2721.7342
type: 'test'
...
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
ok 60 - unittest empty, skipped, expected failure and class initialization errors never verify a task
---
duration_ms: 8081.7878
type: 'test'
...
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
ok 61 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
---
duration_ms: 2897.6415
type: 'test'
...
# Subtest: compilation reads actual Python source bytes without executing top-level project code
ok 62 - compilation reads actual Python source bytes without executing top-level project code
---
duration_ms: 2422.9429
type: 'test'
...
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
ok 63 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
---
duration_ms: 2525.5743
type: 'test'
...
# Subtest: changed project interpreters and forged Python plan bindings execute no check
ok 64 - changed project interpreters and forged Python plan bindings execute no check
---
duration_ms: 1277.3193
type: 'test'
...
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
ok 65 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
---
duration_ms: 1139.5802
type: 'test'
...
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
ok 66 - stopping a real Python check terminates its child and keeps the completed result as cancelled
---
duration_ms: 2029.0361
type: 'test'
...
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
ok 67 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
---
duration_ms: 14954.3331
type: 'test'
...
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
ok 68 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
---
duration_ms: 7946.9105
type: 'test'
...
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
ok 69 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
---
duration_ms: 2729.0867
type: 'test'
...
1..69
# tests 69
# suites 0
# pass 69
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 145738.5137