Files
Agent-Workbench/docs/reproducible-env-release-evidence/source/tests-07.tap
T

431 lines
19 KiB
Plaintext

TAP version 13
# Subtest: JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
ok 1 - JS/TS/React AST indexes actual declarations, exports, imports and verified source lines
---
duration_ms: 1106.9161
type: 'test'
...
# Subtest: default expressions, named default exports and declared functions retain their AST evidence
ok 2 - default expressions, named default exports and declared functions retain their AST evidence
---
duration_ms: 890.6951
type: 'test'
...
# Subtest: incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
ok 3 - incremental refresh invalidates changed/deleted symbols and recalculates reused import targets
---
duration_ms: 1203.0521
type: 'test'
...
# Subtest: Python candidates exclude comments and multiline strings and declare limited evidence
ok 4 - Python candidates exclude comments and multiline strings and declare limited evidence
---
duration_ms: 882.1734
type: 'test'
...
# Subtest: indexes isolate project identity and root and evict bounded caches without sharing results
ok 5 - indexes isolate project identity and root and evict bounded caches without sharing results
---
duration_ms: 857.2824
type: 'test'
...
# Subtest: Git ignore, credential paths and links stay outside the index and no project files are executed
ok 6 - Git ignore, credential paths and links stay outside the index and no project files are executed
---
duration_ms: 2036.6688
type: 'test'
...
# Subtest: malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
ok 7 - malformed, binary, non-UTF8 and bounded files expose partial coverage while good files remain searchable
---
duration_ms: 1249.7265
type: 'test'
...
# Subtest: index query rejects invalid limits/types and does not imply reference or alias resolution
ok 8 - index query rejects invalid limits/types and does not imply reference or alias resolution
---
duration_ms: 820.1779
type: 'test'
...
# Subtest: read-only engineering inspection disables configured Git clean filters and preserves index bytes
ok 9 - read-only engineering inspection disables configured Git clean filters and preserves index bytes
---
duration_ms: 2588.8924
type: 'test'
...
# Subtest: Python multiline declarations retain candidate scope without interpreting expressions as declarations
ok 10 - Python multiline declarations retain candidate scope without interpreting expressions as declarations
---
duration_ms: 1099.4147
type: 'test'
...
# Subtest: TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
ok 11 - TypeScript module candidates support import-equals and MTS/CTS while opaque imports stay explicit
---
duration_ms: 724.3732
type: 'test'
...
# Subtest: actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
ok 12 - actual HTTP requests reuse only this project source-checked memory as redacted data and preserve sent evidence after archive/restart
---
duration_ms: 3004.0165
type: 'test'
...
# Subtest: actual HTTP request excludes archived, timed-out and foreign-project memories
ok 13 - actual HTTP request excludes archived, timed-out and foreign-project memories
---
duration_ms: 3688.7643
type: 'test'
...
# Subtest: actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
ok 14 - actual next HTTP request removes expired memory after a tool observes a source change without replaying that tool
---
duration_ms: 3649.9519
type: 'test'
...
# Subtest: incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
ok 15 - incomplete inventory and excluded-file SHA changes cannot enter actual HTTP memory context or inspect_session snapshots
---
duration_ms: 3750.5201
type: 'test'
...
# Subtest: corrupt original artifact expires its memory and cannot reach an HTTP model request
ok 16 - corrupt original artifact expires its memory and cannot reach an HTTP model request
---
duration_ms: 2659.1931
type: 'test'
...
# Subtest: memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
ok 17 - memory JSON is bounded in escaped UTF-8 bytes and entry count, skips oversized entries and retains complete multilingual values
---
duration_ms: 3922.7507
type: 'test'
...
# Subtest: optional memory yields to the complete goal and original code evidence under the whole-request budget
ok 18 - optional memory yields to the complete goal and original code evidence under the whole-request budget
---
duration_ms: 1764.7064
type: 'test'
...
# Subtest: changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
ok 19 - changed sealed memory artifacts or binding fields fail verification while the original request remains immutable
---
duration_ms: 1814.1244
type: 'test'
...
# Subtest: a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
ok 20 - a malformed project declaration omits optional memory while the repair Task still reaches the owned HTTP service
---
duration_ms: 2772.8418
type: 'test'
...
# Subtest: an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
ok 21 - an expiration persistence failure prevents dispatch and is not hidden as an optional scan failure
---
duration_ms: 1684.2012
type: 'test'
...
# Subtest: project memories persist across restart, keep source provenance, and are visible across tasks
ok 22 - project memories persist across restart, keep source provenance, and are visible across tasks
---
duration_ms: 1620.8466
type: 'test'
...
# Subtest: source changes expire current project memories and keep the original evidence
ok 23 - source changes expire current project memories and keep the original evidence
---
duration_ms: 1439.0899
type: 'test'
...
# Subtest: incomplete source scans mark current memories unverified without expiring or reusing them
ok 24 - incomplete source scans mark current memories unverified without expiring or reusing them
---
duration_ms: 1456.3975
type: 'test'
...
# Subtest: explicit file provenance is rechecked even when the inventory excludes that path
ok 25 - explicit file provenance is rechecked even when the inventory excludes that path
---
duration_ms: 653.2037
type: 'test'
...
# Subtest: execution snapshots do not expose project memories before their source scope is validated
ok 26 - execution snapshots do not expose project memories before their source scope is validated
---
duration_ms: 1004.0568
type: 'test'
...
# Subtest: project memory records stay isolated and archive requires the owning session
ok 27 - project memory records stay isolated and archive requires the owning session
---
duration_ms: 1551.4178
type: 'test'
...
# Subtest: project memory HTTP API exposes read-only source status and explicit writes
ok 28 - project memory HTTP API exposes read-only source status and explicit writes
---
duration_ms: 3520.5368
type: 'test'
...
# Subtest: two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
ok 29 - two Purge source versions lock nine original inputs without executing JavaScript or postinstall and remain disabled by default
---
duration_ms: 1091.8411
type: 'test'
...
# Subtest: incomplete, unsupported, relative and oversized sources cannot enable the experiment
ok 30 - incomplete, unsupported, relative and oversized sources cannot enable the experiment
---
duration_ms: 1163.6356
type: 'test'
...
# Subtest: invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
ok 31 - invalid source fingerprints and invented privilege or retry fields fail before any parent Task is created
---
duration_ms: 3502.6303
type: 'test'
...
# Subtest: source edits between detection and plan are rejected without creating a parent Task
ok 32 - source edits between detection and plan are rejected without creating a parent Task
---
duration_ms: 3197.3915
type: 'test'
...
# Subtest: source edits after sealing cannot launch a child and do not reset its cumulative budget
ok 33 - source edits after sealing cannot launch a child and do not reset its cumulative budget
---
duration_ms: 13836.9415
type: 'test'
...
# Subtest: literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
ok 34 - literal experiment text is sealed into the parent, worker and each new Run while actual host approvals and saved results remain required
---
duration_ms: 36161.5874
type: 'test'
...
# Subtest: source changes after a model response stop before any native tool is accepted, retaining the actual usage once
ok 35 - source changes after a model response stop before any native tool is accepted, retaining the actual usage once
---
duration_ms: 14058.3316
type: 'test'
...
# Subtest: source changes while approval is pending invalidate the old permission before an engineering check starts
ok 36 - source changes while approval is pending invalidate the old permission before an engineering check starts
---
duration_ms: 17405.023
type: 'test'
...
# Subtest: altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
ok 37 - altered text, interpolation, section order and policy flags cannot reuse a sealed experiment
---
duration_ms: 2734.0999
type: 'test'
...
# Subtest: the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
ok 38 - the observed SDK system-message layout and the explicit system field both require exactly one effective section, never a user or tool copy
---
duration_ms: 2573.268
type: 'test'
...
# Subtest: a missing or duplicated experimental section in the actual input is rejected before any model dispatch
ok 39 - a missing or duplicated experimental section in the actual input is rejected before any model dispatch
---
duration_ms: 27167.4017
type: 'test'
...
# Subtest: experimental prompt overhead still participates in the original complete-input budget guard
ok 40 - experimental prompt overhead still participates in the original complete-input budget guard
---
duration_ms: 14544.6337
type: 'test'
...
# Subtest: source detection HTTP remains local-authenticated and read-only with no configured model requests
ok 41 - source detection HTTP remains local-authenticated and read-only with no configured model requests
---
duration_ms: 2594.8512
type: 'test'
...
# Subtest: Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
ok 42 - Python HTTP plans keep npm defaults, require owned approval and preserve actual results across restart
---
duration_ms: 12818.86
type: 'test'
...
# Subtest: an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
ok 43 - an isolated three-module Python Task repairs, checks and delivers a source-bound Git report without extra model calls
---
duration_ms: 46947.4227
type: 'test'
...
# Subtest: Python static inspection does not import project code or probe a project interpreter before approval
ok 44 - Python static inspection does not import project code or probe a project interpreter before approval
---
duration_ms: 2183.308
type: 'test'
...
# Subtest: a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
ok 45 - a real three-module Python failure, reviewed repairs, tests and compilation retain exact structured evidence
---
duration_ms: 5731.4626
type: 'test'
...
# Subtest: unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
ok 46 - unittest counts repeated execution ordinals and subtest skips rather than deduplicating display names
---
duration_ms: 4179.4753
type: 'test'
...
# Subtest: unittest empty, skipped, expected failure and class initialization errors never verify a task
ok 47 - unittest empty, skipped, expected failure and class initialization errors never verify a task
---
duration_ms: 7876.7392
type: 'test'
...
# Subtest: stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
ok 48 - stdout claims cannot replace actual unittest results and an early exit cannot forge a successful collector
---
duration_ms: 3105.9012
type: 'test'
...
# Subtest: compilation reads actual Python source bytes without executing top-level project code
ok 49 - compilation reads actual Python source bytes without executing top-level project code
---
duration_ms: 2939.6749
type: 'test'
...
# Subtest: Node and Python mixed projects retain the existing npm default and require an explicit Python selection
ok 50 - Node and Python mixed projects retain the existing npm default and require an explicit Python selection
---
duration_ms: 2932.2956
type: 'test'
...
# Subtest: changed project interpreters and forged Python plan bindings execute no check
ok 51 - changed project interpreters and forged Python plan bindings execute no check
---
duration_ms: 2420.8374
type: 'test'
...
# Subtest: malformed TOML and invalid Python test paths are reported without expanding npm check scope
ok 52 - malformed TOML and invalid Python test paths are reported without expanding npm check scope
---
duration_ms: 1493.6531
type: 'test'
...
# Subtest: stopping a real Python check terminates its child and keeps the completed result as cancelled
ok 53 - stopping a real Python check terminates its child and keeps the completed result as cancelled
---
duration_ms: 2806.2821
type: 'test'
...
# Subtest: real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
ok 54 - real pytest pass, failure, skip, collection errors and teardown errors use collected case outcomes
---
duration_ms: 16354.4728
type: 'test'
...
# Subtest: a real project virtual environment is detected statically and its actual version is recorded only during the approved check
ok 55 - a real project virtual environment is detected statically and its actual version is recorded only during the approved check
---
duration_ms: 9119.6495
type: 'test'
...
# Subtest: a missing interpreter and repeated pytest item objects cannot create a false verification pass
ok 56 - a missing interpreter and repeated pytest item objects cannot create a false verification pass
---
duration_ms: 2959.9619
type: 'test'
...
# Subtest: continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
ok 57 - continuation reads advance through historical pages without a false pause while repeated current-Run pages still pause
---
duration_ms: 1.9161
type: 'test'
...
# Subtest: a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
ok 58 - a new tool page replaces old latest-feedback space and still obeys its escaped protocol budget
---
duration_ms: 0.7085
type: 'test'
...
# Subtest: budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
ok 59 - budgeted artifact pages count escaped protocol bytes and reconstruct original multilingual JSON without losing characters
---
duration_ms: 9.485
type: 'test'
...
# Subtest: known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
ok 60 - known artifact coverage detects semantic repeats despite changing limits, and advancing pages or direct evidence restore progress
---
duration_ms: 0.3682
type: 'test'
...
# Subtest: actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
ok 61 - actual large artifact reads are present in the next bounded HTTP request and next_offset progresses without redoing tools
---
duration_ms: 3883.4309
type: 'test'
...
# Subtest: a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
ok 62 - a real repeated artifact loop pauses the same Task after recorded results, survives reload and only resumes explicitly
---
duration_ms: 4589.3621
type: 'test'
...
# Subtest: actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
ok 63 - actual HTTP continuation after reload sends distinct historically covered pages without false no_progress or replay
---
duration_ms: 8175.4705
type: 'test'
...
# Subtest: an installed app outside the source drive resolves registered SDK and Purge through actual input verification
ok 64 - an installed app outside the source drive resolves registered SDK and Purge through actual input verification
---
duration_ms: 1061.7316
type: 'test'
...
# Subtest: standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
ok 65 - standalone registration resolves the upstream metadata directory and missing upstream falls back to the other registered source
---
duration_ms: 905.627
type: 'test'
...
# Subtest: registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
ok 66 - registered hints keep explicit roots, environment and existing app-relative candidates in their original priority
---
duration_ms: 1054.2338
type: 'test'
...
# Subtest: unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
ok 67 - unknown IDs, duplicate registered IDs, wrong versions and relative or inconsistent metadata are not lookup candidates
---
duration_ms: 1390.6136
type: 'test'
...
# Subtest: oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
ok 68 - oversized, malformed, invalid UTF-8 and non-file registry inputs cannot silently enable a source
---
duration_ms: 2916.4806
type: 'test'
...
# Subtest: a linked registry directory is rejected without reading or deleting its external source
ok 69 - a linked registry directory is rejected without reading or deleting its external source
---
duration_ms: 488.1204
type: 'test'
...
# Subtest: matching research declarations do not replace actual installed version and critical-source checks
ok 70 - matching research declarations do not replace actual installed version and critical-source checks
---
duration_ms: 670.8121
type: 'test'
...
1..70
# tests 70
# suites 0
# pass 70
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 173738.1085