Files
Agent-Workbench/docs/engineering-evals-abc-evidence/evaluation-a-first.tap
T
2026-11-01 09:56:25 +08:00

19 lines
1.2 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
✔ evaluation contract fixes bounded samples, source paths, checks and aggregate budget (525.0705ms)
✔ same-source workspaces seal real commands before execution and preserve original staged and unstaged bytes (11083.0145ms)
✔ actual original failures and candidate success are both preserved, then adoption requires parent review, checks and Git (40331.2376ms)
✔ candidate cannot shrink tests and changing original test bytes rejects execution before any model request (15626.3462ms)
✔ missing upstream usage remains unknown and does not become a free run or invented cost (25914.3911ms)
✔ missing raw check logs preserve unknown result and original sample denominator (25759.3229ms)
✔ source and model changes never silently replace an existing batch input (2304.4183ms)
✔ sample queue cannot skip or reset attempted samples, and reports freeze further writes (20862.9625ms)
✔ stop cancels only current candidate and preserves partial results instead of replaying a request (16535.6083ms)
✔ restart recovers interrupted evaluations as unknown and keeps completed checks and plan identity (15402.608ms)
ℹ tests 10
ℹ suites 0
ℹ pass 10
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 174485.0587