Skip to content

evals

evals #8

Triggered via pull request July 2, 2026 23:23
Status Success
Total duration 7m 0s
Artifacts 6

evals.lock.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

2 warnings
safe_outputs
⚠️ report_incomplete: The `vally` eval run crashed before scoring any test cases. The executor failed with `Error: Session was not created with authentication info or custom provider` when attempting to start the `copilot-sdk` session for the `basic-usage` stimulus. This is an authentication/credential failure — the `copilot-sdk` executor needs credentials (e.g., a GitHub Copilot token or custom provider config) that were not present in this environment. No results were produced (`results.jsonl` is empty).
safe_outputs
upload_artifact: no files matched, skipping (if-no-files=ignore)

Artifacts

Produced during runtime
Name Size Digest
activation Expired
218 KB
sha256:99e0a1278b4d708046050a651ed31aa0f6c9fa7a9426eb75dfdb3eb119015ae3
agent
911 KB
sha256:604bd23ee7f64b16d8c05d07f6f835cf7b007c16b6d39e1b6a5688929986ef29
detection
3.18 KB
sha256:1b45063b94cb73cb64623d46f7bbc88842512717cf9fea538b426044df0a7f38
safe-outputs-items
301 Bytes
sha256:693cca04892ecbd6368c75d01d636a30018793cfc370cd52ca27d47d465bfaf3
safe-outputs-upload-artifacts Expired
440 Bytes
sha256:e62d9a1e923c8f63d0b9abc29bc39da89f8f6fb55320a77f21a439236c6fdfa0
usage
1.36 KB
sha256:1b826e20b8ab9e1bd6cbdb5cd42596f2dcb7666888472e22eb3a9e89168bcfa2