evals #8
evals.lock.yml
on: pull_request
Annotations
2 warnings
|
safe_outputs
⚠️ report_incomplete: The `vally` eval run crashed before scoring any test cases. The executor failed with `Error: Session was not created with authentication info or custom provider` when attempting to start the `copilot-sdk` session for the `basic-usage` stimulus. This is an authentication/credential failure — the `copilot-sdk` executor needs credentials (e.g., a GitHub Copilot token or custom provider config) that were not present in this environment. No results were produced (`results.jsonl` is empty).
|
|
safe_outputs
upload_artifact: no files matched, skipping (if-no-files=ignore)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
activation
Expired
|
218 KB |
sha256:99e0a1278b4d708046050a651ed31aa0f6c9fa7a9426eb75dfdb3eb119015ae3
|
|
|
agent
|
911 KB |
sha256:604bd23ee7f64b16d8c05d07f6f835cf7b007c16b6d39e1b6a5688929986ef29
|
|
|
detection
|
3.18 KB |
sha256:1b45063b94cb73cb64623d46f7bbc88842512717cf9fea538b426044df0a7f38
|
|
|
safe-outputs-items
|
301 Bytes |
sha256:693cca04892ecbd6368c75d01d636a30018793cfc370cd52ca27d47d465bfaf3
|
|
|
safe-outputs-upload-artifacts
Expired
|
440 Bytes |
sha256:e62d9a1e923c8f63d0b9abc29bc39da89f8f6fb55320a77f21a439236c6fdfa0
|
|
|
usage
|
1.36 KB |
sha256:1b826e20b8ab9e1bd6cbdb5cd42596f2dcb7666888472e22eb3a9e89168bcfa2
|
|