Repository navigation
Add per-sample L4 validation execution - #887
Merged
Brandon Miller (brandom-msft) merged 7 commits intoAug 6, 2026
Merged
Conversation
Define the opt-in sample.yaml L4 execution contract, preserve caller-controlled warm and cold provisioning semantics, and cover pass, no-op, failure, and infrastructure classification paths. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d384d160-f922-4fed-9cd8-c6ffadc653bd
Keep transport-text inference scoped to dedicated dependency installs and require L4 commands to normalize pass, sample failure, and infrastructure error through exit codes 0, 1, and 2. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d384d160-f922-4fed-9cd8-c6ffadc653bd
Brandon Miller (brandom-msft)
temporarily deployed
to
L4-validation
August 6, 2026 01:16 — with 
GitHub Actions
Inactive
GitHub Actions
Inactive
Run a branch-scoped declared sample through the L4 validator using the existing warm-project OIDC environment. This workflow will be removed after evidence is captured. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d384d160-f922-4fed-9cd8-c6ffadc653bd
Brandon Miller (brandom-msft)
had a problem deploying
to
L4-validation
August 6, 2026 01:18 — with
GitHub Actions
Failure
GitHub Actions
Failure
Brandon Miller (brandom-msft)
temporarily deployed
to
L4-validation
August 6, 2026 01:19 — with
GitHub Actions
Inactive
GitHub Actions
Inactive
Match Mike Farah yq kind output for mappings and sequences so declared L4 samples validate with the production parser. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d384d160-f922-4fed-9cd8-c6ffadc653bd
Brandon Miller (brandom-msft)
temporarily deployed
to
L4-validation
August 6, 2026 01:20 — with
GitHub Actions
Inactive
GitHub Actions
Inactive
Brandon Miller (brandom-msft)
temporarily deployed
to
L4-validation
August 6, 2026 01:21 — with
GitHub Actions
Inactive
GitHub Actions
Inactive
The declared warm-project validation passed in GitHub Actions run 31062472629, so remove the branch-scoped proof workflow from the review diff. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d384d160-f922-4fed-9cd8-c6ffadc653bd
Brandon Miller (brandom-msft)
temporarily deployed
to
L4-validation
August 6, 2026 01:23 — with
GitHub Actions
Inactive
GitHub Actions
Inactive
Warn sample authors that common tools use exit 2 for sample-side failures and must be wrapped to preserve the L4 infrastructure-error contract. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d384d160-f922-4fed-9cd8-c6ffadc653bd
Prove that absent sample metadata is a yq-free L4 no-op and malformed YAML remains an infrastructure error. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d384d160-f922-4fed-9cd8-c6ffadc653bd
Brandon Miller (brandom-msft)
temporarily deployed
to
L4-validation
August 6, 2026 01:32 — with
GitHub Actions
Inactive
GitHub Actions
Inactive
Brandon Miller (brandom-msft)
deleted the
brandom-msft-p4-0-l4-execution
branch
August 6, 2026 21:22
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
validate-sample.shsample.yamll4.commandandrequired_envcontractSKIP_PROVISIONbehavior and clean no-declaration success0pass,1fail,2error; other nonzero fail)Validation
yqpong, and the validator emittedl4_declared=trueandverdict=passThe first hosted proof caught a real
yq kindcompatibility issue before Azure execution; commitf8156e73corrected the validator to productionyqbehavior, and both the full self-test and warm-project proof then passed. The temporary branch-scoped proof workflow was removed from the final diff.A final rubber-duck pressure test found no merge blockers. Two optional recommendations were adopted as independently revertible commits: exit-code normalization guidance (
c143f307) and absent/malformed YAML coverage (c2531338). Buffered L4 output was intentionally retained to honor the accepted capture/preservation requirement.Tracking
ADO 5480191: https://msdata.visualstudio.com/Vienna/_workitems/edit/5480191