Skip to content

feat(ci): add prompt and managed agent cloud e2e pipeline - #1061

Draft
Zhijie Huang (hund030) wants to merge 2 commits into
mainfrom
feat/prompt-managed-agent-e2e-public
Draft

Zhijie Huang (hund030) wants to merge 2 commits into
mainfrom
feat/prompt-managed-agent-e2e-public

Conversation

@hund030

@hund030 Zhijie Huang (hund030) commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Add public-repo cloud E2E coverage for azd prompt and managed agents alongside hosted-agent validation. The pipeline runs changed samples on PRs and supports scheduled and manual full runs; Azure DevOps registration and resource authorization are separate setup steps.

Changes

  • .azure-pipelines/prompt-agents-samples-ci.yml: discover, deploy, invoke, recover, and summarize samples under samples/cli/prompt-agents, with SKIP_PROVISION selecting existing or disposable resources.
  • prompt-agents scripts and contracts: validate capabilities, track owned resources, and fail closed on missing evidence or unverified cleanup; fixture paths follow the CLI layout.
  • Shared fixture tooling and docs: support CLI prompt-agent contracts without changing hosted-agent defaults, with credential-free regression coverage and activation guidance.

Manual Validation

  • Ran 01-basic provisioning in westus2: azd init succeeded and ARM started provisioning, but the test identity lacked Microsoft.Authorization/roleAssignments/write; deleted the partial resource group and independently confirmed it was absent. Full deploy/invoke remains unverified.
  • After the CLI sample move, ran the complete local prompt harness with Git Bash and jq (74 tests passed), plus contract discovery. Azure DevOps registration and PR triggering remain unverified.

@hund030
Zhijie Huang (hund030) force-pushed the feat/prompt-managed-agent-e2e-public branch from e29df21 to 5af6f20 Compare October 14, 2026 05:46

This branch was successfully deployed

1 active deployment
L4-validation — 5af6f20e Deployed Oct 14, 2026 by hund030 via trusted #540
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant