Skip to content

docs(prompts): enhance debug prompt with ADO MCP pipeline tools and diagnostic report#457

Merged
jamesadevine merged 1 commit into
mainfrom
enhance-debug-prompt-mcp
May 8, 2026
Merged

docs(prompts): enhance debug prompt with ADO MCP pipeline tools and diagnostic report#457
jamesadevine merged 1 commit into
mainfrom
enhance-debug-prompt-mcp

Conversation

@jamesadevine
Copy link
Copy Markdown
Collaborator

Summary

Enhances prompts/debug-ado-agentic-workflow.md — the prompt loaded by the init-agent dispatcher when users need help debugging a failing ado-aw pipeline. The prompt now leverages Azure DevOps MCP pipeline tools for automated investigation and produces a standardized diagnostic report filed as a GitHub issue.

Changes

New: Azure DevOps MCP prerequisites section

  • Advises users to configure @azure-devops/mcp with the pipelines toolset in their IDE/agent context (NOT the pipeline frontmatter)
  • Lists all useful pipeline tools: get_build_definitions, get_builds, get_build_status, get_build_log, get_build_log_by_id, get_build_changes

New: MCP-first automated investigation flow (Steps 1–6)

  • Step 1: Determine available tools (ADO MCP, GitHub MCP, local repo)
  • Step 2: Establish target run with minimal user context
  • Step 3: Automated investigation — find definition → find failed build → get timeline → classify failure → retrieve logs → compare against last successful build → check local files
  • Step 4: Diagnose using existing stage-specific sections
  • Step 5: Produce diagnostic report using standardized template
  • Step 6: File GitHub issue (mandatory) — priority: GitHub MCP → gh CLI → raw markdown + link

New: Failure classification table

Maps timeline records to stage-specific diagnosis sections (Setup, Agent infrastructure, MCPG, Agent runtime, Detection, Execution, Teardown, resource/auth issues).

New: Standardized diagnostic report template

Semi-rigid markdown template with: summary (pipeline info, failing step, confidence), evidence (sanitized logs, timeline, changes since last success), environment details, analysis, root cause, and issue metadata.

Scoping: Investigation and reporting only

  • The agent investigates and reports — it does not propose fixes, apply changes, or recompile pipelines
  • Removed "Apply the Fix" and "Verify" steps
  • Report template uses "Root Cause" section instead of "Recommended Fix"

Preserved

  • All Stage 1/2/3 diagnosis sections (AWF, MCPG, engine, tools, compilation drift, threat analysis, execution errors)
  • Setup/Teardown and cross-stage sections
  • Debugging checklist and reference links
  • Manual fallback flow for when MCP is unavailable

…iagnostic report

Rework the debug-ado-agentic-workflow.md prompt to:

- Add Azure DevOps MCP prerequisites section advising users to set up
  the @azure-devops/mcp pipelines toolset in their IDE/agent context
- Introduce MCP-first automated investigation flow using pipeline tools
  (get_build_definitions, get_builds, get_build_status, get_build_log,
  get_build_log_by_id, get_build_changes) to find and analyze failing
  builds without manual log copy-paste
- Add failure classification table mapping timeline records to
  stage-specific diagnosis sections
- Add last-successful-build comparison as first-class regression path
- Add standardized diagnostic report template with summary, evidence,
  environment, analysis, and root cause sections
- Make GitHub issue filing mandatory as the final action (priority:
  GitHub MCP > gh CLI > raw markdown + link)
- Scope the agent to investigation and reporting only — no fix proposals
- Preserve all existing Stage 1/2/3 diagnosis content as-is
- Keep manual fallback flow for when MCP is unavailable

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@jamesadevine jamesadevine merged commit aac3f8c into main May 8, 2026
12 checks passed
@jamesadevine jamesadevine deleted the enhance-debug-prompt-mcp branch May 8, 2026 11:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant