Fix Copilot parser to find session logs after artifact flattening

[Copilot]

The Copilot parser couldn't locate session log files after artifact flattening. The issue was that artifact download structures vary depending on how GitHub Actions handles uploaded paths, and the parser only checked specific expected locations.

Changes

• logs_parsing.go: Enhanced findAgentLogFile() with robust search strategy

  • Checks agent_output/ directory (pre-flattening, backward compatibility)
  • Strips /tmp/gh-aw/ prefix and checks expected flattened location: sandbox/agent/logs/
  • Added recursive search fallback: Searches entire logDir for session*.log files to handle any artifact structure

• logs_test.go: Added test cases for Copilot engine

  • Flattened location test
  • Recursive search test for session logs directly in run directory

• logs_copilot_flattening_integration_test.go: Added comprehensive integration tests

  • Full workflow simulation (download → flatten → parse)
  • Direct flattening test (session logs at root)
  • Multiple session files handling
  • Backward compatibility verification

Example

// Before: Only checked agent_output/
agentOutputDir := filepath.Join(logDir, "agent_output")

// After: Multi-layered search strategy
// 1. Check agent_output/ (backward compatibility)
// 2. Check expected flattened location
const tmpGhAwPrefix = "/tmp/gh-aw/"
if strings.HasPrefix(logFileForParsing, tmpGhAwPrefix) {
    relPath := strings.TrimPrefix(logFileForParsing, tmpGhAwPrefix)
    flattenedDir := filepath.Join(logDir, relPath) // sandbox/agent/logs/
    // Find .log files in flattened directory
}
// 3. Recursive search for session*.log anywhere in logDir (fallback)

The parser now correctly discovers session logs regardless of artifact structure, handling:

• Pre-flattening location (agent_output/)
• Expected flattened location (sandbox/agent/logs/)
• Any artifact structure via recursive search for session*.log files

Original prompt

Reference: https://github.com/githubnext/gh-aw/actions/runs/20704025325/job/59430998166#step:5:1

Make sure the logs file flattening works and the copilot parser is able to find the session file to parse the log.

Try this run:

✓ Downloaded artifacts for run 20701642088 to .github/aw/logs/run-20701642088

---

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

[pelikhan]

@copilot flattening is still not working

[Copilot]

@copilot flattening is still not working

Could you provide more details about what's not working? The tests pass, and the flattening logic moves files from agent_outputs/sandbox/agent/logs/ to sandbox/agent/logs/. Are you seeing:

• Files not being moved?
• Parser not finding files after flattening?
• A specific workflow run that's failing?

Having specific examples or error messages would help me debug the issue.

[pelikhan]

@copilot the parser is not finding the session log file. Look for session*.log recursively to find where to find it.

[Copilot]

@copilot the parser is not finding the session log file. Look for session*.log recursively to find where to find it.

Fixed in 96610c8. Added recursive search for session*.log files as a fallback when the expected directory structures aren't found. The parser now searches:

1. agent_output/ (pre-flattening)
2. sandbox/agent/logs/ (expected post-flattening)
3. Entire logDir recursively for session*.log (handles any artifact structure)

This handles cases where gh run download creates different directory structures than expected.