Skip to content

Fix Performance Benchmarks results extraction failure #100

@m-marinucci

Description

@m-marinucci

Problem

The Performance Benchmarks workflow introduced in PR #89 is failing during the "Extract benchmark results" step across all compiler configurations (gcc-11, gcc-12, clang-15).

Error Details

  • All performance benchmark jobs fail with exit code 1
  • Error occurs in the "Extract benchmark results" step
  • The Performance Analysis job reports "No benchmark results were found to analyze"

Root Cause

The benchmark extraction script is either:

  1. Not finding the expected output files from the benchmarks
  2. Encountering an error while parsing the benchmark results
  3. Looking in the wrong location for benchmark outputs

Proposed Fix

  1. Debug the benchmark extraction script to identify the exact failure point
  2. Verify that benchmarks are actually running and producing output
  3. Ensure the extraction script handles missing/malformed data gracefully
  4. Add better error messages to identify what's failing

Impact

  • Cannot track performance regressions
  • CI shows as failing even when code is correct
  • Blocks PR merging if strict CI requirements are enabled

Related

Priority

High - This blocks our ability to detect performance regressions

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions