Skip to content

Investigate feasibility of new CLI features: result export, baselining, CI regression testing - #223

Merged
ErikEJ merged 2 commits into
masterfrom
copilot/investigate-new-cli-features
Oct 9, 2026
Merged

ErikEJ merged 2 commits into
masterfrom
copilot/investigate-new-cli-features

Conversation

Copilot AI commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

Investigation for #222: assess the feasibility of adding result export, baselining, and CI regression testing of query performance to the sqlstresscmd CLI. This PR adds a planning document only — no runtime behaviour changes.

Added

  • docs/cli-features-feasibility.md — feasibility plan grounded in the current code (Program.cs → LoadRunner → shared LoadEngine).

Key findings

  • Result export already partially exists: the -r/--results option autosaves a CSV in LoadRunner, though the option is still annotated //TODO Implement and only emits averages with culture-sensitive formatting.
  • Enabling changes that unlock all three features are small: a shared RunResult model for structured export, and making Program.Main return a non-zero exit code (currently void, so CI cannot detect failures).
  • The CLI already collects the needed metrics and reuses the linked JsonSerializer and Spectre.Console, so no new heavy dependencies are required.

Proposed design & effort

  • Result export (Low) — formalize RunResult, add JSON, invariant/ISO-8601 formatting, optional percentiles.
  • Baselining (Low–Medium) — --save-baseline / --baseline comparing per-iteration averages, rendered as a diff table.
  • CI regression testing (Medium) — threshold options + exit codes + sample GitHub Actions job; flagged as noise-sensitive, so recommended as indicative rather than exact.

Recommended delivery order

Export → baselining → CI regression, each additive and backward compatible.

Copilot AI linked an issue Oct 9, 2026 that may be closed by this pull request
…ression)

Co-authored-by: ErikEJ <4169187+ErikEJ@users.noreply.github.com>
Copilot AI changed the title [WIP] Investigate feasibility of new CLI features Investigate feasibility of new CLI features: result export, baselining, CI regression testing Oct 9, 2026
Copilot AI requested a review from ErikEJ October 9, 2026 10:05
@ErikEJ
ErikEJ marked this pull request as ready for review October 9, 2026 10:09
@ErikEJ
ErikEJ merged commit 727b094 into master Oct 9, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Investigate new CLI features

2 participants