Skip to content
This repository was archived by the owner on Sep 28, 2026. It is now read-only.

[QoL] Add generated text summary to top of output file - #116

Merged
benchislett merged 2 commits into
mainfrom
qol-output-file
Aug 27, 2025
Merged

benchislett merged 2 commits into
mainfrom
qol-output-file

Conversation

@benchislett

Copy link
Copy Markdown
Contributor

Overview

Include the generated_text section from each request in the top of the output-file. This makes it much easier to check the response quality at a glance, and correspond them by line-number to the i-th prompt.

Other

  • Allow small output token lengths as long as they are < 1. This was formerly a sanity check for ShareGPT data but isn't really needed anymore. Now we can run with --output-token-distribution same 1 to test prefill-only workloads.

Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
@benchislett benchislett self-assigned this Aug 27, 2025
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
@benchislett
benchislett merged commit 695da06 into main Aug 27, 2025
5 checks passed
@benchislett
benchislett deleted the qol-output-file branch August 27, 2025 20:55
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants