New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Benchpark output runtime params #565

Open

4 tasks

pearce8 opened this issue Jan 24, 2025 · 1 comment

Assignees

Labels

ci feature

Milestone

Collaborator

pearce8 commented Jan 24, 2025 •

edited

Loading

For those unable/unwilling to use Ramble, we need to generate the equivalent of Running instructions

Run the benchmark in CI
Output appropriate runtime params and how to scale the benchmark to a file
Leave off the launch command and resource request
If the run passed, add the new instructions to the Sphinx page like this one

#532 may be useful for this.

pearce8 added the feature label

pearce8 assigned scheibelp and slabasan

pearce8 added the ci label

pearce8 unassigned scheibelp

pearce8 added this to the Urgent v0.1.1 milestone

pearce8 assigned michaelmckinsey1

Collaborator Author

pearce8 commented Feb 5, 2025

2/4/25 meeting notes

To get the launch line and parameters, could render the experiment.
unformatted_command_sans_logs strips the logs, has srun commands, they are not redirected.
For the table of parameters and FOMs: could sweep the parameters. We may also do this from Thicket.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment