Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchpark python script to grab programming models #486

Closed
14 tasks done
pearce8 opened this issue Dec 10, 2024 · 1 comment · Fixed by #698
Closed
14 tasks done

benchpark python script to grab programming models #486

pearce8 opened this issue Dec 10, 2024 · 1 comment · Fixed by #698
Assignees
Labels
feature New feature or request
Milestone

Comments

@pearce8
Copy link
Collaborator

pearce8 commented Dec 10, 2024

A script to access info in experiment.py:

class Amg2023(
    Experiment,
    OpenMPExperiment,
    CudaExperiment,
    ROCmExperiment,
    StrongScaling,
    WeakScaling,
    ThroughputScaling,
    Caliper,
):

For now, we would use benchpark-python. Once experiments become Spack packages, we could use
spack-python (https://spack-tutorial.readthedocs.io/en/latest/tutorial_spack_scripting.html). #138 is an example of using spack-python.

  • benchpark list experiments openmp
  • benchpark list experiments cuda
  • benchpark list experiments rocm
  • benchpark list experiments strong
  • benchpark list experiments weak
  • benchpark list experiments throughput
  • benchpark list experiments caliper
    • caliper is a modifier, so it is listed under benchpark list modifiers
  • benchpark list programmingmodels experimentname -> benchpark list experiments --experiment cuda rocm openmp
  • benchpark list scaling experimentname -> benchpark list experiments --experiment weak strong
  • remove cuda/rocm/openmp from tags in application.py and experiment.py files
  • update script generating experiment table to use benchpark list experiments --experiment cuda rocm openmp for the programming-model row
  • add scaling-experiments row in experiment table using benchpark list experiments --experiment weak strong command
  • add instrumented-caliper row in experiment table using benchpark list modifiers --name caliper --experiments command
  • add all new commands to docs
@michaelmckinsey1
Copy link
Collaborator

Currently, benchpark list experiments does the following:

$ benchpark list experiments
Experiments:
    ad+single_node
    amg2023+single_node
    amg2023+openmp
    amg2023+cuda
    amg2023+rocm
    amg2023+strong
    amg2023+weak
    amg2023+throughput
    ...

To enable this Issue, would need to add a subparser that down-selects from the current output.

@michaelmckinsey1 michaelmckinsey1 linked a pull request Mar 24, 2025 that will close this issue
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants