Open up a pull request on this repository to add a benchmark to the
benchmarks/ directory.
You should add tests in pairs, a .lisp file with a matching .out file.
Your tests should be named with your GitHub username:
<username>-<testname>.lisp and <username>-<testname>.out.
Here's how to get started running benchmarks for the final homework:
- Clone this respository into your final homework repository:
git clone https://github.com/BrownCS1260/final-benchmarks-2025.git benchmarks- In the new benchmarks directory, make a
config.jsonfile. This file should be a JSON-formatted dictionary where the keys are configurations and the values are lists of pass names. For example, it might look like:
{"No optimizations": [],
"Inlining": ["uniquify-variables", "inline"],
"Constant propagation and inlining": ["uniquify-variables", "inline", "propagate-constants"]}- Run the benchmark script. It will run each benchmark 10 times using each
specified configuration and write the results to
results.csv.
python3 bench.pyHave fun!