-
Notifications
You must be signed in to change notification settings - Fork 214
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Benchmarking infrastructure ideas #338
Comments
Agreed, these would be quite useful. I think having a general tool to profile constraints would be nice too.
This probably belongs in its own repo, as these tools are probably helpful in benchmarking other components too.
Does this work?
Probably something like this should help?
I think we should have a benchmark suite of useful constraint systems, including recursive constraints, hash functions, group/field operations, etc. |
I've used that flame graph package and gotten it to work before. In golang theres a tool called
It'd be nice if we could get the expected result from another source, or maybe a file in the repo, which we have a bot to maintain |
I agree that that visualization is much better; maybe this tool should help? https://pingcap.medium.com/quickly-find-rust-program-bottlenecks-online-using-a-go-tool-37be0546aa8f
That library does have the |
This issue is intended for discussion on what types of infrastructure we should add, to go about benchmarking the constraint generation frameworks performance. I have some initial ideas below:
perf
,massif
, etc. I know we can convert perf's output to flamegraphs, and massif hasmassif-visualizer
. Not sure if we can make any of the above output graphviz svg's like pprof in golang. (I've seen some blog posts claiming to do this with perf, but it didn't work for me last time I tried it)Some remaining questions are
constraints-benchmark
crate be? I currently think it ought to be its own repoThoughts on any of the above / alternate ideas?
For Admin Use
The text was updated successfully, but these errors were encountered: