Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better benchmarks #21

Open
2 of 3 tasks
DavJCosby opened this issue Dec 12, 2023 · 0 comments
Open
2 of 3 tasks

Better benchmarks #21

DavJCosby opened this issue Dec 12, 2023 · 0 comments
Labels
e/performance Changes intended to improve performance needs_thought Concepts that need to be explored more before they're ready to be worked on

Comments

@DavJCosby
Copy link
Owner

DavJCosby commented Dec 12, 2023

Right now I've basically got a benchmark for each significant method. For the most part that's been helpful as I'm in a stage where I'd like to see how a change directly affects a method's performance, but later down the road this model doesn't really make sense. The current solution is pretty noise prone, and it takes forever to run the thing.

Instead of like 10-15 benchmarks, there should be 3-5 that each try to push the system to some extreme from a handful of angles. These should be computationally expensive benchmarks that each ask for 100+ frames of unique color generation. While one might focus on mapping techniques, another might make heavier use of angular/directional setters, or filters.

With better benchmarks like these, regressions/improvements should be more distinguishable from the noise.

  • quirky_trail
    heavy usage of angle-based draw methods
  • raindrops
    heavy usage of distance-based draw methods
  • something focusing on filters
    - [ ] something complex that focuses on index/range operations. Maybe 1D conways game of life?
@DavJCosby DavJCosby added e/api Improving a method in the API, or adding a new one e/performance Changes intended to improve performance labels Dec 12, 2023
@DavJCosby DavJCosby added this to the 0.2.0 milestone Dec 12, 2023
@DavJCosby DavJCosby moved this to Todo in 0.2 Roadmap Dec 12, 2023
@DavJCosby DavJCosby moved this from Todo to In Progress in 0.2 Roadmap Dec 13, 2023
@DavJCosby DavJCosby moved this from In Progress to Next Up in 0.2 Roadmap Dec 13, 2023
@DavJCosby DavJCosby moved this from Next Up to Backlog in 0.2 Roadmap Dec 13, 2023
@DavJCosby DavJCosby added needs_thought Concepts that need to be explored more before they're ready to be worked on and removed e/api Improving a method in the API, or adding a new one labels Dec 13, 2023
@DavJCosby DavJCosby removed this from the 1.0.0 release milestone Sep 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
e/performance Changes intended to improve performance needs_thought Concepts that need to be explored more before they're ready to be worked on
Projects
Status: Backlog
Development

No branches or pull requests

1 participant