Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev Tooling: Measure Utility of dev tools #14

Open
JSeiferth opened this issue Mar 4, 2025 · 0 comments
Open

Dev Tooling: Measure Utility of dev tools #14

JSeiferth opened this issue Mar 4, 2025 · 0 comments

Comments

@JSeiferth
Copy link
Member

What are you providing feedback on?

Metrics - feedback about the metrics used in the Eval Algo

Please describe your feedback

We need to improve our approach to measuring the utility of Dev Tools (e.g. for a given app dev, which dependency provides how much value to them?)

@Vectorized provided the following feedback

Code formatters are considered small features, and foundry already has one built-in that is way faster and better.

Metrics are bad at measuring impact. Say if we have two projects that are equally widely imported, but the first project has 1000x more usefulness than the second one, both will be ranked the same.

Solidity (the compiler) ranks relatively lower on this round, vs RPGF6 where it ranked in the top 3 via expert voting.

Please provide references or examples

Specific examples:

  1. Prettier Solidity performs better than other dev tools, while the value it provides to an app dev is fairly low compared to other libraries.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant