Skip to content

[AST] [Performance] Use 'SmallArray' instead of 'Vector' #7010

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

[AST] [Performance] Use 'SmallArray' instead of 'Vector' #7010

wants to merge 1 commit into from

Conversation

effectfully
Copy link
Contributor

#6602 will require optimizing case, so let's try doing that separately.

@effectfully effectfully added Evaluation AST Performance EXPERIMENT Experiments that we probably don't want to merge labels Apr 3, 2025
@effectfully effectfully self-assigned this Apr 3, 2025
@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Comparing benchmark results of 'lists' on '684818da3a' (base) and '5c2f60cc51' (PR)

Results table
Script 684818d 5c2f60c Change
sort/ghcSort/50 181.1 μs 188.1 μs +3.9%
sort/ghcSort/100 419.4 μs 442.3 μs +5.5%
sort/ghcSort/150 721.5 μs 759.9 μs +5.3%
sort/ghcSort/200 972.6 μs 1.022 ms +5.1%
sort/ghcSort/250 1.255 ms 1.320 ms +5.2%
sort/ghcSort/300 1.658 ms 1.743 ms +5.1%
sort/insertionSort/50 615.6 μs 630.2 μs +2.4%
sort/insertionSort/100 2.463 ms 2.514 ms +2.1%
sort/insertionSort/150 5.561 ms 5.663 ms +1.8%
sort/insertionSort/200 9.911 ms 10.08 ms +1.7%
sort/insertionSort/250 15.54 ms 15.82 ms +1.8%
sort/insertionSort/300 22.37 ms 22.93 ms +2.5%
sort/mergeSort/50 544.0 μs 561.0 μs +3.1%
sort/mergeSort/100 1.249 ms 1.288 ms +3.1%
sort/mergeSort/150 2.009 ms 2.074 ms +3.2%
sort/mergeSort/200 2.821 ms 2.908 ms +3.1%
sort/mergeSort/250 3.700 ms 3.823 ms +3.3%
sort/mergeSort/300 4.501 ms 4.648 ms +3.3%
sort/quickSort/50 1.456 ms 1.471 ms +1.0%
sort/quickSort/100 6.017 ms 6.046 ms +0.5%
sort/quickSort/150 13.52 ms 13.58 ms +0.4%
sort/quickSort/200 23.95 ms 24.04 ms +0.4%
sort/quickSort/250 37.75 ms 37.90 ms +0.4%
sort/quickSort/300 54.52 ms 54.50 ms -0.0%
sum/compiled-from-Haskell/sum-right-builtin/100 78.13 μs 76.99 μs -1.5%
sum/compiled-from-Haskell/sum-right-builtin/500 405.8 μs 403.7 μs -0.5%
sum/compiled-from-Haskell/sum-right-builtin/1000 864.3 μs 859.3 μs -0.6%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.662 ms 2.661 ms -0.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.754 ms 5.754 ms 0.0%
sum/compiled-from-Haskell/sum-right-Scott/100 44.19 μs 45.41 μs +2.8%
sum/compiled-from-Haskell/sum-right-Scott/500 233.3 μs 239.3 μs +2.6%
sum/compiled-from-Haskell/sum-right-Scott/1000 493.5 μs 525.8 μs +6.5%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.718 ms 1.805 ms +5.1%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.130 ms 4.192 ms +1.5%
sum/compiled-from-Haskell/sum-right-data/100 257.3 μs 256.9 μs -0.2%
sum/compiled-from-Haskell/sum-right-data/500 1.415 ms 1.415 ms 0.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.286 ms 3.165 ms -3.7%
sum/compiled-from-Haskell/sum-right-data/2500 8.464 ms 8.464 ms 0.0%
sum/compiled-from-Haskell/sum-right-data/5000 18.03 ms 18.06 ms +0.2%
sum/compiled-from-Haskell/sum-left-builtin/100 75.35 μs 75.68 μs +0.4%
sum/compiled-from-Haskell/sum-left-builtin/500 389.8 μs 392.9 μs +0.8%
sum/compiled-from-Haskell/sum-left-builtin/1000 843.4 μs 842.8 μs -0.1%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.569 ms 2.584 ms +0.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.691 ms 5.709 ms +0.3%
sum/compiled-from-Haskell/sum-left-Scott/100 42.56 μs 44.72 μs +5.1%
sum/compiled-from-Haskell/sum-left-Scott/500 224.6 μs 235.2 μs +4.7%
sum/compiled-from-Haskell/sum-left-Scott/1000 491.9 μs 518.6 μs +5.4%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.620 ms 1.722 ms +6.3%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.050 ms 4.311 ms +6.4%
sum/compiled-from-Haskell/sum-left-data/100 275.7 μs 263.4 μs -4.5%
sum/compiled-from-Haskell/sum-left-data/500 1.452 ms 1.457 ms +0.3%
sum/compiled-from-Haskell/sum-left-data/1000 3.271 ms 3.269 ms -0.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.671 ms 8.698 ms +0.3%
sum/compiled-from-Haskell/sum-left-data/5000 18.45 ms 18.45 ms 0.0%
sum/hand-written-PLC/sum-right-builtin/100 52.22 μs 53.02 μs +1.5%
sum/hand-written-PLC/sum-right-builtin/500 262.4 μs 267.2 μs +1.8%
sum/hand-written-PLC/sum-right-builtin/1000 536.0 μs 552.7 μs +3.1%
sum/hand-written-PLC/sum-right-builtin/2500 1.569 ms 1.593 ms +1.5%
sum/hand-written-PLC/sum-right-builtin/5000 3.467 ms 3.531 ms +1.8%
sum/hand-written-PLC/sum-right-Scott/100 34.66 μs 33.28 μs -4.0%
sum/hand-written-PLC/sum-right-Scott/500 182.0 μs 183.0 μs +0.5%
sum/hand-written-PLC/sum-right-Scott/1000 409.8 μs 404.9 μs -1.2%
sum/hand-written-PLC/sum-right-Scott/2500 1.368 ms 1.355 ms -1.0%
sum/hand-written-PLC/sum-right-Scott/5000 4.130 ms 4.072 ms -1.4%
sum/hand-written-PLC/sum-left-builtin/100 55.79 μs 55.02 μs -1.4%
sum/hand-written-PLC/sum-left-builtin/500 273.5 μs 270.3 μs -1.2%
sum/hand-written-PLC/sum-left-builtin/1000 542.5 μs 536.9 μs -1.0%
sum/hand-written-PLC/sum-left-builtin/2500 1.360 ms 1.338 ms -1.6%
sum/hand-written-PLC/sum-left-builtin/5000 2.708 ms 2.650 ms -2.1%
sum/hand-written-PLC/sum-left-Scott/100 38.83 μs 37.51 μs -3.4%
sum/hand-written-PLC/sum-left-Scott/500 209.8 μs 204.7 μs -2.4%
sum/hand-written-PLC/sum-left-Scott/1000 461.4 μs 453.3 μs -1.8%
sum/hand-written-PLC/sum-left-Scott/2500 1.604 ms 1.560 ms -2.7%
sum/hand-written-PLC/sum-left-Scott/5000 4.431 ms 4.369 ms -1.4%
684818d 5c2f60c Change
TOTAL 333.4 ms 336.0 ms +0.8%

@effectfully
Copy link
Contributor Author

(the results should be disregarded, I screwed up the implementation and made it slower than it can be)

@effectfully effectfully force-pushed the effectfully/ast/performance/use-SmallArray-instead-of-Vector branch from 5c2f60c to dbbd853 Compare April 3, 2025 20:52
@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@effectfully effectfully force-pushed the effectfully/ast/performance/use-SmallArray-instead-of-Vector branch from dbbd853 to ccca4dd Compare April 3, 2025 20:53
@effectfully
Copy link
Contributor Author

/benchmark lists

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

/benchmark nofib

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark nofib

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully effectfully mentioned this pull request Apr 3, 2025
Open
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Comparing benchmark results of 'lists' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
sort/ghcSort/50 181.1 μs 176.5 μs -2.5%
sort/ghcSort/100 419.0 μs 410.0 μs -2.1%
sort/ghcSort/150 721.3 μs 709.0 μs -1.7%
sort/ghcSort/200 970.5 μs 952.1 μs -1.9%
sort/ghcSort/250 1.257 ms 1.230 ms -2.1%
sort/ghcSort/300 1.652 ms 1.624 ms -1.7%
sort/insertionSort/50 609.1 μs 604.5 μs -0.8%
sort/insertionSort/100 2.446 ms 2.414 ms -1.3%
sort/insertionSort/150 5.553 ms 5.413 ms -2.5%
sort/insertionSort/200 9.960 ms 9.678 ms -2.8%
sort/insertionSort/250 15.49 ms 15.19 ms -1.9%
sort/insertionSort/300 22.37 ms 21.93 ms -2.0%
sort/mergeSort/50 542.0 μs 535.2 μs -1.3%
sort/mergeSort/100 1.244 ms 1.232 ms -1.0%
sort/mergeSort/150 2.004 ms 1.976 ms -1.4%
sort/mergeSort/200 2.812 ms 2.770 ms -1.5%
sort/mergeSort/250 3.691 ms 3.638 ms -1.4%
sort/mergeSort/300 4.492 ms 4.421 ms -1.6%
sort/quickSort/50 1.425 ms 1.399 ms -1.8%
sort/quickSort/100 5.904 ms 5.780 ms -2.1%
sort/quickSort/150 13.25 ms 12.99 ms -2.0%
sort/quickSort/200 23.54 ms 23.06 ms -2.0%
sort/quickSort/250 37.02 ms 36.22 ms -2.2%
sort/quickSort/300 53.06 ms 52.32 ms -1.4%
sum/compiled-from-Haskell/sum-right-builtin/100 77.87 μs 77.95 μs +0.1%
sum/compiled-from-Haskell/sum-right-builtin/500 405.8 μs 406.8 μs +0.2%
sum/compiled-from-Haskell/sum-right-builtin/1000 867.2 μs 865.7 μs -0.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.685 ms 2.655 ms -1.1%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.757 ms 5.751 ms -0.1%
sum/compiled-from-Haskell/sum-right-Scott/100 43.81 μs 43.98 μs +0.4%
sum/compiled-from-Haskell/sum-right-Scott/500 232.8 μs 232.5 μs -0.1%
sum/compiled-from-Haskell/sum-right-Scott/1000 493.2 μs 509.6 μs +3.3%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.721 ms 1.727 ms +0.3%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.129 ms 4.170 ms +1.0%
sum/compiled-from-Haskell/sum-right-data/100 257.9 μs 252.2 μs -2.2%
sum/compiled-from-Haskell/sum-right-data/500 1.475 ms 1.388 ms -5.9%
sum/compiled-from-Haskell/sum-right-data/1000 3.161 ms 3.116 ms -1.4%
sum/compiled-from-Haskell/sum-right-data/2500 8.477 ms 8.312 ms -1.9%
sum/compiled-from-Haskell/sum-right-data/5000 18.08 ms 17.74 ms -1.9%
sum/compiled-from-Haskell/sum-left-builtin/100 74.95 μs 76.13 μs +1.6%
sum/compiled-from-Haskell/sum-left-builtin/500 390.0 μs 394.3 μs +1.1%
sum/compiled-from-Haskell/sum-left-builtin/1000 835.9 μs 846.7 μs +1.3%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.577 ms 2.595 ms +0.7%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.673 ms 5.726 ms +0.9%
sum/compiled-from-Haskell/sum-left-Scott/100 42.54 μs 42.11 μs -1.0%
sum/compiled-from-Haskell/sum-left-Scott/500 223.8 μs 224.0 μs +0.1%
sum/compiled-from-Haskell/sum-left-Scott/1000 490.7 μs 491.1 μs +0.1%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.622 ms 1.629 ms +0.4%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.043 ms 4.083 ms +1.0%
sum/compiled-from-Haskell/sum-left-data/100 264.8 μs 259.5 μs -2.0%
sum/compiled-from-Haskell/sum-left-data/500 1.516 ms 1.439 ms -5.1%
sum/compiled-from-Haskell/sum-left-data/1000 3.294 ms 3.232 ms -1.9%
sum/compiled-from-Haskell/sum-left-data/2500 8.691 ms 8.597 ms -1.1%
sum/compiled-from-Haskell/sum-left-data/5000 18.47 ms 18.22 ms -1.4%
sum/hand-written-PLC/sum-right-builtin/100 52.13 μs 53.91 μs +3.4%
sum/hand-written-PLC/sum-right-builtin/500 268.9 μs 271.0 μs +0.8%
sum/hand-written-PLC/sum-right-builtin/1000 537.1 μs 558.3 μs +3.9%
sum/hand-written-PLC/sum-right-builtin/2500 1.562 ms 1.604 ms +2.7%
sum/hand-written-PLC/sum-right-builtin/5000 3.500 ms 3.542 ms +1.2%
sum/hand-written-PLC/sum-right-Scott/100 35.31 μs 34.97 μs -1.0%
sum/hand-written-PLC/sum-right-Scott/500 183.9 μs 187.6 μs +2.0%
sum/hand-written-PLC/sum-right-Scott/1000 412.0 μs 412.7 μs +0.2%
sum/hand-written-PLC/sum-right-Scott/2500 1.378 ms 1.373 ms -0.4%
sum/hand-written-PLC/sum-right-Scott/5000 4.127 ms 4.095 ms -0.8%
sum/hand-written-PLC/sum-left-builtin/100 55.54 μs 56.79 μs +2.3%
sum/hand-written-PLC/sum-left-builtin/500 273.4 μs 278.6 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/1000 545.5 μs 546.7 μs +0.2%
sum/hand-written-PLC/sum-left-builtin/2500 1.359 ms 1.373 ms +1.0%
sum/hand-written-PLC/sum-left-builtin/5000 2.702 ms 2.719 ms +0.6%
sum/hand-written-PLC/sum-left-Scott/100 38.23 μs 38.09 μs -0.4%
sum/hand-written-PLC/sum-left-Scott/500 206.8 μs 207.1 μs +0.1%
sum/hand-written-PLC/sum-left-Scott/1000 464.6 μs 457.7 μs -1.5%
sum/hand-written-PLC/sum-left-Scott/2500 1.587 ms 1.573 ms -0.9%
sum/hand-written-PLC/sum-left-Scott/5000 4.425 ms 4.394 ms -0.7%
2596b5b ccca4dd Change
TOTAL 330.4 ms 325.6 ms -1.5%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Comparing benchmark results of 'lists' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
sort/ghcSort/50 180.0 μs 176.7 μs -1.8%
sort/ghcSort/100 415.7 μs 410.7 μs -1.2%
sort/ghcSort/150 718.0 μs 707.4 μs -1.5%
sort/ghcSort/200 962.0 μs 952.3 μs -1.0%
sort/ghcSort/250 1.244 ms 1.229 ms -1.2%
sort/ghcSort/300 1.640 ms 1.620 ms -1.2%
sort/insertionSort/50 611.1 μs 604.5 μs -1.1%
sort/insertionSort/100 2.457 ms 2.415 ms -1.7%
sort/insertionSort/150 5.544 ms 5.416 ms -2.3%
sort/insertionSort/200 9.865 ms 9.681 ms -1.9%
sort/insertionSort/250 15.57 ms 15.15 ms -2.7%
sort/insertionSort/300 22.32 ms 21.97 ms -1.6%
sort/mergeSort/50 545.3 μs 536.2 μs -1.7%
sort/mergeSort/100 1.249 ms 1.230 ms -1.5%
sort/mergeSort/150 2.011 ms 1.974 ms -1.8%
sort/mergeSort/200 2.829 ms 2.770 ms -2.1%
sort/mergeSort/250 3.699 ms 3.629 ms -1.9%
sort/mergeSort/300 4.504 ms 4.420 ms -1.9%
sort/quickSort/50 1.422 ms 1.398 ms -1.7%
sort/quickSort/100 5.845 ms 5.770 ms -1.3%
sort/quickSort/150 13.14 ms 12.99 ms -1.1%
sort/quickSort/200 23.26 ms 22.98 ms -1.2%
sort/quickSort/250 36.56 ms 36.18 ms -1.0%
sort/quickSort/300 52.73 ms 52.38 ms -0.7%
sum/compiled-from-Haskell/sum-right-builtin/100 77.28 μs 78.21 μs +1.2%
sum/compiled-from-Haskell/sum-right-builtin/500 403.7 μs 406.7 μs +0.7%
sum/compiled-from-Haskell/sum-right-builtin/1000 857.5 μs 864.8 μs +0.9%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.633 ms 2.654 ms +0.8%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.701 ms 5.755 ms +0.9%
sum/compiled-from-Haskell/sum-right-Scott/100 43.49 μs 43.90 μs +0.9%
sum/compiled-from-Haskell/sum-right-Scott/500 230.8 μs 231.7 μs +0.4%
sum/compiled-from-Haskell/sum-right-Scott/1000 489.4 μs 508.1 μs +3.8%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.704 ms 1.725 ms +1.2%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.116 ms 4.168 ms +1.3%
sum/compiled-from-Haskell/sum-right-data/100 269.5 μs 252.3 μs -6.4%
sum/compiled-from-Haskell/sum-right-data/500 1.447 ms 1.393 ms -3.7%
sum/compiled-from-Haskell/sum-right-data/1000 3.157 ms 3.117 ms -1.3%
sum/compiled-from-Haskell/sum-right-data/2500 8.464 ms 8.342 ms -1.4%
sum/compiled-from-Haskell/sum-right-data/5000 18.04 ms 17.77 ms -1.5%
sum/compiled-from-Haskell/sum-left-builtin/100 75.14 μs 75.60 μs +0.6%
sum/compiled-from-Haskell/sum-left-builtin/500 390.5 μs 393.7 μs +0.8%
sum/compiled-from-Haskell/sum-left-builtin/1000 836.9 μs 846.2 μs +1.1%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.572 ms 2.584 ms +0.5%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.664 ms 5.698 ms +0.6%
sum/compiled-from-Haskell/sum-left-Scott/100 42.58 μs 42.03 μs -1.3%
sum/compiled-from-Haskell/sum-left-Scott/500 224.7 μs 224.3 μs -0.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 490.9 μs 490.1 μs -0.2%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.619 ms 1.627 ms +0.5%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.037 ms 4.078 ms +1.0%
sum/compiled-from-Haskell/sum-left-data/100 277.2 μs 260.5 μs -6.0%
sum/compiled-from-Haskell/sum-left-data/500 1.457 ms 1.439 ms -1.2%
sum/compiled-from-Haskell/sum-left-data/1000 3.275 ms 3.240 ms -1.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.705 ms 8.592 ms -1.3%
sum/compiled-from-Haskell/sum-left-data/5000 18.46 ms 18.23 ms -1.2%
sum/hand-written-PLC/sum-right-builtin/100 52.16 μs 53.15 μs +1.9%
sum/hand-written-PLC/sum-right-builtin/500 262.2 μs 270.9 μs +3.3%
sum/hand-written-PLC/sum-right-builtin/1000 540.5 μs 557.7 μs +3.2%
sum/hand-written-PLC/sum-right-builtin/2500 1.558 ms 1.604 ms +3.0%
sum/hand-written-PLC/sum-right-builtin/5000 3.458 ms 3.543 ms +2.5%
sum/hand-written-PLC/sum-right-Scott/100 34.79 μs 34.91 μs +0.3%
sum/hand-written-PLC/sum-right-Scott/500 182.8 μs 187.1 μs +2.4%
sum/hand-written-PLC/sum-right-Scott/1000 405.3 μs 413.5 μs +2.0%
sum/hand-written-PLC/sum-right-Scott/2500 1.364 ms 1.367 ms +0.2%
sum/hand-written-PLC/sum-right-Scott/5000 4.111 ms 4.093 ms -0.4%
sum/hand-written-PLC/sum-left-builtin/100 55.74 μs 56.86 μs +2.0%
sum/hand-written-PLC/sum-left-builtin/500 274.8 μs 277.8 μs +1.1%
sum/hand-written-PLC/sum-left-builtin/1000 544.0 μs 547.0 μs +0.6%
sum/hand-written-PLC/sum-left-builtin/2500 1.363 ms 1.373 ms +0.7%
sum/hand-written-PLC/sum-left-builtin/5000 2.702 ms 2.725 ms +0.9%
sum/hand-written-PLC/sum-left-Scott/100 38.92 μs 38.08 μs -2.2%
sum/hand-written-PLC/sum-left-Scott/500 206.7 μs 207.1 μs +0.2%
sum/hand-written-PLC/sum-left-Scott/1000 460.6 μs 456.6 μs -0.9%
sum/hand-written-PLC/sum-left-Scott/2500 1.583 ms 1.572 ms -0.7%
sum/hand-written-PLC/sum-left-Scott/5000 4.422 ms 4.388 ms -0.8%
2596b5b ccca4dd Change
TOTAL 328.7 ms 325.5 ms -1.0%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'nofib' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
clausify/formula1 2.202 ms 2.187 ms -0.7%
clausify/formula2 2.971 ms 2.953 ms -0.6%
clausify/formula3 8.243 ms 8.176 ms -0.8%
clausify/formula4 17.72 ms 17.69 ms -0.2%
clausify/formula5 40.15 ms 39.78 ms -0.9%
knights/4x4 14.86 ms 14.81 ms -0.3%
knights/6x6 36.46 ms 35.82 ms -1.8%
knights/8x8 63.15 ms 62.01 ms -1.8%
primetest/05digits 8.959 ms 9.139 ms +2.0%
primetest/10digits 17.49 ms 17.89 ms +2.3%
primetest/30digits 53.81 ms 55.36 ms +2.9%
primetest/50digits 88.80 ms 91.16 ms +2.7%
queens4x4/bt 4.125 ms 4.013 ms -2.7%
queens4x4/bm 5.061 ms 5.014 ms -0.9%
queens4x4/bjbt1 4.918 ms 4.791 ms -2.6%
queens4x4/bjbt2 4.645 ms 4.522 ms -2.6%
queens4x4/fc 10.12 ms 9.995 ms -1.2%
queens5x5/bt 57.45 ms 55.93 ms -2.6%
queens5x5/bm 58.07 ms 57.61 ms -0.8%
queens5x5/bjbt1 66.37 ms 64.87 ms -2.3%
queens5x5/bjbt2 64.40 ms 63.17 ms -1.9%
queens5x5/fc 128.2 ms 126.7 ms -1.2%
2596b5b ccca4dd Change
TOTAL 758.2 ms 753.6 ms -0.6%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'nofib' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
clausify/formula1 2.230 ms 2.171 ms -2.6%
clausify/formula2 3.010 ms 2.929 ms -2.7%
clausify/formula3 8.270 ms 8.101 ms -2.0%
clausify/formula4 17.79 ms 17.56 ms -1.3%
clausify/formula5 40.33 ms 39.48 ms -2.1%
knights/4x4 14.90 ms 14.62 ms -1.9%
knights/6x6 36.52 ms 35.73 ms -2.2%
knights/8x8 63.28 ms 61.88 ms -2.2%
primetest/05digits 8.937 ms 9.030 ms +1.0%
primetest/10digits 17.58 ms 17.64 ms +0.3%
primetest/30digits 53.85 ms 54.63 ms +1.4%
primetest/50digits 89.39 ms 90.06 ms +0.7%
queens4x4/bt 4.118 ms 4.013 ms -2.5%
queens4x4/bm 5.062 ms 5.009 ms -1.0%
queens4x4/bjbt1 4.921 ms 4.779 ms -2.9%
queens4x4/bjbt2 4.636 ms 4.514 ms -2.6%
queens4x4/fc 10.10 ms 9.969 ms -1.3%
queens5x5/bt 57.77 ms 55.95 ms -3.2%
queens5x5/bm 58.56 ms 57.48 ms -1.8%
queens5x5/bjbt1 66.99 ms 64.86 ms -3.2%
queens5x5/bjbt2 65.09 ms 63.06 ms -3.1%
queens5x5/fc 129.2 ms 126.6 ms -2.0%
2596b5b ccca4dd Change
TOTAL 762.5 ms 750.1 ms -1.6%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'validation' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
auction_1-1 164.7 μs 164.7 μs 0.0%
auction_1-2 528.1 μs 530.4 μs +0.4%
auction_1-3 534.1 μs 528.5 μs -1.0%
auction_1-4 213.5 μs 213.4 μs -0.0%
auction_2-1 164.1 μs 168.3 μs +2.6%
auction_2-2 525.1 μs 529.2 μs +0.8%
auction_2-3 676.7 μs 688.7 μs +1.8%
auction_2-4 524.3 μs 529.4 μs +1.0%
auction_2-5 218.9 μs 213.1 μs -2.6%
crowdfunding-success-1 193.3 μs 195.5 μs +1.1%
crowdfunding-success-2 192.8 μs 195.8 μs +1.6%
crowdfunding-success-3 192.6 μs 195.6 μs +1.6%
currency-1 210.5 μs 212.2 μs +0.8%
escrow-redeem_1-1 297.1 μs 304.8 μs +2.6%
escrow-redeem_1-2 298.4 μs 303.7 μs +1.8%
escrow-redeem_2-1 347.9 μs 356.6 μs +2.5%
escrow-redeem_2-2 348.4 μs 357.2 μs +2.5%
escrow-redeem_2-3 347.4 μs 357.4 μs +2.9%
escrow-refund-1 141.8 μs 145.6 μs +2.7%
future-increase-margin-1 210.8 μs 213.0 μs +1.0%
future-increase-margin-2 450.8 μs 468.7 μs +4.0%
future-increase-margin-3 448.4 μs 464.4 μs +3.6%
future-increase-margin-4 403.1 μs 412.1 μs +2.2%
future-increase-margin-5 683.6 μs 693.2 μs +1.4%
future-pay-out-1 211.2 μs 213.2 μs +0.9%
future-pay-out-2 450.7 μs 464.5 μs +3.1%
future-pay-out-3 449.5 μs 466.3 μs +3.7%
future-pay-out-4 683.4 μs 693.6 μs +1.5%
future-settle-early-1 210.9 μs 212.9 μs +0.9%
future-settle-early-2 448.8 μs 463.7 μs +3.3%
future-settle-early-3 450.4 μs 464.5 μs +3.1%
future-settle-early-4 518.7 μs 529.0 μs +2.0%
game-sm-success_1-1 335.2 μs 336.0 μs +0.2%
game-sm-success_1-2 183.8 μs 187.8 μs +2.2%
game-sm-success_1-3 527.0 μs 539.4 μs +2.4%
game-sm-success_1-4 214.0 μs 221.7 μs +3.6%
game-sm-success_2-1 330.1 μs 336.3 μs +1.9%
game-sm-success_2-2 183.4 μs 187.8 μs +2.4%
game-sm-success_2-3 529.6 μs 540.0 μs +2.0%
game-sm-success_2-4 212.5 μs 216.6 μs +1.9%
game-sm-success_2-5 529.5 μs 538.8 μs +1.8%
game-sm-success_2-6 213.6 μs 216.8 μs +1.5%
multisig-sm-1 335.0 μs 341.7 μs +2.0%
multisig-sm-2 325.7 μs 329.4 μs +1.1%
multisig-sm-3 338.5 μs 340.4 μs +0.6%
multisig-sm-4 333.4 μs 339.4 μs +1.8%
multisig-sm-5 465.3 μs 467.5 μs +0.5%
multisig-sm-6 333.4 μs 341.1 μs +2.3%
multisig-sm-7 325.0 μs 330.1 μs +1.6%
multisig-sm-8 327.1 μs 332.8 μs +1.7%
multisig-sm-9 331.1 μs 337.2 μs +1.8%
multisig-sm-10 460.5 μs 466.1 μs +1.2%
ping-pong-1 277.6 μs 279.7 μs +0.8%
ping-pong-2 275.4 μs 279.9 μs +1.6%
ping-pong_2-1 176.1 μs 180.5 μs +2.5%
prism-1 153.6 μs 157.1 μs +2.3%
prism-2 349.3 μs 358.5 μs +2.6%
prism-3 316.1 μs 322.4 μs +2.0%
pubkey-1 131.6 μs 134.1 μs +1.9%
stablecoin_1-1 795.7 μs 807.8 μs +1.5%
stablecoin_1-2 178.2 μs 183.0 μs +2.7%
stablecoin_1-3 911.8 μs 921.7 μs +1.1%
stablecoin_1-4 188.8 μs 193.2 μs +2.3%
stablecoin_1-5 1.148 ms 1.170 ms +1.9%
stablecoin_1-6 230.7 μs 239.2 μs +3.7%
stablecoin_2-1 792.9 μs 816.0 μs +2.9%
stablecoin_2-2 176.8 μs 183.2 μs +3.6%
stablecoin_2-3 910.3 μs 930.0 μs +2.2%
stablecoin_2-4 187.4 μs 193.6 μs +3.3%
token-account-1 162.2 μs 166.3 μs +2.5%
token-account-2 286.3 μs 295.3 μs +3.1%
uniswap-1 335.9 μs 341.8 μs +1.8%
uniswap-2 194.6 μs 201.5 μs +3.5%
uniswap-3 1.460 ms 1.456 ms -0.3%
uniswap-4 305.0 μs 311.2 μs +2.0%
uniswap-5 960.1 μs 984.6 μs +2.6%
uniswap-6 286.8 μs 304.6 μs +6.2%
vesting-1 291.0 μs 302.6 μs +4.0%
2596b5b ccca4dd Change
TOTAL 30.06 ms 30.61 ms +1.8%

@effectfully effectfully force-pushed the effectfully/ast/performance/use-SmallArray-instead-of-Vector branch from ccca4dd to a1911e0 Compare May 27, 2025 00:31
@effectfully
Copy link
Contributor Author

/benchmark nofib

2 similar comments
@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

2 similar comments
@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'nofib' on 'f17c02cb9' (base) and 'a1911e0e4' (PR)

Results table
Script f17c02c a1911e0 Change
clausify/formula1 2.215 ms 2.201 ms -0.6%
clausify/formula2 2.982 ms 2.974 ms -0.3%
clausify/formula3 8.317 ms 8.237 ms -1.0%
clausify/formula4 17.81 ms 17.64 ms -1.0%
clausify/formula5 40.24 ms 40.12 ms -0.3%
knights/4x4 14.79 ms 14.87 ms +0.5%
knights/6x6 36.11 ms 36.04 ms -0.2%
knights/8x8 62.60 ms 62.08 ms -0.8%
primetest/05digits 5.423 ms 5.446 ms +0.4%
primetest/10digits 10.66 ms 10.85 ms +1.8%
primetest/30digits 31.13 ms 31.26 ms +0.4%
primetest/50digits 50.65 ms 50.78 ms +0.3%
queens4x4/bt 4.089 ms 4.097 ms +0.2%
queens4x4/bm 5.097 ms 5.085 ms -0.2%
queens4x4/bjbt1 4.887 ms 4.886 ms -0.0%
queens4x4/bjbt2 4.605 ms 4.627 ms +0.5%
queens4x4/fc 10.17 ms 10.04 ms -1.3%
queens5x5/bt 56.95 ms 57.05 ms +0.2%
queens5x5/bm 58.39 ms 58.49 ms +0.2%
queens5x5/bjbt1 65.94 ms 65.81 ms -0.2%
queens5x5/bjbt2 64.11 ms 64.09 ms -0.0%
queens5x5/fc 128.9 ms 127.3 ms -1.2%
f17c02c a1911e0 Change
TOTAL 686.1 ms 684.0 ms -0.3%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'nofib' on 'f17c02cb9' (base) and 'a1911e0e4' (PR)

Results table
Script f17c02c a1911e0 Change
clausify/formula1 2.239 ms 2.205 ms -1.5%
clausify/formula2 3.031 ms 2.980 ms -1.7%
clausify/formula3 8.405 ms 8.262 ms -1.7%
clausify/formula4 18.19 ms 17.71 ms -2.6%
clausify/formula5 40.76 ms 40.13 ms -1.5%
knights/4x4 15.07 ms 14.99 ms -0.5%
knights/6x6 37.03 ms 36.05 ms -2.6%
knights/8x8 64.26 ms 62.05 ms -3.4%
primetest/05digits 5.407 ms 5.579 ms +3.2%
primetest/10digits 10.69 ms 11.03 ms +3.2%
primetest/30digits 31.22 ms 31.92 ms +2.2%
primetest/50digits 50.63 ms 51.79 ms +2.3%
queens4x4/bt 4.143 ms 4.100 ms -1.0%
queens4x4/bm 5.158 ms 5.042 ms -2.2%
queens4x4/bjbt1 4.956 ms 4.886 ms -1.4%
queens4x4/bjbt2 4.691 ms 4.624 ms -1.4%
queens4x4/fc 10.36 ms 10.05 ms -3.0%
queens5x5/bt 58.05 ms 56.85 ms -2.1%
queens5x5/bm 59.16 ms 58.06 ms -1.9%
queens5x5/bjbt1 66.77 ms 65.91 ms -1.3%
queens5x5/bjbt2 65.15 ms 64.21 ms -1.4%
queens5x5/fc 132.1 ms 127.4 ms -3.6%
f17c02c a1911e0 Change
TOTAL 697.5 ms 685.8 ms -1.7%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'nofib' on 'f17c02cb9' (base) and 'a1911e0e4' (PR)

Results table
Script f17c02c a1911e0 Change
clausify/formula1 2.208 ms 2.196 ms -0.5%
clausify/formula2 2.980 ms 2.972 ms -0.3%
clausify/formula3 8.236 ms 8.252 ms +0.2%
clausify/formula4 17.71 ms 17.67 ms -0.2%
clausify/formula5 40.13 ms 40.12 ms -0.0%
knights/4x4 14.73 ms 15.03 ms +2.0%
knights/6x6 35.96 ms 35.98 ms +0.1%
knights/8x8 62.79 ms 62.04 ms -1.2%
primetest/05digits 5.377 ms 5.464 ms +1.6%
primetest/10digits 10.64 ms 10.76 ms +1.1%
primetest/30digits 31.02 ms 31.28 ms +0.8%
primetest/50digits 50.29 ms 50.76 ms +0.9%
queens4x4/bt 4.082 ms 4.098 ms +0.4%
queens4x4/bm 5.074 ms 5.042 ms -0.6%
queens4x4/bjbt1 4.875 ms 4.891 ms +0.3%
queens4x4/bjbt2 4.636 ms 4.625 ms -0.2%
queens4x4/fc 10.14 ms 10.12 ms -0.2%
queens5x5/bt 57.04 ms 56.91 ms -0.2%
queens5x5/bm 58.32 ms 58.04 ms -0.5%
queens5x5/bjbt1 65.73 ms 65.90 ms +0.3%
queens5x5/bjbt2 64.27 ms 64.46 ms +0.3%
queens5x5/fc 129.1 ms 127.1 ms -1.5%
f17c02c a1911e0 Change
TOTAL 685.3 ms 683.7 ms -0.2%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'lists' on 'f17c02cb9' (base) and 'a1911e0e4' (PR)

Results table
Script f17c02c a1911e0 Change
sort/ghcSort/50 178.7 μs 173.7 μs -2.8%
sort/ghcSort/100 417.9 μs 403.9 μs -3.4%
sort/ghcSort/150 724.9 μs 699.7 μs -3.5%
sort/ghcSort/200 973.4 μs 945.6 μs -2.9%
sort/ghcSort/250 1.256 ms 1.220 ms -2.9%
sort/ghcSort/300 1.658 ms 1.604 ms -3.3%
sort/insertionSort/50 624.8 μs 595.1 μs -4.8%
sort/insertionSort/100 2.492 ms 2.368 ms -5.0%
sort/insertionSort/150 5.603 ms 5.320 ms -5.1%
sort/insertionSort/200 9.985 ms 9.531 ms -4.5%
sort/insertionSort/250 15.64 ms 14.90 ms -4.7%
sort/insertionSort/300 22.59 ms 21.61 ms -4.3%
sort/mergeSort/50 540.5 μs 532.3 μs -1.5%
sort/mergeSort/100 1.246 ms 1.220 ms -2.1%
sort/mergeSort/150 2.008 ms 1.969 ms -1.9%
sort/mergeSort/200 2.823 ms 2.753 ms -2.5%
sort/mergeSort/250 3.701 ms 3.612 ms -2.4%
sort/mergeSort/300 4.513 ms 4.420 ms -2.1%
sort/quickSort/50 1.433 ms 1.381 ms -3.6%
sort/quickSort/100 5.930 ms 5.725 ms -3.5%
sort/quickSort/150 13.32 ms 12.91 ms -3.1%
sort/quickSort/200 23.61 ms 22.88 ms -3.1%
sort/quickSort/250 37.20 ms 36.11 ms -2.9%
sort/quickSort/300 53.79 ms 52.33 ms -2.7%
sum/compiled-from-Haskell/sum-right-builtin/100 81.43 μs 79.76 μs -2.1%
sum/compiled-from-Haskell/sum-right-builtin/500 422.4 μs 413.2 μs -2.2%
sum/compiled-from-Haskell/sum-right-builtin/1000 902.9 μs 883.1 μs -2.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.753 ms 2.716 ms -1.3%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.945 ms 5.885 ms -1.0%
sum/compiled-from-Haskell/sum-right-Scott/100 44.80 μs 43.98 μs -1.8%
sum/compiled-from-Haskell/sum-right-Scott/500 241.8 μs 235.7 μs -2.5%
sum/compiled-from-Haskell/sum-right-Scott/1000 522.1 μs 511.4 μs -2.0%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.768 ms 1.738 ms -1.7%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.239 ms 4.191 ms -1.1%
sum/compiled-from-Haskell/sum-right-data/100 256.3 μs 252.7 μs -1.4%
sum/compiled-from-Haskell/sum-right-data/500 1.403 ms 1.386 ms -1.2%
sum/compiled-from-Haskell/sum-right-data/1000 3.150 ms 3.113 ms -1.2%
sum/compiled-from-Haskell/sum-right-data/2500 8.438 ms 8.414 ms -0.3%
sum/compiled-from-Haskell/sum-right-data/5000 17.78 ms 17.74 ms -0.2%
sum/compiled-from-Haskell/sum-left-builtin/100 79.34 μs 78.06 μs -1.6%
sum/compiled-from-Haskell/sum-left-builtin/500 416.5 μs 407.2 μs -2.2%
sum/compiled-from-Haskell/sum-left-builtin/1000 880.6 μs 867.4 μs -1.5%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.702 ms 2.651 ms -1.9%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.862 ms 5.774 ms -1.5%
sum/compiled-from-Haskell/sum-left-Scott/100 43.72 μs 42.72 μs -2.3%
sum/compiled-from-Haskell/sum-left-Scott/500 232.9 μs 224.5 μs -3.6%
sum/compiled-from-Haskell/sum-left-Scott/1000 509.5 μs 492.1 μs -3.4%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.693 ms 1.633 ms -3.5%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.214 ms 4.108 ms -2.5%
sum/compiled-from-Haskell/sum-left-data/100 258.0 μs 252.7 μs -2.1%
sum/compiled-from-Haskell/sum-left-data/500 1.407 ms 1.402 ms -0.4%
sum/compiled-from-Haskell/sum-left-data/1000 3.185 ms 3.166 ms -0.6%
sum/compiled-from-Haskell/sum-left-data/2500 8.436 ms 8.490 ms +0.6%
sum/compiled-from-Haskell/sum-left-data/5000 17.92 ms 17.85 ms -0.4%
sum/hand-written-PLC/sum-right-builtin/100 53.60 μs 52.04 μs -2.9%
sum/hand-written-PLC/sum-right-builtin/500 269.8 μs 264.2 μs -2.1%
sum/hand-written-PLC/sum-right-builtin/1000 557.5 μs 545.2 μs -2.2%
sum/hand-written-PLC/sum-right-builtin/2500 1.607 ms 1.572 ms -2.2%
sum/hand-written-PLC/sum-right-builtin/5000 3.557 ms 3.495 ms -1.7%
sum/hand-written-PLC/sum-right-Scott/100 35.01 μs 34.00 μs -2.9%
sum/hand-written-PLC/sum-right-Scott/500 188.4 μs 182.8 μs -3.0%
sum/hand-written-PLC/sum-right-Scott/1000 417.5 μs 397.9 μs -4.7%
sum/hand-written-PLC/sum-right-Scott/2500 1.380 ms 1.349 ms -2.2%
sum/hand-written-PLC/sum-right-Scott/5000 4.096 ms 4.036 ms -1.5%
sum/hand-written-PLC/sum-left-builtin/100 55.85 μs 54.33 μs -2.7%
sum/hand-written-PLC/sum-left-builtin/500 281.8 μs 271.1 μs -3.8%
sum/hand-written-PLC/sum-left-builtin/1000 558.9 μs 540.3 μs -3.3%
sum/hand-written-PLC/sum-left-builtin/2500 1.393 ms 1.342 ms -3.7%
sum/hand-written-PLC/sum-left-builtin/5000 2.779 ms 2.659 ms -4.3%
sum/hand-written-PLC/sum-left-Scott/100 39.01 μs 38.00 μs -2.6%
sum/hand-written-PLC/sum-left-Scott/500 214.3 μs 207.5 μs -3.2%
sum/hand-written-PLC/sum-left-Scott/1000 472.8 μs 463.9 μs -1.9%
sum/hand-written-PLC/sum-left-Scott/2500 1.628 ms 1.598 ms -1.8%
sum/hand-written-PLC/sum-left-Scott/5000 4.515 ms 4.486 ms -0.6%
f17c02c a1911e0 Change
TOTAL 332.1 ms 323.8 ms -2.5%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'lists' on 'f17c02cb9' (base) and 'a1911e0e4' (PR)

Results table
Script f17c02c a1911e0 Change
sort/ghcSort/50 174.8 μs 174.2 μs -0.3%
sort/ghcSort/100 408.9 μs 404.5 μs -1.1%
sort/ghcSort/150 709.5 μs 701.6 μs -1.1%
sort/ghcSort/200 954.7 μs 946.7 μs -0.8%
sort/ghcSort/250 1.232 ms 1.223 ms -0.7%
sort/ghcSort/300 1.620 ms 1.608 ms -0.7%
sort/insertionSort/50 606.1 μs 595.9 μs -1.7%
sort/insertionSort/100 2.411 ms 2.383 ms -1.2%
sort/insertionSort/150 5.414 ms 5.348 ms -1.2%
sort/insertionSort/200 9.657 ms 9.563 ms -1.0%
sort/insertionSort/250 15.14 ms 14.96 ms -1.2%
sort/insertionSort/300 21.89 ms 21.63 ms -1.2%
sort/mergeSort/50 532.7 μs 537.6 μs +0.9%
sort/mergeSort/100 1.225 ms 1.232 ms +0.6%
sort/mergeSort/150 1.978 ms 1.995 ms +0.9%
sort/mergeSort/200 2.778 ms 2.774 ms -0.1%
sort/mergeSort/250 3.645 ms 3.645 ms 0.0%
sort/mergeSort/300 4.436 ms 4.472 ms +0.8%
sort/quickSort/50 1.402 ms 1.383 ms -1.4%
sort/quickSort/100 5.792 ms 5.740 ms -0.9%
sort/quickSort/150 13.28 ms 12.97 ms -2.3%
sort/quickSort/200 23.05 ms 22.94 ms -0.5%
sort/quickSort/250 36.44 ms 36.26 ms -0.5%
sort/quickSort/300 52.52 ms 52.30 ms -0.4%
sum/compiled-from-Haskell/sum-right-builtin/100 80.04 μs 80.35 μs +0.4%
sum/compiled-from-Haskell/sum-right-builtin/500 415.1 μs 417.9 μs +0.7%
sum/compiled-from-Haskell/sum-right-builtin/1000 887.0 μs 891.3 μs +0.5%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.724 ms 2.736 ms +0.4%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.872 ms 5.908 ms +0.6%
sum/compiled-from-Haskell/sum-right-Scott/100 44.73 μs 44.13 μs -1.3%
sum/compiled-from-Haskell/sum-right-Scott/500 239.7 μs 235.8 μs -1.6%
sum/compiled-from-Haskell/sum-right-Scott/1000 518.4 μs 513.4 μs -1.0%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.756 ms 1.749 ms -0.4%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.214 ms 4.210 ms -0.1%
sum/compiled-from-Haskell/sum-right-data/100 253.3 μs 255.5 μs +0.9%
sum/compiled-from-Haskell/sum-right-data/500 1.385 ms 1.393 ms +0.6%
sum/compiled-from-Haskell/sum-right-data/1000 3.119 ms 3.137 ms +0.6%
sum/compiled-from-Haskell/sum-right-data/2500 8.410 ms 8.412 ms +0.0%
sum/compiled-from-Haskell/sum-right-data/5000 17.67 ms 17.76 ms +0.5%
sum/compiled-from-Haskell/sum-left-builtin/100 77.88 μs 78.70 μs +1.1%
sum/compiled-from-Haskell/sum-left-builtin/500 407.9 μs 410.4 μs +0.6%
sum/compiled-from-Haskell/sum-left-builtin/1000 866.2 μs 872.4 μs +0.7%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.666 ms 2.678 ms +0.5%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.800 ms 5.833 ms +0.6%
sum/compiled-from-Haskell/sum-left-Scott/100 42.97 μs 43.08 μs +0.3%
sum/compiled-from-Haskell/sum-left-Scott/500 229.3 μs 226.8 μs -1.1%
sum/compiled-from-Haskell/sum-left-Scott/1000 499.6 μs 494.6 μs -1.0%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.668 ms 1.656 ms -0.7%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.172 ms 4.130 ms -1.0%
sum/compiled-from-Haskell/sum-left-data/100 251.8 μs 254.5 μs +1.1%
sum/compiled-from-Haskell/sum-left-data/500 1.398 ms 1.412 ms +1.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.154 ms 3.199 ms +1.4%
sum/compiled-from-Haskell/sum-left-data/2500 8.399 ms 8.505 ms +1.3%
sum/compiled-from-Haskell/sum-left-data/5000 17.83 ms 17.93 ms +0.6%
sum/hand-written-PLC/sum-right-builtin/100 52.99 μs 52.59 μs -0.8%
sum/hand-written-PLC/sum-right-builtin/500 264.7 μs 266.7 μs +0.8%
sum/hand-written-PLC/sum-right-builtin/1000 550.7 μs 548.9 μs -0.3%
sum/hand-written-PLC/sum-right-builtin/2500 1.631 ms 1.587 ms -2.7%
sum/hand-written-PLC/sum-right-builtin/5000 3.548 ms 3.521 ms -0.8%
sum/hand-written-PLC/sum-right-Scott/100 35.01 μs 34.38 μs -1.8%
sum/hand-written-PLC/sum-right-Scott/500 188.5 μs 182.0 μs -3.4%
sum/hand-written-PLC/sum-right-Scott/1000 416.1 μs 406.8 μs -2.2%
sum/hand-written-PLC/sum-right-Scott/2500 1.380 ms 1.360 ms -1.4%
sum/hand-written-PLC/sum-right-Scott/5000 4.098 ms 4.054 ms -1.1%
sum/hand-written-PLC/sum-left-builtin/100 55.28 μs 54.74 μs -1.0%
sum/hand-written-PLC/sum-left-builtin/500 277.3 μs 272.3 μs -1.8%
sum/hand-written-PLC/sum-left-builtin/1000 553.5 μs 541.2 μs -2.2%
sum/hand-written-PLC/sum-left-builtin/2500 1.379 ms 1.346 ms -2.4%
sum/hand-written-PLC/sum-left-builtin/5000 2.736 ms 2.688 ms -1.8%
sum/hand-written-PLC/sum-left-Scott/100 38.88 μs 39.15 μs +0.7%
sum/hand-written-PLC/sum-left-Scott/500 215.4 μs 208.2 μs -3.3%
sum/hand-written-PLC/sum-left-Scott/1000 473.2 μs 468.2 μs -1.1%
sum/hand-written-PLC/sum-left-Scott/2500 1.623 ms 1.609 ms -0.9%
sum/hand-written-PLC/sum-left-Scott/5000 4.530 ms 4.514 ms -0.4%
f17c02c a1911e0 Change
TOTAL 326.4 ms 325.0 ms -0.4%

@github-actions GitHub Actions
Copy link
Contributor

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

Comparing benchmark results of 'lists' on 'f17c02cb9' (base) and 'a1911e0e4' (PR)

Results table
Script f17c02c a1911e0 Change
sort/ghcSort/50 174.3 μs 174.7 μs +0.2%
sort/ghcSort/100 407.9 μs 405.0 μs -0.7%
sort/ghcSort/150 706.8 μs 703.3 μs -0.5%
sort/ghcSort/200 949.2 μs 947.6 μs -0.2%
sort/ghcSort/250 1.227 ms 1.226 ms -0.1%
sort/ghcSort/300 1.619 ms 1.607 ms -0.7%
sort/insertionSort/50 605.1 μs 598.8 μs -1.0%
sort/insertionSort/100 2.409 ms 2.362 ms -2.0%
sort/insertionSort/150 5.404 ms 5.341 ms -1.2%
sort/insertionSort/200 9.654 ms 9.512 ms -1.5%
sort/insertionSort/250 15.11 ms 14.96 ms -1.0%
sort/insertionSort/300 21.83 ms 21.64 ms -0.9%
sort/mergeSort/50 527.7 μs 537.4 μs +1.8%
sort/mergeSort/100 1.217 ms 1.230 ms +1.1%
sort/mergeSort/150 1.965 ms 1.988 ms +1.2%
sort/mergeSort/200 2.745 ms 2.788 ms +1.6%
sort/mergeSort/250 3.610 ms 3.671 ms +1.7%
sort/mergeSort/300 4.410 ms 4.474 ms +1.5%
sort/quickSort/50 1.394 ms 1.386 ms -0.6%
sort/quickSort/100 5.768 ms 5.761 ms -0.1%
sort/quickSort/150 12.99 ms 12.99 ms 0.0%
sort/quickSort/200 23.00 ms 22.96 ms -0.2%
sort/quickSort/250 36.31 ms 36.31 ms 0.0%
sort/quickSort/300 52.23 ms 52.35 ms +0.2%
sum/compiled-from-Haskell/sum-right-builtin/100 79.21 μs 81.80 μs +3.3%
sum/compiled-from-Haskell/sum-right-builtin/500 421.3 μs 424.6 μs +0.8%
sum/compiled-from-Haskell/sum-right-builtin/1000 882.2 μs 900.3 μs +2.1%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.780 ms 2.757 ms -0.8%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.851 ms 5.972 ms +2.1%
sum/compiled-from-Haskell/sum-right-Scott/100 44.25 μs 44.41 μs +0.4%
sum/compiled-from-Haskell/sum-right-Scott/500 238.5 μs 236.4 μs -0.9%
sum/compiled-from-Haskell/sum-right-Scott/1000 516.4 μs 514.9 μs -0.3%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.754 ms 1.746 ms -0.5%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.216 ms 4.216 ms 0.0%
sum/compiled-from-Haskell/sum-right-data/100 250.6 μs 260.5 μs +4.0%
sum/compiled-from-Haskell/sum-right-data/500 1.385 ms 1.423 ms +2.7%
sum/compiled-from-Haskell/sum-right-data/1000 3.098 ms 3.195 ms +3.1%
sum/compiled-from-Haskell/sum-right-data/2500 8.364 ms 8.586 ms +2.7%
sum/compiled-from-Haskell/sum-right-data/5000 17.65 ms 18.13 ms +2.7%
sum/compiled-from-Haskell/sum-left-builtin/100 77.30 μs 81.91 μs +6.0%
sum/compiled-from-Haskell/sum-left-builtin/500 405.5 μs 424.3 μs +4.6%
sum/compiled-from-Haskell/sum-left-builtin/1000 862.1 μs 899.4 μs +4.3%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.645 ms 2.744 ms +3.7%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.770 ms 5.948 ms +3.1%
sum/compiled-from-Haskell/sum-left-Scott/100 42.92 μs 43.04 μs +0.3%
sum/compiled-from-Haskell/sum-left-Scott/500 230.6 μs 227.3 μs -1.4%
sum/compiled-from-Haskell/sum-left-Scott/1000 505.0 μs 494.9 μs -2.0%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.664 ms 1.642 ms -1.3%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.154 ms 4.132 ms -0.5%
sum/compiled-from-Haskell/sum-left-data/100 249.7 μs 262.1 μs +5.0%
sum/compiled-from-Haskell/sum-left-data/500 1.381 ms 1.448 ms +4.9%
sum/compiled-from-Haskell/sum-left-data/1000 3.148 ms 3.248 ms +3.2%
sum/compiled-from-Haskell/sum-left-data/2500 8.429 ms 8.598 ms +2.0%
sum/compiled-from-Haskell/sum-left-data/5000 17.71 ms 18.33 ms +3.5%
sum/hand-written-PLC/sum-right-builtin/100 52.56 μs 52.71 μs +0.3%
sum/hand-written-PLC/sum-right-builtin/500 264.3 μs 267.5 μs +1.2%
sum/hand-written-PLC/sum-right-builtin/1000 549.0 μs 550.9 μs +0.3%
sum/hand-written-PLC/sum-right-builtin/2500 1.586 ms 1.586 ms 0.0%
sum/hand-written-PLC/sum-right-builtin/5000 3.511 ms 3.520 ms +0.3%
sum/hand-written-PLC/sum-right-Scott/100 34.60 μs 34.51 μs -0.3%
sum/hand-written-PLC/sum-right-Scott/500 185.6 μs 184.1 μs -0.8%
sum/hand-written-PLC/sum-right-Scott/1000 414.3 μs 407.5 μs -1.6%
sum/hand-written-PLC/sum-right-Scott/2500 1.369 ms 1.361 ms -0.6%
sum/hand-written-PLC/sum-right-Scott/5000 4.067 ms 4.054 ms -0.3%
sum/hand-written-PLC/sum-left-builtin/100 55.66 μs 54.69 μs -1.7%
sum/hand-written-PLC/sum-left-builtin/500 277.8 μs 272.3 μs -2.0%
sum/hand-written-PLC/sum-left-builtin/1000 546.8 μs 540.6 μs -1.1%
sum/hand-written-PLC/sum-left-builtin/2500 1.364 ms 1.346 ms -1.3%
sum/hand-written-PLC/sum-left-builtin/5000 2.720 ms 2.690 ms -1.1%
sum/hand-written-PLC/sum-left-Scott/100 38.47 μs 38.24 μs -0.6%
sum/hand-written-PLC/sum-left-Scott/500 212.2 μs 212.2 μs 0.0%
sum/hand-written-PLC/sum-left-Scott/1000 468.1 μs 462.4 μs -1.2%
sum/hand-written-PLC/sum-left-Scott/2500 1.611 ms 1.615 ms +0.2%
sum/hand-written-PLC/sum-left-Scott/5000 4.509 ms 4.503 ms -0.1%
f17c02c a1911e0 Change
TOTAL 324.9 ms 326.7 ms +0.5%

@effectfully
Copy link
Contributor Author

#7012 looks better for nofib and is more "conservative" of a change, since Vector is backed by Array, so let's prefer that one in favor of this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@effectfully effectfully

Labels
AST Evaluation EXPERIMENT Experiments that we probably don't want to merge Performance
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@effectfully