Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

graph: use slices package for sorting and reversing slices #1957

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

jbduncan
Copy link
Contributor

@jbduncan jbduncan commented Mar 6, 2024

This PR introduces a modernization change that is not necessarily related to #617 but which was spun out from my attempts at generifying the leaves of graph. Benchmarks to follow.

Blocked by #1940 and #1953.

@jbduncan jbduncan force-pushed the 617-graph-slices-sort-and-reverse branch from 403c650 to 7110b3b Compare March 8, 2024 16:33
@jbduncan
Copy link
Contributor Author

As discussed in #1956 (comment), I'll more than happy to check if new benchmarks are needed first.

@kortschak
Copy link
Member

This needs to pick up the changes in master.

@jbduncan jbduncan force-pushed the 617-graph-slices-sort-and-reverse branch from 7110b3b to 20c5128 Compare March 16, 2024 13:58
@jbduncan
Copy link
Contributor Author

This needs to pick up the changes in master.

Done. I'll pick them up again if #1953 is merged in.

@codecov-commenter
Copy link

codecov-commenter commented Mar 16, 2024

Codecov Report

Attention: Patch coverage is 70.00000% with 18 lines in your changes are missing coverage. Please review.

Project coverage is 72.38%. Comparing base (1858083) to head (20c5128).
Report is 388 commits behind head on master.

Current head 20c5128 differs from pull request most recent head 44b16ea

Please upload reports for the commit 44b16ea to get more accurate results.

Files Patch % Lines
graph/internal/ordered/sort.go 0.00% 11 Missing ⚠️
internal/sorted/sort.go 0.00% 7 Missing ⚠️

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1957      +/-   ##
==========================================
+ Coverage   71.46%   72.38%   +0.92%     
==========================================
  Files         489      557      +68     
  Lines       54288    65108   +10820     
==========================================
+ Hits        38797    47130    +8333     
- Misses      13086    15376    +2290     
- Partials     2405     2602     +197     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@kortschak kortschak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please reorder the commits so that the benchmarks are introduced first and then show the perf impacts of the change.

@jbduncan jbduncan force-pushed the 617-graph-slices-sort-and-reverse branch from 1951a3f to 60d4652 Compare April 14, 2024 13:25
@jbduncan
Copy link
Contributor Author

Please reorder the commits so that the benchmarks are introduced first and then show the perf impacts of the change.

Okay, commits re-ordered!

I intend to rebase and run the benchmarks as soon as prerequisite PR #1953 is merged in.

@jbduncan jbduncan force-pushed the 617-graph-slices-sort-and-reverse branch from 60d4652 to 357673e Compare April 14, 2024 13:38
@jbduncan jbduncan force-pushed the 617-graph-slices-sort-and-reverse branch 3 times, most recently from f7672bf to 8ee84f7 Compare May 12, 2024 16:43
@jbduncan jbduncan force-pushed the 617-graph-slices-sort-and-reverse branch 2 times, most recently from 029bb6e to 3fca49f Compare May 24, 2024 08:22
Copy link
Member

@kortschak kortschak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What are the benchmarking outcomes from the non-coloring.Set changes?

graph/coloring/coloring_test.go Outdated Show resolved Hide resolved
@jbduncan
Copy link
Contributor Author

What are the benchmarking outcomes from the non-coloring.Set changes?

Thanks for checking! I'm not finished with my benchmarks yet. I ran them last night, but I made a mistake where I ran them on this branch and master whereas I should have run them on both commits in this branch instead. Stay tuned.

@jbduncan jbduncan force-pushed the 617-graph-slices-sort-and-reverse branch from 3fca49f to 44b16ea Compare May 25, 2024 08:16
@jbduncan
Copy link
Contributor Author

Here are the benchmarks. I'm not sure what to make of them. WDYT?

Benchmarks
goos: darwin
goarch: arm64
pkg: gonum.org/v1/gonum/graph/coloring
                                                     │  bench.old   │               bench.new               │
                                                     │    sec/op    │    sec/op      vs base                │
Coloring/empty/Dsatur-8                                  3.196n ±  0%    3.191n ±  0%        ~ (p=0.164 n=10)
Coloring/empty/DsaturExact-8                             3.191n ±  1%    3.191n ±  0%        ~ (p=0.489 n=10)
Coloring/empty/Randomized-8                              3.192n ±  0%    3.191n ±  0%        ~ (p=0.722 n=10)
Coloring/empty/RecursiveLargestFirst-8                   3.191n ±  0%    3.191n ±  0%        ~ (p=0.180 n=10)
Coloring/empty/SanSegundo-8                              3.190n ±  0%    3.191n ±  0%        ~ (p=0.329 n=10)
Coloring/empty/WelshPowell-8                             3.191n ±  1%    3.191n ±  0%        ~ (p=0.512 n=10)
Coloring/singleton/Dsatur-8                              414.6n ±  0%    416.8n ±  0%   +0.54% (p=0.000 n=10)
Coloring/singleton/DsaturExact-8                         962.6n ±  0%    965.2n ±  0%   +0.26% (p=0.037 n=10)
Coloring/singleton/Randomized-8                          236.7n ±  1%    238.5n ±  0%   +0.74% (p=0.022 n=10)
Coloring/singleton/RecursiveLargestFirst-8               298.7n ±  0%    298.9n ±  0%        ~ (p=0.156 n=10)
Coloring/singleton/SanSegundo-8                          415.3n ±  0%    417.1n ±  0%   +0.43% (p=0.001 n=10)
Coloring/singleton/WelshPowell-8                         289.9n ±  0%    291.6n ±  0%   +0.57% (p=0.001 n=10)
Coloring/kite/Dsatur-8                                   3.332µ ±  2%    3.384µ ±  0%   +1.58% (p=0.022 n=10)
Coloring/kite/DsaturExact-8                              17.99µ ±  0%    18.26µ ±  1%   +1.46% (p=0.000 n=10)
Coloring/kite/Randomized-8                               1.177µ ±  0%    1.197µ ±  0%   +1.70% (p=0.000 n=10)
Coloring/kite/RecursiveLargestFirst-8                    2.267µ ±  0%    2.269µ ±  0%   +0.09% (p=0.015 n=10)
Coloring/kite/SanSegundo-8                               4.043µ ±  0%    4.106µ ±  0%   +1.55% (p=0.000 n=10)
Coloring/kite/WelshPowell-8                              1.410µ ±  0%    1.435µ ±  0%   +1.77% (p=0.001 n=10)
Coloring/triangle+1/Dsatur-8                             2.106µ ±  0%    2.147µ ±  1%   +1.95% (p=0.000 n=10)
Coloring/triangle+1/DsaturExact-8                        10.14µ ±  0%    10.26µ ±  0%   +1.24% (p=0.000 n=10)
Coloring/triangle+1/Randomized-8                         820.3n ±  0%    839.7n ±  0%   +2.37% (p=0.000 n=10)
Coloring/triangle+1/RecursiveLargestFirst-8              1.453µ ±  1%    1.457µ ±  0%   +0.24% (p=0.048 n=10)
Coloring/triangle+1/SanSegundo-8                         2.452µ ±  0%    2.491µ ±  0%   +1.61% (p=0.000 n=10)
Coloring/triangle+1/WelshPowell-8                        983.6n ±  0%   1002.0n ±  2%   +1.88% (p=0.000 n=10)
Coloring/bipartite_halves/Dsatur-8                       8.054µ ±  0%    8.176µ ±  0%   +1.51% (p=0.000 n=10)
Coloring/bipartite_halves/DsaturExact-8                  33.32µ ±  1%    33.68µ ±  0%   +1.07% (p=0.001 n=10)
Coloring/bipartite_halves/Randomized-8                   2.196µ ±  0%    2.218µ ±  0%   +1.00% (p=0.000 n=10)
Coloring/bipartite_halves/RecursiveLargestFirst-8        4.027µ ±  0%    4.010µ ±  0%   -0.42% (p=0.030 n=10)
Coloring/bipartite_halves/SanSegundo-8                   15.25µ ±  0%    15.43µ ±  0%   +1.18% (p=0.000 n=10)
Coloring/bipartite_halves/WelshPowell-8                  2.401µ ±  0%    2.447µ ±  0%   +1.90% (p=0.000 n=10)
Coloring/bipartite_alternating/Dsatur-8                  7.924µ ±  2%    8.061µ ±  0%   +1.73% (p=0.022 n=10)
Coloring/bipartite_alternating/DsaturExact-8             33.12µ ±  0%    33.53µ ±  0%   +1.22% (p=0.002 n=10)
Coloring/bipartite_alternating/Randomized-8              2.178µ ±  0%    2.204µ ±  1%   +1.22% (p=0.000 n=10)
Coloring/bipartite_alternating/RecursiveLargestFirst-8   3.986µ ±  0%    3.975µ ±  0%   -0.30% (p=0.000 n=10)
Coloring/bipartite_alternating/SanSegundo-8              15.37µ ±  1%    15.50µ ±  0%   +0.82% (p=0.003 n=10)
Coloring/bipartite_alternating/WelshPowell-8             2.534µ ±  1%    2.536µ ±  0%        ~ (p=0.322 n=10)
Coloring/3/4_bipartite/Dsatur-8                          6.468µ ±  0%    6.548µ ±  0%   +1.23% (p=0.000 n=10)
Coloring/3/4_bipartite/DsaturExact-8                     30.60µ ±  0%    30.91µ ±  1%   +1.02% (p=0.000 n=10)
Coloring/3/4_bipartite/Randomized-8                      1.869µ ±  0%    1.896µ ±  0%   +1.47% (p=0.000 n=10)
Coloring/3/4_bipartite/RecursiveLargestFirst-8           3.566µ ±  1%    3.549µ ±  0%   -0.46% (p=0.000 n=10)
Coloring/3/4_bipartite/SanSegundo-8                      13.46µ ±  0%    13.56µ ±  0%   +0.80% (p=0.000 n=10)
Coloring/3/4_bipartite/WelshPowell-8                     2.250µ ±  0%    2.279µ ±  0%   +1.29% (p=0.001 n=10)
Coloring/cubical/Dsatur-8                                8.074µ ±  0%    8.184µ ±  0%   +1.37% (p=0.000 n=10)
Coloring/cubical/DsaturExact-8                           33.55µ ±  0%    33.89µ ±  0%   +1.02% (p=0.000 n=10)
Coloring/cubical/Randomized-8                            2.211µ ±  2%    2.232µ ±  1%   +0.95% (p=0.017 n=10)
Coloring/cubical/RecursiveLargestFirst-8                 4.097µ ±  0%    4.089µ ±  0%   -0.18% (p=0.022 n=10)
Coloring/cubical/SanSegundo-8                            15.43µ ±  0%    15.56µ ±  0%   +0.83% (p=0.000 n=10)
Coloring/cubical/WelshPowell-8                           2.522µ ±  0%    2.562µ ±  0%   +1.61% (p=0.000 n=10)
Coloring/HoG33106/Dsatur-8                               19.15µ ±  0%    19.37µ ±  0%   +1.11% (p=0.000 n=10)
Coloring/HoG33106/DsaturExact-8                          74.02µ ±  0%    74.72µ ±  0%   +0.94% (p=0.002 n=10)
Coloring/HoG33106/Randomized-8                           4.056µ ±  0%    4.082µ ±  1%   +0.65% (p=0.000 n=10)
Coloring/HoG33106/RecursiveLargestFirst-8                8.855µ ±  0%    8.848µ ±  0%        ~ (p=0.196 n=10)
Coloring/HoG33106/SanSegundo-8                           69.19µ ±  1%    69.78µ ±  0%   +0.85% (p=0.003 n=10)
Coloring/HoG33106/WelshPowell-8                          5.007µ ±  0%    5.056µ ±  0%   +1.00% (p=0.000 n=10)
Coloring/HoG41237/Dsatur-8                               206.0m ±  0%    212.4m ±  1%   +3.09% (p=0.000 n=10)
Coloring/HoG41237/DsaturExact-8                          225.3m ±  0%    232.4m ±  0%   +3.15% (p=0.000 n=10)
Coloring/HoG41237/Randomized-8                           2.411m ±  2%    2.405m ±  0%   -0.22% (p=0.007 n=10)
Coloring/HoG41237/RecursiveLargestFirst-8                8.755m ±  0%    8.810m ±  1%   +0.63% (p=0.001 n=10)
Coloring/HoG41237/SanSegundo-8                           495.9m ±  1%    501.5m ±  0%   +1.12% (p=0.003 n=10)
Coloring/HoG41237/WelshPowell-8                          3.581m ±  1%    3.606m ±  1%   +0.69% (p=0.009 n=10)
Coloring/exams/Dsatur-8                                  4.686µ ±  0%    4.742µ ±  0%   +1.21% (p=0.000 n=10)
Coloring/exams/DsaturExact-8                             26.82µ ±  0%    27.17µ ±  1%   +1.29% (p=0.000 n=10)
Coloring/exams/Randomized-8                              1.524µ ±  0%    1.545µ ±  0%   +1.34% (p=0.000 n=10)
Coloring/exams/RecursiveLargestFirst-8                   3.108µ ±  2%    3.079µ ±  0%   -0.95% (p=0.000 n=10)
Coloring/exams/SanSegundo-8                              7.514µ ±  0%    7.582µ ±  0%   +0.91% (p=0.000 n=10)
Coloring/exams/WelshPowell-8                             1.847µ ±  0%    1.870µ ±  0%   +1.25% (p=0.000 n=10)
Coloring/exam_scheduler_1/Dsatur-8                       18.09µ ±  0%    18.32µ ±  1%   +1.25% (p=0.000 n=10)
Coloring/exam_scheduler_1/DsaturExact-8                  100.4µ ±  0%    101.5µ ±  0%   +1.08% (p=0.000 n=10)
Coloring/exam_scheduler_1/Randomized-8                   4.322µ ±  2%    4.353µ ±  0%   +0.71% (p=0.023 n=10)
Coloring/exam_scheduler_1/RecursiveLargestFirst-8        11.49µ ±  0%    11.46µ ±  0%   -0.27% (p=0.006 n=10)
Coloring/exam_scheduler_1/SanSegundo-8                   27.86µ ±  0%    28.10µ ±  0%   +0.89% (p=0.000 n=10)
Coloring/exam_scheduler_1/WelshPowell-8                  4.759µ ±  0%    4.834µ ±  0%   +1.58% (p=0.000 n=10)
Coloring/exam_scheduler_2/Dsatur-8                       8.432µ ±  0%    8.552µ ±  0%   +1.42% (p=0.000 n=10)
Coloring/exam_scheduler_2/DsaturExact-8                  48.77µ ±  0%    49.02µ ±  0%   +0.53% (p=0.001 n=10)
Coloring/exam_scheduler_2/Randomized-8                   2.371µ ±  0%    2.396µ ±  0%   +1.03% (p=0.000 n=10)
Coloring/exam_scheduler_2/RecursiveLargestFirst-8        5.243µ ±  0%    5.233µ ±  1%   -0.19% (p=0.022 n=10)
Coloring/exam_scheduler_2/SanSegundo-8                   12.89µ ±  0%    13.08µ ±  0%   +1.44% (p=0.000 n=10)
Coloring/exam_scheduler_2/WelshPowell-8                  2.769µ ±  4%    2.809µ ±  0%   +1.44% (p=0.022 n=10)
Coloring/Brélaz/Dsatur-8                                 12.23µ ±  0%    12.36µ ±  0%   +1.04% (p=0.000 n=10)
Coloring/Brélaz/DsaturExact-8                            60.25µ ±  0%    60.79µ ±  1%   +0.90% (p=0.000 n=10)
Coloring/Brélaz/Randomized-8                             3.116µ ±  0%    3.142µ ±  0%   +0.83% (p=0.000 n=10)
Coloring/Brélaz/RecursiveLargestFirst-8                  7.655µ ±  1%    7.645µ ±  0%   -0.14% (p=0.018 n=10)
Coloring/Brélaz/SanSegundo-8                             18.62µ ±  0%    18.75µ ±  0%   +0.68% (p=0.000 n=10)
Coloring/Brélaz/WelshPowell-8                            3.743µ ±  0%    3.784µ ±  0%   +1.11% (p=0.000 n=10)
Coloring/Lima_Carmo/Dsatur-8                             7.617µ ±  0%    7.723µ ±  1%   +1.39% (p=0.000 n=10)
Coloring/Lima_Carmo/DsaturExact-8                        33.09µ ±  0%    33.41µ ±  0%   +0.97% (p=0.000 n=10)
Coloring/Lima_Carmo/Randomized-8                         2.107µ ±  1%    2.124µ ±  0%   +0.78% (p=0.019 n=10)
Coloring/Lima_Carmo/RecursiveLargestFirst-8              4.242µ ±  0%    4.216µ ±  0%   -0.62% (p=0.000 n=10)
Coloring/Lima_Carmo/SanSegundo-8                         11.35µ ±  0%    11.48µ ±  0%   +1.13% (p=0.000 n=10)
Coloring/Lima_Carmo/WelshPowell-8                        2.502µ ±  0%    2.532µ ±  2%   +1.20% (p=0.000 n=10)
Coloring/San_Segundo/Dsatur-8                            12.92µ ±  0%    13.03µ ±  0%   +0.88% (p=0.000 n=10)
Coloring/San_Segundo/DsaturExact-8                       121.3µ ±  2%    121.8µ ±  0%   +0.37% (p=0.029 n=10)
Coloring/San_Segundo/Randomized-8                        3.484µ ±  0%    3.498µ ±  0%   +0.40% (p=0.000 n=10)
Coloring/San_Segundo/RecursiveLargestFirst-8             9.289µ ±  0%    9.242µ ±  0%   -0.51% (p=0.001 n=10)
Coloring/San_Segundo/SanSegundo-8                        22.82µ ±  0%    22.94µ ±  0%   +0.50% (p=0.019 n=10)
Coloring/San_Segundo/WelshPowell-8                       3.635µ ±  2%    3.684µ ±  5%   +1.33% (p=0.006 n=10)
Coloring/tetrahedron/Dsatur-8                            2.415µ ±  0%    2.466µ ±  3%   +2.13% (p=0.000 n=10)
Coloring/tetrahedron/DsaturExact-8                       13.75µ ±  0%    13.91µ ±  0%   +1.15% (p=0.000 n=10)
Coloring/tetrahedron/Randomized-8                        941.4n ±  0%    962.0n ±  1%   +2.19% (p=0.000 n=10)
Coloring/tetrahedron/RecursiveLargestFirst-8             1.890µ ±  1%    1.883µ ±  0%   -0.40% (p=0.000 n=10)
Coloring/tetrahedron/SanSegundo-8                        3.370µ ±  0%    3.408µ ±  0%   +1.13% (p=0.001 n=10)
Coloring/tetrahedron/WelshPowell-8                       1.078µ ±  0%    1.099µ ±  0%   +2.00% (p=0.000 n=10)
Coloring/triangle/Dsatur-8                               1.498µ ±  0%    1.529µ ±  2%   +2.04% (p=0.000 n=10)
Coloring/triangle/DsaturExact-8                          7.365µ ±  0%    7.390µ ±  0%   +0.33% (p=0.000 n=10)
Coloring/triangle/Randomized-8                           647.1n ±  0%    659.4n ±  0%   +1.91% (p=0.001 n=10)
Coloring/triangle/RecursiveLargestFirst-8                1.171µ ±  0%    1.171µ ±  0%        ~ (p=0.822 n=10)
Coloring/triangle/SanSegundo-8                           1.844µ ±  0%    1.869µ ±  0%   +1.38% (p=0.000 n=10)
Coloring/triangle/WelshPowell-8                          780.7n ±  0%    793.0n ±  0%   +1.58% (p=0.000 n=10)
Coloring/square/Dsatur-8                                 2.226µ ±  2%    2.268µ ±  0%   +1.89% (p=0.003 n=10)
Coloring/square/DsaturExact-8                            10.94µ ±  0%    11.11µ ±  0%   +1.53% (p=0.000 n=10)
Coloring/square/Randomized-8                             867.5n ±  0%    884.6n ±  0%   +1.98% (p=0.000 n=10)
Coloring/square/RecursiveLargestFirst-8                  1.451µ ±  0%    1.448µ ±  0%   -0.24% (p=0.000 n=10)
Coloring/square/SanSegundo-8                             2.843µ ±  0%    2.889µ ±  0%   +1.64% (p=0.000 n=10)
Coloring/square/WelshPowell-8                            1.034µ ±  3%    1.050µ ±  0%   +1.60% (p=0.018 n=10)
Coloring/cycle-5/Dsatur-8                                3.263µ ±  0%    3.302µ ±  0%   +1.18% (p=0.000 n=10)
Coloring/cycle-5/DsaturExact-8                           19.39µ ±  0%    19.58µ ±  1%   +0.95% (p=0.000 n=10)
Coloring/cycle-5/Randomized-8                            1.139µ ±  0%    1.155µ ±  0%   +1.40% (p=0.000 n=10)
Coloring/cycle-5/RecursiveLargestFirst-8                 2.154µ ±  0%    2.148µ ±  1%   -0.26% (p=0.049 n=10)
Coloring/cycle-5/SanSegundo-8                            4.200µ ±  2%    4.240µ ±  0%   +0.93% (p=0.022 n=10)
Coloring/cycle-5/WelshPowell-8                           1.381µ ±  0%    1.392µ ±  0%   +0.80% (p=0.000 n=10)
Coloring/cycle-6/Dsatur-8                                4.355µ ±  0%    4.426µ ±  0%   +1.63% (p=0.000 n=10)
Coloring/cycle-6/DsaturExact-8                           18.53µ ±  0%    18.66µ ±  0%   +0.74% (p=0.000 n=10)
Coloring/cycle-6/Randomized-8                            1.395µ ±  1%    1.409µ ±  0%   +1.04% (p=0.001 n=10)
Coloring/cycle-6/RecursiveLargestFirst-8                 2.529µ ±  0%    2.520µ ±  0%   -0.34% (p=0.005 n=10)
Coloring/cycle-6/SanSegundo-8                            5.634µ ±  0%    5.701µ ±  0%   +1.19% (p=0.000 n=10)
Coloring/cycle-6/WelshPowell-8                           1.686µ ±  0%    1.704µ ±  0%   +1.04% (p=0.000 n=10)
Coloring/wheel-5/Dsatur-8                                3.493µ ±  0%    3.535µ ±  0%   +1.19% (p=0.000 n=10)
Coloring/wheel-5/DsaturExact-8                           23.15µ ±  1%    23.32µ ±  0%   +0.75% (p=0.002 n=10)
Coloring/wheel-5/Randomized-8                            1.244µ ±  0%    1.261µ ±  0%   +1.33% (p=0.000 n=10)
Coloring/wheel-5/RecursiveLargestFirst-8                 2.435µ ±  0%    2.422µ ±  0%   -0.51% (p=0.000 n=10)
Coloring/wheel-5/SanSegundo-8                            5.236µ ±  0%    5.294µ ±  1%   +1.11% (p=0.000 n=10)
Coloring/wheel-5/WelshPowell-8                           1.414µ ±  0%    1.434µ ±  0%   +1.45% (p=0.000 n=10)
Coloring/wheel-6/Dsatur-8                                4.911µ ±  1%    4.966µ ±  0%   +1.12% (p=0.014 n=10)
Coloring/wheel-6/DsaturExact-8                           38.40µ ±  0%    38.61µ ±  0%   +0.54% (p=0.000 n=10)
Coloring/wheel-6/Randomized-8                            1.616µ ±  0%    1.633µ ±  2%   +1.08% (p=0.000 n=10)
Coloring/wheel-6/RecursiveLargestFirst-8                 3.373µ ±  0%    3.357µ ±  0%   -0.50% (p=0.000 n=10)
Coloring/wheel-6/SanSegundo-8                            7.642µ ±  0%    7.716µ ±  0%   +0.97% (p=0.000 n=10)
Coloring/wheel-6/WelshPowell-8                           1.829µ ±  1%    1.850µ ±  0%   +1.18% (p=0.001 n=10)
Coloring/wheel-7/Dsatur-8                                6.403µ ±  0%    6.489µ ±  0%   +1.34% (p=0.000 n=10)
Coloring/wheel-7/DsaturExact-8                           39.86µ ±  0%    40.20µ ±  0%   +0.86% (p=0.000 n=10)
Coloring/wheel-7/Randomized-8                            1.972µ ±  0%    1.993µ ±  0%   +1.04% (p=0.000 n=10)
Coloring/wheel-7/RecursiveLargestFirst-8                 4.010µ ±  1%    3.991µ ±  0%   -0.47% (p=0.000 n=10)
Coloring/wheel-7/SanSegundo-8                            10.30µ ±  0%    10.38µ ±  0%   +0.79% (p=0.000 n=10)
Coloring/wheel-7/WelshPowell-8                           2.204µ ±  0%    2.232µ ±  0%   +1.29% (p=0.000 n=10)
Coloring/sudoku_board/Dsatur-8                           21.39m ±  0%    21.47m ±  0%   +0.34% (p=0.000 n=10)
Coloring/sudoku_board/DsaturExact-8                      85.97m ±  0%    86.19m ±  1%        ~ (p=0.739 n=10)
Coloring/sudoku_board/Randomized-8                       583.0µ ±  2%    580.8µ ±  0%   -0.37% (p=0.000 n=10)
Coloring/sudoku_board/RecursiveLargestFirst-8            3.856m ±  0%    3.901m ±  0%   +1.16% (p=0.000 n=10)
Coloring/sudoku_board/SanSegundo-8                       25.49m ±  0%    25.71m ±  1%   +0.89% (p=0.000 n=10)
Coloring/sudoku_board/WelshPowell-8                      687.4µ ±  0%    689.5µ ±  0%   +0.30% (p=0.000 n=10)
Coloring/sudoku_problem/Dsatur-8                         32.53m ±  2%    32.26m ±  0%   -0.81% (p=0.000 n=10)
Coloring/sudoku_problem/DsaturExact-8                     4.297 ± 94%     5.256 ± 65%        ~ (p=0.529 n=10)
Coloring/sudoku_problem/Randomized-8                     824.9µ ±  0%    821.6µ ±  0%   -0.41% (p=0.000 n=10)
Coloring/sudoku_problem/RecursiveLargestFirst-8          5.718m ±  1%    5.817m ±  0%   +1.74% (p=0.002 n=10)
Coloring/sudoku_problem/SanSegundo-8                     35.45m ±  0%    35.65m ±  1%   +0.57% (p=0.000 n=10)
Coloring/sudoku_problem/WelshPowell-8                    964.7µ ±  0%    961.0µ ±  0%   -0.38% (p=0.000 n=10)
Coloring/cs_shc/Dsatur-8                                 3.383µ ±  0%    3.424µ ±  0%   +1.23% (p=0.000 n=10)
Coloring/cs_shc/DsaturExact-8                            20.63µ ±  1%    20.78µ ±  0%   +0.76% (p=0.022 n=10)
Coloring/cs_shc/Randomized-8                             1.216µ ±  0%    1.230µ ±  0%   +1.19% (p=0.000 n=10)
Coloring/cs_shc/RecursiveLargestFirst-8                  2.429µ ±  0%    2.419µ ±  2%   -0.41% (p=0.022 n=10)
Coloring/cs_shc/SanSegundo-8                             5.180µ ±  0%    5.230µ ±  0%   +0.97% (p=0.000 n=10)
Coloring/cs_shc/WelshPowell-8                            1.435µ ±  0%    1.456µ ±  0%   +1.46% (p=0.000 n=10)
Coloring/gis_hc/Dsatur-8                                 4.029µ ±  1%    4.078µ ±  0%   +1.20% (p=0.001 n=10)
Coloring/gis_hc/DsaturExact-8                            17.03µ ±  0%    17.13µ ±  0%   +0.59% (p=0.000 n=10)
Coloring/gis_hc/Randomized-8                             1.310µ ±  0%    1.325µ ±  1%   +1.15% (p=0.000 n=10)
Coloring/gis_hc/RecursiveLargestFirst-8                  2.353µ ±  0%    2.347µ ±  0%   -0.28% (p=0.000 n=10)
Coloring/gis_hc/SanSegundo-8                             7.548µ ±  0%    7.610µ ±  0%   +0.82% (p=0.000 n=10)
Coloring/gis_hc/WelshPowell-8                            1.673µ ±  1%    1.691µ ±  0%   +1.08% (p=0.011 n=10)
Coloring/gis_shc|rs_shc/Dsatur-8                         2.107µ ±  0%    2.136µ ±  0%   +1.35% (p=0.000 n=10)
Coloring/gis_shc|rs_shc/DsaturExact-8                    9.854µ ±  0%    9.979µ ±  2%   +1.26% (p=0.000 n=10)
Coloring/gis_shc|rs_shc/Randomized-8                     827.9n ±  0%    841.1n ±  0%   +1.60% (p=0.000 n=10)
Coloring/gis_shc|rs_shc/RecursiveLargestFirst-8          1.376µ ±  1%    1.369µ ±  0%   -0.51% (p=0.010 n=10)
Coloring/gis_shc|rs_shc/SanSegundo-8                     2.744µ ±  0%    2.776µ ±  0%   +1.17% (p=0.000 n=10)
Coloring/gis_shc|rs_shc/WelshPowell-8                    1.029µ ±  0%    1.045µ ±  2%   +1.55% (p=0.000 n=10)
Coloring/lf_hc/Dsatur-8                                  6.200µ ±  1%    6.272µ ±  0%   +1.16% (p=0.001 n=10)
Coloring/lf_hc/DsaturExact-8                             32.76µ ±  0%    32.96µ ±  0%   +0.62% (p=0.000 n=10)
Coloring/lf_hc/Randomized-8                              1.901µ ±  1%    1.916µ ±  0%   +0.76% (p=0.002 n=10)
Coloring/lf_hc/RecursiveLargestFirst-8                   3.778µ ±  0%    3.747µ ±  0%   -0.81% (p=0.000 n=10)
Coloring/lf_hc/SanSegundo-8                              10.41µ ±  0%    10.49µ ±  1%   +0.79% (p=0.000 n=10)
Coloring/lf_hc/WelshPowell-8                             2.094µ ±  0%    2.119µ ±  0%   +1.24% (p=0.000 n=10)
Coloring/lf_shc/Dsatur-8                                 4.128µ ±  0%    4.175µ ±  0%   +1.15% (p=0.000 n=10)
Coloring/lf_shc/DsaturExact-8                            17.07µ ±  1%    17.15µ ±  0%   +0.51% (p=0.023 n=10)
Coloring/lf_shc/Randomized-8                             1.345µ ±  0%    1.354µ ±  0%   +0.63% (p=0.000 n=10)
Coloring/lf_shc/RecursiveLargestFirst-8                  2.456µ ±  0%    2.451µ ±  1%   -0.20% (p=0.036 n=10)
Coloring/lf_shc/SanSegundo-8                             4.506µ ±  0%    4.552µ ±  0%   +1.03% (p=0.000 n=10)
Coloring/lf_shc/WelshPowell-8                            1.618µ ±  0%    1.633µ ±  0%   +0.93% (p=0.000 n=10)
Coloring/lfi_hc/Dsatur-8                                 10.60µ ±  1%    10.70µ ±  0%   +0.89% (p=0.002 n=10)
Coloring/lfi_hc/DsaturExact-8                            68.19µ ±  0%    68.31µ ±  0%   +0.18% (p=0.005 n=10)
Coloring/lfi_hc/Randomized-8                             2.740µ ±  0%    2.755µ ±  0%   +0.57% (p=0.000 n=10)
Coloring/lfi_hc/RecursiveLargestFirst-8                  5.999µ ±  0%    5.956µ ±  0%   -0.72% (p=0.000 n=10)
Coloring/lfi_hc/SanSegundo-8                             14.16µ ±  0%    14.25µ ±  0%   +0.65% (p=0.001 n=10)
Coloring/lfi_hc/WelshPowell-8                            3.154µ ±  0%    3.182µ ±  1%   +0.90% (p=0.000 n=10)
Coloring/lfi_shc|slf_shc/Dsatur-8                        6.292µ ±  0%    6.377µ ±  2%   +1.34% (p=0.000 n=10)
Coloring/lfi_shc|slf_shc/DsaturExact-8                   39.51µ ±  0%    39.61µ ±  0%   +0.23% (p=0.000 n=10)
Coloring/lfi_shc|slf_shc/Randomized-8                    1.856µ ±  0%    1.872µ ±  0%   +0.86% (p=0.001 n=10)
Coloring/lfi_shc|slf_shc/RecursiveLargestFirst-8         3.598µ ±  0%    3.566µ ±  0%   -0.89% (p=0.000 n=10)
Coloring/lfi_shc|slf_shc/SanSegundo-8                    7.226µ ±  0%    7.317µ ±  0%   +1.26% (p=0.000 n=10)
Coloring/lfi_shc|slf_shc/WelshPowell-8                   2.158µ ±  0%    2.184µ ±  0%   +1.20% (p=0.000 n=10)
Coloring/no_solo/Dsatur-8                                16.95µ ±  0%    17.10µ ±  0%   +0.89% (p=0.000 n=10)
Coloring/no_solo/DsaturExact-8                           55.00µ ±  1%    55.38µ ±  0%   +0.70% (p=0.023 n=10)
Coloring/no_solo/Randomized-8                            3.490µ ±  0%    3.509µ ±  0%   +0.56% (p=0.000 n=10)
Coloring/no_solo/RecursiveLargestFirst-8                 7.755µ ±  0%    7.736µ ±  0%   -0.25% (p=0.030 n=10)
Coloring/no_solo/SanSegundo-8                            25.46µ ±  0%    25.66µ ±  0%   +0.76% (p=0.000 n=10)
Coloring/no_solo/WelshPowell-8                           4.431µ ±  0%    4.473µ ±  0%   +0.93% (p=0.000 n=10)
Coloring/sl_hc/Dsatur-8                                  8.857µ ±  1%    8.962µ ±  0%   +1.19% (p=0.001 n=10)
Coloring/sl_hc/DsaturExact-8                             75.34µ ±  0%    75.61µ ±  1%   +0.35% (p=0.000 n=10)
Coloring/sl_hc/Randomized-8                              2.478µ ±  2%    2.489µ ±  0%   +0.44% (p=0.024 n=10)
Coloring/sl_hc/RecursiveLargestFirst-8                   5.333µ ±  0%    5.299µ ±  0%   -0.64% (p=0.001 n=10)
Coloring/sl_hc/SanSegundo-8                              12.16µ ±  2%    12.26µ ±  0%   +0.86% (p=0.022 n=10)
Coloring/sl_hc/WelshPowell-8                             2.712µ ±  0%    2.743µ ±  0%   +1.12% (p=0.000 n=10)
Coloring/sl_shc/Dsatur-8                                 4.854µ ±  0%    4.913µ ±  0%   +1.23% (p=0.000 n=10)
Coloring/sl_shc/DsaturExact-8                            25.62µ ±  0%    25.83µ ±  0%   +0.84% (p=0.000 n=10)
Coloring/sl_shc/Randomized-8                             1.556µ ±  0%    1.567µ ±  0%   +0.74% (p=0.000 n=10)
Coloring/sl_shc/RecursiveLargestFirst-8                  3.035µ ±  2%    3.023µ ±  0%   -0.38% (p=0.000 n=10)
Coloring/sl_shc/SanSegundo-8                             7.080µ ±  0%    7.135µ ±  0%   +0.78% (p=0.000 n=10)
Coloring/sl_shc/WelshPowell-8                            1.779µ ±  0%    1.801µ ±  0%   +1.21% (p=0.000 n=10)
Coloring/slf_hc/Dsatur-8                                 7.992µ ±  0%    8.089µ ±  0%   +1.21% (p=0.000 n=10)
Coloring/slf_hc/DsaturExact-8                            50.50µ ±  1%    50.68µ ±  0%   +0.34% (p=0.029 n=10)
Coloring/slf_hc/Randomized-8                             2.209µ ±  0%    2.226µ ±  0%   +0.72% (p=0.000 n=10)
Coloring/slf_hc/RecursiveLargestFirst-8                  4.709µ ±  0%    4.695µ ±  1%        ~ (p=0.239 n=10)
Coloring/slf_hc/SanSegundo-8                             13.37µ ±  0%    13.42µ ±  0%   +0.40% (p=0.002 n=10)
Coloring/slf_hc/WelshPowell-8                            2.583µ ±  0%    2.616µ ±  0%   +1.26% (p=0.000 n=10)
Coloring/sli_hc/Dsatur-8                                 12.51µ ±  0%    12.64µ ±  0%   +1.04% (p=0.001 n=10)
Coloring/sli_hc/DsaturExact-8                            129.7µ ±  0%    129.6µ ±  0%        ~ (p=0.280 n=10)
Coloring/sli_hc/Randomized-8                             3.299µ ±  0%    3.312µ ±  1%   +0.39% (p=0.000 n=10)
Coloring/sli_hc/RecursiveLargestFirst-8                  8.527µ ±  0%    8.446µ ±  0%   -0.95% (p=0.000 n=10)
Coloring/sli_hc/SanSegundo-8                             16.90µ ±  0%    17.00µ ±  0%   +0.59% (p=0.002 n=10)
Coloring/sli_hc/WelshPowell-8                            3.422µ ±  1%    3.456µ ±  0%   +0.99% (p=0.001 n=10)
Coloring/sli_shc/Dsatur-8                                6.355µ ±  0%    6.431µ ±  0%   +1.19% (p=0.000 n=10)
Coloring/sli_shc/DsaturExact-8                           31.48µ ±  0%    31.76µ ±  0%   +0.90% (p=0.000 n=10)
Coloring/sli_shc/Randomized-8                            1.909µ ±  0%    1.925µ ±  0%   +0.84% (p=0.000 n=10)
Coloring/sli_shc/RecursiveLargestFirst-8                 3.860µ ±  1%    3.836µ ±  0%   -0.62% (p=0.000 n=10)
Coloring/sli_shc/SanSegundo-8                            10.31µ ±  0%    10.39µ ±  0%   +0.76% (p=0.000 n=10)
Coloring/sli_shc/WelshPowell-8                           2.177µ ±  0%    2.201µ ±  1%   +1.13% (p=0.000 n=10)
Coloring/rsi_shc/Dsatur-8                                4.610µ ±  0%    4.672µ ±  0%   +1.35% (p=0.000 n=10)
Coloring/rsi_shc/DsaturExact-8                           23.76µ ±  0%    23.95µ ±  0%   +0.78% (p=0.000 n=10)
Coloring/rsi_shc/Randomized-8                            1.500µ ±  1%    1.512µ ±  0%   +0.80% (p=0.006 n=10)
Coloring/rsi_shc/RecursiveLargestFirst-8                 2.920µ ±  0%    2.905µ ±  0%   -0.50% (p=0.000 n=10)
Coloring/rsi_shc/SanSegundo-8                            5.689µ ±  0%    5.745µ ±  1%   +0.99% (p=0.000 n=10)
Coloring/rsi_shc/WelshPowell-8                           1.741µ ±  0%    1.762µ ±  0%   +1.24% (p=0.000 n=10)
Coloring/V_plus_not_in_A_cal/Dsatur-8                    9.014µ ±  0%    9.111µ ±  0%   +1.06% (p=0.000 n=10)
Coloring/V_plus_not_in_A_cal/DsaturExact-8               33.34µ ±  0%    33.56µ ±  0%   +0.66% (p=0.002 n=10)
Coloring/V_plus_not_in_A_cal/Randomized-8                2.325µ ±  0%    2.336µ ±  1%   +0.43% (p=0.000 n=10)
Coloring/V_plus_not_in_A_cal/RecursiveLargestFirst-8     4.926µ ±  0%    4.902µ ±  1%   -0.49% (p=0.022 n=10)
Coloring/V_plus_not_in_A_cal/SanSegundo-8                10.80µ ±  0%    10.92µ ±  0%   +1.08% (p=0.000 n=10)
Coloring/V_plus_not_in_A_cal/WelshPowell-8               2.831µ ±  0%    2.862µ ±  0%   +1.11% (p=0.000 n=10)
Coloring/queen5_5/Dsatur-8                               288.2µ ±  2%    290.5µ ±  0%   +0.81% (p=0.023 n=10)
Coloring/queen5_5/DsaturExact-8                          2.477m ±  0%    2.492m ±  2%   +0.62% (p=0.000 n=10)
Coloring/queen5_5/Randomized-8                           28.94µ ±  0%    28.97µ ±  0%        ~ (p=0.494 n=10)
Coloring/queen5_5/RecursiveLargestFirst-8                100.9µ ±  0%    100.5µ ±  0%   -0.41% (p=0.000 n=10)
Coloring/queen5_5/SanSegundo-8                           590.0µ ±  0%    592.2µ ±  0%   +0.37% (p=0.002 n=10)
Coloring/queen5_5/WelshPowell-8                          32.39µ ±  0%    32.41µ ±  0%        ~ (p=0.305 n=10)
Coloring/queen6_6/Dsatur-8                               1.157m ±  0%    1.163m ±  0%   +0.57% (p=0.000 n=10)
Coloring/queen6_6/DsaturExact-8                          189.2m ± 22%    151.1m ± 20%  -20.16% (p=0.029 n=10)
Coloring/queen6_6/Randomized-8                           75.74µ ±  0%    75.43µ ±  0%   -0.41% (p=0.000 n=10)
Coloring/queen6_6/RecursiveLargestFirst-8                375.7µ ±  0%    375.6µ ±  2%        ~ (p=0.912 n=10)
Coloring/queen6_6/SanSegundo-8                           1.449m ±  0%    1.461m ±  0%   +0.84% (p=0.000 n=10)
Coloring/queen6_6/WelshPowell-8                          86.86µ ±  0%    86.64µ ±  0%   -0.26% (p=0.005 n=10)
Coloring/queen7_7/Dsatur-8                               3.649m ±  2%    3.648m ±  0%        ~ (p=0.684 n=10)
Coloring/queen7_7/DsaturExact-8                           1.727 ± 75%     1.249 ± 43%        ~ (p=0.075 n=10)
Coloring/queen7_7/Randomized-8                           170.7µ ±  2%    170.7µ ±  0%        ~ (p=0.853 n=10)
Coloring/queen7_7/RecursiveLargestFirst-8                982.9µ ±  0%    981.7µ ±  0%        ~ (p=0.218 n=10)
Coloring/queen7_7/SanSegundo-8                           4.278m ±  1%    4.301m ±  1%   +0.55% (p=0.009 n=10)
Coloring/queen7_7/WelshPowell-8                          196.5µ ±  0%    196.9µ ±  0%   +0.22% (p=0.000 n=10)
Coloring/queen8_8/Dsatur-8                               10.20m ±  2%    10.22m ±  0%        ~ (p=0.105 n=10)
Coloring/queen8_8/Randomized-8                           365.5µ ±  0%    365.4µ ±  0%        ~ (p=0.579 n=10)
Coloring/queen8_8/RecursiveLargestFirst-8                2.294m ±  0%    2.329m ±  0%   +1.52% (p=0.000 n=10)
Coloring/queen8_8/SanSegundo-8                           11.50m ±  0%    11.56m ±  0%   +0.54% (p=0.000 n=10)
Coloring/queen8_8/WelshPowell-8                          426.1µ ±  0%    427.5µ ±  0%   +0.32% (p=0.000 n=10)
geomean                                                  11.28µ          11.35µ         +0.61%

pkg: gonum.org/v1/gonum/graph/community
                                                  │  bench.old   │             bench.new              │
                                                  │    sec/op    │   sec/op     vs base               │
KCliqueCommunities/simple-k=3-8                        33.39µ ± 0%   32.18µ ± 1%  -3.62% (p=0.000 n=10)
KCliqueCommunities/Batagelj-Zaversnik_Graph-k=3-8     101.64µ ± 0%   97.99µ ± 0%  -3.59% (p=0.002 n=10)
KCliqueCommunities/Batagelj-Zaversnik_Graph-k=4-8     101.53µ ± 0%   98.08µ ± 0%  -3.41% (p=0.000 n=10)
LouvainDirectedMultiplex-8                             11.72m ± 0%   11.71m ± 0%       ~ (p=0.912 n=10)
NewDirectedLayers/graphSize=1,numGraphs=1-8            134.9n ± 1%   132.9n ± 0%  -1.45% (p=0.001 n=10)
NewDirectedLayers/graphSize=1,numGraphs=10-8           1.719µ ± 0%   1.694µ ± 0%  -1.45% (p=0.001 n=10)
NewDirectedLayers/graphSize=10,numGraphs=1-8           501.1n ± 1%   496.8n ± 1%  -0.86% (p=0.008 n=10)
NewDirectedLayers/graphSize=10,numGraphs=10-8          7.682µ ± 1%   7.665µ ± 0%       ~ (p=0.481 n=10)
NewDirectedLayers/graphSize=1000,numGraphs=1-8         64.43µ ± 0%   64.48µ ± 0%  +0.08% (p=0.050 n=10)
NewDirectedLayers/graphSize=1000,numGraphs=10-8        856.7µ ± 2%   857.1µ ± 0%       ~ (p=0.529 n=10)
NewDirectedLayers/graphSize=100000,numGraphs=1-8       6.430m ± 0%   6.430m ± 0%       ~ (p=0.912 n=10)
NewDirectedLayers/graphSize=100000,numGraphs=10-8      93.30m ± 0%   93.34m ± 0%       ~ (p=0.280 n=10)
LouvainDirected-8                                      10.11m ± 0%   10.06m ± 0%  -0.53% (p=0.000 n=10)
LouvainMultiplex-8                                     7.728m ± 0%   7.759m ± 0%  +0.40% (p=0.009 n=10)
NewUndirectedLayers/graphSize=1,numGraphs=1-8          135.5n ± 0%   134.1n ± 0%  -1.07% (p=0.000 n=10)
NewUndirectedLayers/graphSize=1,numGraphs=10-8         2.085µ ± 0%   2.071µ ± 0%  -0.67% (p=0.000 n=10)
NewUndirectedLayers/graphSize=10,numGraphs=1-8         499.7n ± 1%   499.1n ± 1%       ~ (p=0.305 n=10)
NewUndirectedLayers/graphSize=10,numGraphs=10-8        8.082µ ± 1%   8.047µ ± 0%       ~ (p=0.101 n=10)
NewUndirectedLayers/graphSize=1000,numGraphs=1-8       64.57µ ± 0%   64.51µ ± 0%       ~ (p=0.796 n=10)
NewUndirectedLayers/graphSize=1000,numGraphs=10-8      862.2µ ± 0%   862.3µ ± 0%       ~ (p=0.739 n=10)
NewUndirectedLayers/graphSize=100000,numGraphs=1-8     6.442m ± 1%   6.440m ± 3%       ~ (p=0.579 n=10)
NewUndirectedLayers/graphSize=100000,numGraphs=10-8    93.59m ± 0%   93.60m ± 0%       ~ (p=0.436 n=10)
Louvain-8                                              6.592m ± 1%   6.550m ± 0%  -0.64% (p=0.000 n=10)
geomean                                                126.8µ        125.8µ       -0.77%

pkg: gonum.org/v1/gonum/graph/encoding/dot
                                  │  bench.old  │             bench.new              │
                                  │   sec/op    │   sec/op     vs base               │
UnmarshalGnp_10_tenth-8               16.85µ ± 1%   16.92µ ± 1%       ~ (p=0.143 n=10)
UnmarshalGnp_100_tenth-8              1.089m ± 2%   1.079m ± 1%       ~ (p=0.165 n=10)
UnmarshalGnp_1000_tenth-8             105.3m ± 1%   105.5m ± 0%       ~ (p=0.436 n=10)
UnmarshalGnp_10_half-8                51.05µ ± 2%   50.99µ ± 2%       ~ (p=0.739 n=10)
UnmarshalGnp_100_half-8               4.904m ± 1%   4.907m ± 0%       ~ (p=1.000 n=10)
UnmarshalGnp_1000_half-8              539.2m ± 1%   540.6m ± 2%       ~ (p=1.000 n=10)
UnmarshalMultiPowerLaw_10_tenth-8     22.03µ ± 1%   22.08µ ± 1%       ~ (p=0.912 n=10)
UnmarshalMultiPowerLaw_100_tenth-8    1.498m ± 1%   1.498m ± 1%       ~ (p=0.971 n=10)
UnmarshalMultiPowerLaw_1000_tenth-8   149.6m ± 1%   151.0m ± 1%       ~ (p=0.052 n=10)
UnmarshalMultiPowerLaw_10_half-8      67.02µ ± 1%   67.09µ ± 1%       ~ (p=0.853 n=10)
UnmarshalMultiPowerLaw_100_half-8     6.795m ± 2%   6.725m ± 2%       ~ (p=0.123 n=10)
UnmarshalMultiPowerLaw_1000_half-8    728.2m ± 0%   734.6m ± 1%       ~ (p=0.089 n=10)
geomean                               2.946m        2.948m       +0.08%

pkg: gonum.org/v1/gonum/graph/flow
                                            │  bench.old  │             bench.new              │
                                            │   sec/op    │   sec/op     vs base               │
RandomGraphDominators/gnm-n=1e3-m=1e3-8         701.9µ ± 0%   706.7µ ± 0%  +0.68% (p=0.000 n=10)
RandomGraphDominators/gnm-n=1e3-m=3e3-8         899.9µ ± 0%   893.3µ ± 1%  -0.73% (p=0.004 n=10)
RandomGraphDominators/gnm-n=1e3-m=1e4-8         1.590m ± 0%   1.594m ± 1%       ~ (p=0.123 n=10)
RandomGraphDominators/gnm-n=1e3-m=3e4-8         3.013m ± 0%   3.011m ± 1%       ~ (p=0.436 n=10)
RandomGraphDominators/gnm-n=1e4-m=1e4-8         7.805m ± 0%   7.778m ± 0%       ~ (p=0.075 n=10)
RandomGraphDominators/gnm-n=1e4-m=3e4-8         10.55m ± 0%   10.71m ± 1%  +1.43% (p=0.000 n=10)
RandomGraphDominators/gnm-n=1e4-m=1e5-8         19.37m ± 1%   19.46m ± 1%       ~ (p=0.353 n=10)
RandomGraphDominators/gnm-n=1e4-m=3e5-8         40.22m ± 1%   40.18m ± 1%       ~ (p=0.436 n=10)
RandomGraphDominators/gnm-n=1e5-m=1e5-8         118.0m ± 2%   116.9m ± 1%       ~ (p=0.684 n=10)
RandomGraphDominators/gnm-n=1e5-m=3e5-8         190.4m ± 1%   190.1m ± 2%       ~ (p=0.684 n=10)
RandomGraphDominators/gnm-n=1e5-m=1e6-8         351.3m ± 1%   350.7m ± 1%       ~ (p=0.796 n=10)
RandomGraphDominators/gnm-n=1e5-m=3e6-8         737.0m ± 0%   737.9m ± 0%       ~ (p=0.052 n=10)
RandomGraphDominators/gnm-n=1e6-m=1e6-8          1.862 ± 1%    1.847 ± 1%  -0.80% (p=0.001 n=10)
RandomGraphDominators/gnm-n=1e6-m=3e6-8          3.492 ± 8%    3.465 ± 9%       ~ (p=0.631 n=10)
RandomGraphDominators/gnm-n=1e6-m=1e7-8          6.536 ± 0%    6.537 ± 1%       ~ (p=0.971 n=10)
RandomGraphDominators/gnm-n=1e6-m=3e7-8          15.13 ± 0%    15.33 ± 1%  +1.31% (p=0.000 n=10)
RandomGraphDominators/dup-n=1e3-d=0.8-a=0.1-8   852.8µ ± 1%   862.7µ ± 1%  +1.17% (p=0.000 n=10)
RandomGraphDominators/dup-n=1e3-d=0.5-a=0.2-8   1.901m ± 0%   1.909m ± 3%       ~ (p=0.143 n=10)
RandomGraphDominators/dup-n=1e4-d=0.8-a=0.1-8   9.384m ± 1%   9.383m ± 7%       ~ (p=0.481 n=10)
RandomGraphDominators/dup-n=1e4-d=0.5-a=0.2-8   50.43m ± 1%   50.40m ± 1%       ~ (p=0.481 n=10)
RandomGraphDominators/dup-n=1e5-d=0.8-a=0.1-8   134.7m ± 1%   134.2m ± 1%       ~ (p=0.739 n=10)
RandomGraphDominators/dup-n=1e5-d=0.5-a=0.2-8    2.357 ± 1%    2.366 ± 0%       ~ (p=0.143 n=10)
geomean                                         54.77m        54.81m       +0.08%

pkg: gonum.org/v1/gonum/graph/formats/rdf
                                              │  bench.old  │             bench.new              │
                                              │   sec/op    │   sec/op     vs base               │
IsoCanonicalHashes/test019-in.nq/decomp=false-8   13.66µ ± 0%   13.48µ ± 0%  -1.31% (p=0.001 n=10)
IsoCanonicalHashes/test019-in.nq/decomp=true-8    14.93µ ± 0%   14.78µ ± 2%  -1.00% (p=0.022 n=10)
IsoCanonicalHashes/test044-in.nq/decomp=false-8   240.8m ± 0%   239.4m ± 1%  -0.60% (p=0.035 n=10)
IsoCanonicalHashes/test044-in.nq/decomp=true-8    251.7m ± 0%   250.5m ± 0%  -0.48% (p=0.000 n=10)
URNA/test019-in.nq/URDNA2015-8                    3.292µ ± 0%   3.203µ ± 2%  -2.72% (p=0.001 n=10)
URNA/test019-in.nq/URGNA2012-8                    3.332µ ± 0%   3.246µ ± 0%  -2.57% (p=0.000 n=10)
URNA/test044-in.nq/URDNA2015-8                    2.798m ± 1%   2.790m ± 0%  -0.27% (p=0.000 n=10)
URNA/test044-in.nq/URGNA2012-8                    2.717m ± 0%   2.706m ± 0%  -0.41% (p=0.000 n=10)
geomean                                           423.3µ        418.3µ       -1.17%

pkg: gonum.org/v1/gonum/graph/path
                                                             │  bench.old  │              bench.new              │
                                                             │   sec/op    │    sec/op     vs base               │
AStarUndirected/GNP_Undirected_10_tenth-8                        2.133µ ± 0%   2.118µ ±  2%  -0.68% (p=0.050 n=10)
AStarUndirected/GNP_Undirected_100_tenth-8                       141.0µ ± 0%   138.5µ ±  0%  -1.75% (p=0.000 n=10)
AStarUndirected/GNP_Undirected_1000_tenth-8                      7.105m ± 5%   7.293m ±  4%       ~ (p=0.247 n=10)
AStarUndirected/GNP_Undirected_10_half-8                         5.436µ ± 0%   5.439µ ±  1%       ~ (p=0.444 n=10)
AStarUndirected/GNP_Undirected_100_half-8                        468.9µ ± 0%   479.4µ ±  0%  +2.24% (p=0.000 n=10)
AStarUndirected/GNP_Undirected_1000_half-8                       14.88m ± 6%   15.28m ± 12%       ~ (p=0.436 n=10)
AStarUndirected/NSW_Undirected_10_2_2_2-8                        35.84µ ± 1%   36.24µ ±  1%  +1.11% (p=0.002 n=10)
AStarUndirected/NSW_Undirected_10_2_2_2_heuristic-8              6.452µ ± 1%   6.457µ ±  0%       ~ (p=0.446 n=10)
AStarUndirected/NSW_Undirected_10_2_5_2-8                        39.69µ ± 1%   41.37µ ±  1%  +4.23% (p=0.000 n=10)
AStarUndirected/NSW_Undirected_10_2_5_2_heuristic-8              6.662µ ± 0%   6.633µ ±  1%  -0.44% (p=0.008 n=10)
AStarUndirected/NSW_Undirected_100_5_10_2-8                      797.1µ ± 2%   812.1µ ±  2%       ~ (p=0.143 n=10)
AStarUndirected/NSW_Undirected_100_5_10_2_heuristic-8            30.80µ ± 0%   30.59µ ±  1%  -0.69% (p=0.015 n=10)
AStarUndirected/NSW_Undirected_100_5_20_2-8                      2.270m ± 2%   2.449m ±  2%  +7.91% (p=0.000 n=10)
AStarUndirected/NSW_Undirected_100_5_20_2_heuristic-8            62.43µ ± 1%   62.25µ ±  0%       ~ (p=0.393 n=10)
BellmanFordFrom/500_tenth-8                                      2.237m ± 0%   2.259m ±  0%  +0.98% (p=0.000 n=10)
BellmanFordFrom/500_tenth_incremental-8                          2.267m ± 0%   2.268m ±  0%       ~ (p=0.393 n=10)
BellmanFordFrom/1000_tenth-8                                     8.997m ± 0%   9.052m ±  0%  +0.60% (p=0.003 n=10)
BellmanFordFrom/1000_tenth_incremental-8                         9.141m ± 0%   9.106m ±  0%  -0.38% (p=0.000 n=10)
BellmanFordFrom/2000_tenth-8                                     41.18m ± 0%   41.23m ±  1%       ~ (p=0.190 n=10)
BellmanFordFrom/2000_tenth_incremental-8                         41.70m ± 1%   41.67m ±  0%       ~ (p=0.123 n=10)
BellmanFordFrom/500_half-8                                       9.385m ± 0%   9.479m ±  0%  +1.00% (p=0.000 n=10)
BellmanFordFrom/500_half_incremental-8                           9.447m ± 0%   9.574m ±  0%  +1.35% (p=0.000 n=10)
BellmanFordFrom/1000_half-8                                      35.28m ± 1%   35.77m ±  0%  +1.37% (p=0.002 n=10)
BellmanFordFrom/1000_half_incremental-8                          35.73m ± 0%   36.21m ±  0%  +1.34% (p=0.000 n=10)
BellmanFordFrom/2000_half-8                                      169.7m ± 0%   170.3m ±  0%  +0.33% (p=0.002 n=10)
BellmanFordFrom/2000_half_incremental-8                          172.2m ± 0%   172.7m ±  0%  +0.28% (p=0.004 n=10)
BellmanFordFrom/500_full-8                                       16.33m ± 1%   16.25m ±  0%  -0.52% (p=0.000 n=10)
BellmanFordFrom/500_full_incremental-8                           16.47m ± 0%   16.41m ±  0%  -0.38% (p=0.000 n=10)
BellmanFordFrom/1000_full-8                                      58.08m ± 0%   58.33m ±  0%  +0.44% (p=0.001 n=10)
BellmanFordFrom/1000_full_incremental-8                          58.71m ± 0%   59.03m ±  0%  +0.54% (p=0.000 n=10)
BellmanFordFrom/2000_full-8                                      329.2m ± 0%   328.0m ±  0%  -0.36% (p=0.000 n=10)
BellmanFordFrom/2000_full_incremental-8                          332.3m ± 1%   332.8m ±  0%       ~ (p=0.481 n=10)
ShortestAlts/AllTo_100×2|0.5(17)-8                               4.364µ ± 2%   4.423µ ±  3%       ~ (p=0.093 n=10)
ShortestAlts/AllToFunc_100×2|0.5(17)-8                           3.028µ ± 1%   3.052µ ±  1%  +0.79% (p=0.014 n=10)
ShortestAlts/AllTo_1000×2|0.5(51)-8                              28.02µ ± 4%   27.78µ ±  2%       ~ (p=0.912 n=10)
ShortestAlts/AllToFunc_1000×2|0.5(51)-8                          25.80µ ± 2%   25.59µ ±  3%       ~ (p=0.684 n=10)
ShortestAlts/AllTo_100×4|0.25(53)-8                              7.443µ ± 1%   7.435µ ±  1%       ~ (p=0.811 n=10)
ShortestAlts/AllToFunc_100×4|0.25(53)-8                          4.676µ ± 1%   4.659µ ±  1%       ~ (p=0.425 n=10)
ShortestAlts/AllTo_1000×4|0.25(574)-8                            154.0µ ± 1%   154.7µ ±  3%       ~ (p=0.796 n=10)
ShortestAlts/AllToFunc_1000×4|0.25(574)-8                        124.8µ ± 3%   120.9µ ±  1%  -3.14% (p=0.003 n=10)
ShortestAlts/AllTo_100×16|0.1(76)-8                              10.62µ ± 1%   10.65µ ±  1%  +0.32% (p=0.030 n=10)
ShortestAlts/AllToFunc_100×16|0.1(76)-8                          6.544µ ± 0%   6.560µ ±  1%       ~ (p=0.271 n=10)
ShortestAlts/AllTo_1000×16|0.1(822)-8                            222.9µ ± 2%   223.2µ ±  2%       ~ (p=0.529 n=10)
ShortestAlts/AllToFunc_1000×16|0.1(822)-8                        182.8µ ± 1%   181.7µ ±  3%       ~ (p=0.631 n=10)
AllShortest/DijkstraAllPaths_Between_100×2|0.5(17)-8             332.5n ± 2%   330.5n ±  1%       ~ (p=0.280 n=10)
AllShortest/DijkstraAllPaths_AllBetween_100×2|0.5(17)-8          3.850µ ± 1%   3.850µ ±  1%       ~ (p=0.853 n=10)
AllShortest/DijkstraAllPaths_AllBetweenFunc_100×2|0.5(17)-8      2.647µ ± 1%   2.651µ ±  1%       ~ (p=0.698 n=10)
AllShortest/FloydWarshall_Between_100×2|0.5(17)-8                322.8n ± 1%   320.8n ±  1%  -0.64% (p=0.035 n=10)
AllShortest/FloydWarshall_AllBetween_100×2|0.5(17)-8             3.697µ ± 1%   3.695µ ±  1%       ~ (p=0.755 n=10)
AllShortest/FloydWarshall_AllBetweenFunc_100×2|0.5(17)-8         2.482µ ± 2%   2.486µ ±  1%       ~ (p=0.631 n=10)
AllShortest/DijkstraAllPaths_Between_1000×2|0.5(51)-8            1.468µ ± 1%   1.441µ ±  1%  -1.87% (p=0.000 n=10)
AllShortest/DijkstraAllPaths_AllBetween_1000×2|0.5(51)-8         26.95µ ± 4%   27.35µ ±  2%       ~ (p=0.315 n=10)
AllShortest/DijkstraAllPaths_AllBetweenFunc_1000×2|0.5(51)-8     23.64µ ± 2%   23.38µ ±  1%  -1.08% (p=0.023 n=10)
AllShortest/FloydWarshall_Between_1000×2|0.5(51)-8               1.429µ ± 2%   1.444µ ±  2%       ~ (p=0.271 n=10)
AllShortest/FloydWarshall_AllBetween_1000×2|0.5(51)-8            22.31µ ± 1%   22.23µ ±  1%       ~ (p=0.089 n=10)
AllShortest/FloydWarshall_AllBetweenFunc_1000×2|0.5(51)-8        18.34µ ± 1%   18.39µ ±  2%       ~ (p=0.224 n=10)
AllShortest/DijkstraAllPaths_Between_100×4|0.25(53)-8            265.9n ± 1%   268.9n ±  1%  +1.15% (p=0.024 n=10)
AllShortest/DijkstraAllPaths_AllBetween_100×4|0.25(53)-8         7.150µ ± 1%   7.175µ ±  1%       ~ (p=0.085 n=10)
AllShortest/DijkstraAllPaths_AllBetweenFunc_100×4|0.25(53)-8     4.426µ ± 1%   4.441µ ±  1%       ~ (p=0.362 n=10)
AllShortest/FloydWarshall_Between_100×4|0.25(53)-8               260.9n ± 2%   260.6n ±  1%       ~ (p=0.492 n=10)
AllShortest/FloydWarshall_AllBetween_100×4|0.25(53)-8            7.110µ ± 1%   7.132µ ±  2%       ~ (p=0.579 n=10)
AllShortest/FloydWarshall_AllBetweenFunc_100×4|0.25(53)-8        4.244µ ± 1%   4.247µ ±  1%       ~ (p=1.000 n=10)
AllShortest/DijkstraAllPaths_Between_1000×4|0.25(574)-8          1.369µ ± 2%   1.404µ ±  3%  +2.56% (p=0.012 n=10)
AllShortest/DijkstraAllPaths_AllBetween_1000×4|0.25(574)-8       157.6µ ± 2%   154.9µ ±  1%       ~ (p=0.052 n=10)
AllShortest/DijkstraAllPaths_AllBetweenFunc_1000×4|0.25(574)-8   123.7µ ± 2%   123.8µ ±  2%       ~ (p=0.853 n=10)
AllShortest/FloydWarshall_Between_1000×4|0.25(574)-8             1.362µ ± 2%   1.394µ ±  2%  +2.35% (p=0.003 n=10)
AllShortest/FloydWarshall_AllBetween_1000×4|0.25(574)-8          151.4µ ± 2%   150.3µ ±  2%       ~ (p=0.280 n=10)
AllShortest/FloydWarshall_AllBetweenFunc_1000×4|0.25(574)-8      120.7µ ± 1%   119.4µ ±  1%       ~ (p=0.052 n=10)
AllShortest/DijkstraAllPaths_Between_100×16|0.1(76)-8            264.4n ± 1%   268.2n ±  1%  +1.42% (p=0.000 n=10)
AllShortest/DijkstraAllPaths_AllBetween_100×16|0.1(76)-8         10.34µ ± 2%   10.31µ ±  1%       ~ (p=0.218 n=10)
AllShortest/DijkstraAllPaths_AllBetweenFunc_100×16|0.1(76)-8     6.289µ ± 1%   6.338µ ±  1%       ~ (p=0.118 n=10)
AllShortest/FloydWarshall_Between_100×16|0.1(76)-8               261.3n ± 1%   259.4n ±  1%       ~ (p=0.239 n=10)
AllShortest/FloydWarshall_AllBetween_100×16|0.1(76)-8            10.36µ ± 1%   10.31µ ±  1%       ~ (p=0.123 n=10)
AllShortest/FloydWarshall_AllBetweenFunc_100×16|0.1(76)-8        6.057µ ± 1%   6.077µ ±  1%       ~ (p=0.256 n=10)
AllShortest/DijkstraAllPaths_Between_1000×16|0.1(822)-8          1.387µ ± 4%   1.381µ ±  2%       ~ (p=0.469 n=10)
AllShortest/DijkstraAllPaths_AllBetween_1000×16|0.1(822)-8       215.6µ ± 1%   216.2µ ±  3%       ~ (p=0.393 n=10)
AllShortest/DijkstraAllPaths_AllBetweenFunc_1000×16|0.1(822)-8   180.3µ ± 2%   177.2µ ±  3%       ~ (p=0.165 n=10)
AllShortest/FloydWarshall_Between_1000×16|0.1(822)-8             1.387µ ± 2%   1.394µ ±  1%       ~ (p=0.305 n=10)
AllShortest/FloydWarshall_AllBetween_1000×16|0.1(822)-8          207.7µ ± 3%   205.5µ ±  1%  -1.05% (p=0.035 n=10)
AllShortest/FloydWarshall_AllBetweenFunc_1000×16|0.1(822)-8      167.5µ ± 1%   166.4µ ±  0%       ~ (p=0.165 n=10)
geomean                                                          84.41µ        84.65µ        +0.28%

pkg: gonum.org/v1/gonum/graph/product
                                      │  bench.old   │              bench.new              │
                                      │    sec/op    │    sec/op     vs base               │
Product/Cartesian_50-0.05-8               5.872m ±  9%   5.846m ±  8%       ~ (p=0.796 n=10)
Product/Cartesian_100-0.05-8              44.49m ±  8%   44.96m ±  7%       ~ (p=0.739 n=10)
Product/Cartesian_50-0.25-8               25.81m ±  5%   25.65m ±  3%       ~ (p=0.912 n=10)
Product/Cartesian_100-0.25-8              233.4m ±  9%   232.8m ±  4%       ~ (p=0.631 n=10)
Product/Cartesian_50-0.50-8               49.88m ±  3%   50.45m ±  3%       ~ (p=0.529 n=10)
Product/Cartesian_100-0.50-8              466.8m ±  3%   463.2m ±  2%       ~ (p=0.796 n=10)
Product/Cartesian_50-0.75-8               78.72m ±  1%   78.61m ±  1%       ~ (p=0.631 n=10)
Product/Cartesian_100-0.75-8              720.2m ±  1%   722.9m ±  2%       ~ (p=0.436 n=10)
Product/Cartesian_50-0.95-8               93.46m ±  2%   94.06m ±  1%       ~ (p=0.631 n=10)
Product/Cartesian_100-0.95-8              859.4m ±  2%   865.0m ±  2%       ~ (p=0.436 n=10)
Product/Cartesian_naive_50-0.05-8         208.0m ±  1%   208.6m ±  2%       ~ (p=1.000 n=10)
Product/Cartesian_naive_100-0.05-8         3.336 ±  2%    3.341 ±  1%       ~ (p=0.971 n=10)
Product/Cartesian_naive_50-0.25-8         341.5m ±  3%   342.8m ±  2%       ~ (p=0.684 n=10)
Product/Cartesian_naive_100-0.25-8         5.424 ±  1%    5.424 ±  1%       ~ (p=0.436 n=10)
Product/Cartesian_naive_50-0.50-8         480.5m ±  3%   487.1m ±  3%       ~ (p=0.579 n=10)
Product/Cartesian_naive_100-0.50-8         7.289 ±  1%    7.287 ±  1%       ~ (p=0.579 n=10)
Product/Cartesian_naive_50-0.75-8         599.4m ±  2%   599.1m ±  2%       ~ (p=0.579 n=10)
Product/Cartesian_naive_100-0.75-8         8.753 ±  0%    8.741 ±  0%       ~ (p=0.280 n=10)
Product/Cartesian_naive_50-0.95-8         683.4m ±  1%   683.7m ±  1%       ~ (p=0.912 n=10)
Product/Cartesian_naive_100-0.95-8         9.945 ±  1%    9.941 ±  0%       ~ (p=0.796 n=10)
Product/CoNormal_50-0.05-8                189.5m ± 11%   194.1m ±  7%       ~ (p=0.631 n=10)
Product/CoNormal_50-0.25-8                 1.137 ±  4%    1.130 ±  2%       ~ (p=0.796 n=10)
Product/CoNormal_50-0.50-8                 2.472 ±  3%    2.456 ±  5%       ~ (p=0.739 n=10)
Product/CoNormal_50-0.75-8                 3.481 ±  2%    3.444 ±  2%       ~ (p=0.436 n=10)
Product/CoNormal_50-0.95-8                 4.238 ±  2%    4.203 ±  2%       ~ (p=0.529 n=10)
Product/CoNormal_naive_50-0.05-8          421.6m ±  9%   425.5m ±  8%       ~ (p=0.912 n=10)
Product/CoNormal_naive_50-0.25-8           1.541 ±  4%    1.533 ±  2%       ~ (p=0.529 n=10)
Product/CoNormal_naive_50-0.50-8           2.739 ±  4%    2.725 ±  2%       ~ (p=0.853 n=10)
Product/CoNormal_naive_50-0.75-8           3.205 ±  3%    3.198 ±  2%       ~ (p=0.529 n=10)
Product/CoNormal_naive_50-0.95-8           3.386 ±  2%    3.382 ±  2%       ~ (p=0.912 n=10)
Product/Lexicographical_50-0.05-8         95.62m ± 13%   97.74m ± 14%       ~ (p=0.436 n=10)
Product/Lexicographical_50-0.25-8         528.0m ±  4%   520.1m ±  8%       ~ (p=0.481 n=10)
Product/Lexicographical_50-0.50-8          1.144 ±  2%    1.137 ±  3%       ~ (p=0.579 n=10)
Product/Lexicographical_50-0.75-8          1.864 ±  3%    1.854 ±  2%       ~ (p=0.796 n=10)
Product/Lexicographical_50-0.95-8          2.314 ±  2%    2.309 ±  3%       ~ (p=0.912 n=10)
Product/Lexicographical_naive_50-0.05-8   306.1m ±  7%   305.9m ±  6%       ~ (p=0.796 n=10)
Product/Lexicographical_naive_50-0.25-8   942.9m ±  7%   947.8m ±  7%       ~ (p=0.684 n=10)
Product/Lexicographical_naive_50-0.50-8    1.851 ±  2%    1.813 ±  3%       ~ (p=0.105 n=10)
Product/Lexicographical_naive_50-0.75-8    2.797 ±  4%    2.785 ±  3%       ~ (p=0.796 n=10)
Product/Lexicographical_naive_50-0.95-8    3.330 ±  2%    3.311 ±  4%       ~ (p=0.739 n=10)
Product/Modular_50-0.05-8                  2.727 ±  3%    2.752 ±  2%       ~ (p=0.912 n=10)
Product/Modular_50-0.25-8                  1.973 ±  5%    2.029 ±  4%       ~ (p=0.684 n=10)
Product/Modular_50-0.50-8                  1.880 ±  1%    1.871 ±  2%       ~ (p=0.393 n=10)
Product/Modular_50-0.75-8                  2.220 ±  2%    2.209 ±  2%       ~ (p=0.579 n=10)
Product/Modular_50-0.95-8                  3.244 ±  1%    3.168 ±  2%  -2.36% (p=0.023 n=10)
Product/Modular_naive_50-0.05-8            2.724 ±  6%    2.717 ±  2%       ~ (p=0.631 n=10)
Product/Modular_naive_50-0.25-8            2.010 ±  3%    1.976 ±  2%       ~ (p=0.393 n=10)
Product/Modular_naive_50-0.50-8            1.877 ±  2%    1.861 ±  1%       ~ (p=0.353 n=10)
Product/Modular_naive_50-0.75-8            2.194 ±  2%    2.206 ±  2%       ~ (p=0.971 n=10)
Product/Modular_naive_50-0.95-8            3.228 ±  2%    3.215 ±  2%       ~ (p=0.481 n=10)
Product/Strong_50-0.05-8                  12.93m ± 12%   13.46m ± 16%       ~ (p=0.353 n=10)
Product/Strong_50-0.25-8                  192.6m ±  7%   192.4m ±  6%       ~ (p=0.971 n=10)
Product/Strong_50-0.50-8                  717.4m ±  6%   723.9m ±  5%       ~ (p=0.971 n=10)
Product/Strong_50-0.75-8                   1.589 ±  3%    1.604 ±  3%       ~ (p=0.684 n=10)
Product/Strong_50-0.95-8                   2.693 ±  1%    2.702 ±  2%       ~ (p=0.796 n=10)
Product/Strong_naive_50-0.05-8            216.2m ±  3%   216.1m ±  4%       ~ (p=0.739 n=10)
Product/Strong_naive_50-0.25-8            492.5m ±  7%   483.3m ±  3%       ~ (p=0.529 n=10)
Product/Strong_naive_50-0.50-8             1.172 ±  4%    1.163 ±  3%       ~ (p=0.739 n=10)
Product/Strong_naive_50-0.75-8             2.128 ±  3%    2.132 ±  2%       ~ (p=0.971 n=10)
Product/Strong_naive_50-0.95-8             3.224 ±  3%    3.240 ±  3%       ~ (p=0.393 n=10)
Product/Tensor_50-0.05-8                  7.237m ± 15%   7.146m ± 18%       ~ (p=0.631 n=10)
Product/Tensor_50-0.25-8                  158.9m ±  9%   158.1m ±  8%       ~ (p=0.853 n=10)
Product/Tensor_50-0.50-8                  639.4m ±  3%   640.5m ±  6%       ~ (p=0.912 n=10)
Product/Tensor_50-0.75-8                   1.475 ±  4%    1.504 ±  4%  +1.94% (p=0.023 n=10)
Product/Tensor_50-0.95-8                   2.529 ±  1%    2.508 ±  3%       ~ (p=0.393 n=10)
Product/Tensor_naive_50-0.05-8            193.6m ±  2%   193.3m ±  2%       ~ (p=0.971 n=10)
Product/Tensor_naive_50-0.25-8            444.6m ±  4%   446.3m ±  5%       ~ (p=0.971 n=10)
Product/Tensor_naive_50-0.50-8             1.062 ±  3%    1.067 ±  3%       ~ (p=0.853 n=10)
Product/Tensor_naive_50-0.75-8             2.013 ±  3%    2.035 ±  4%       ~ (p=0.353 n=10)
Product/Tensor_naive_50-0.95-8             3.096 ±  3%    3.173 ±  4%       ~ (p=0.190 n=10)
geomean                                   805.8m         806.3m        +0.06%

pkg: gonum.org/v1/gonum/graph/topo
                                      │  bench.old  │              bench.new              │
                                      │   sec/op    │   sec/op     vs base                │
TarjanSCCGnp_10_tenth-8                   3.894µ ± 1%   3.992µ ± 1%   +2.49% (p=0.000 n=10)
TarjanSCCGnp_100_tenth-8                  152.0µ ± 1%   153.1µ ± 1%   +0.68% (p=0.015 n=10)
TarjanSCCGnp_1000_tenth-8                 8.772m ± 0%   8.821m ± 1%   +0.56% (p=0.001 n=10)
TarjanSCCGnp_10_half-8                    8.371µ ± 0%   8.415µ ± 0%   +0.52% (p=0.001 n=10)
TarjanSCCGnp_100_half-8                   591.7µ ± 1%   590.7µ ± 0%        ~ (p=0.105 n=10)
TarjanSCCGnp_1000_half-8                  40.03m ± 0%   40.21m ± 1%   +0.45% (p=0.029 n=10)
DirectedCyclesInGnp_10_tenth-8            13.63µ ± 1%   13.57µ ± 2%        ~ (p=0.123 n=10)
DirectedCyclesInGnp_10_half-8             2.493m ± 0%   2.489m ± 1%        ~ (p=0.353 n=10)
UndirectedCyclesInGnp_100_tenth-8         224.6µ ± 1%   224.0µ ± 0%   -0.31% (p=0.015 n=10)
UndirectedCyclesInGnp_10_half-8           9.553µ ± 1%   9.482µ ± 1%   -0.74% (p=0.000 n=10)
UndirectedCyclesInGnp_100_half-8          808.5µ ± 2%   806.4µ ± 3%        ~ (p=0.631 n=10)
SortPath_10-8                             4.728µ ± 1%   4.733µ ± 1%        ~ (p=0.643 n=10)
SortPath_1000-8                           403.1µ ± 1%   402.4µ ± 1%        ~ (p=0.529 n=10)
SortPath_100000-8                         75.89m ± 1%   72.92m ± 2%   -3.91% (p=0.000 n=10)
SortStabilizedPath_10-8                   4.885µ ± 1%   4.300µ ± 0%  -11.98% (p=0.000 n=10)
SortStabilizedPath_1000-8                 469.6µ ± 0%   414.0µ ± 1%  -11.84% (p=0.000 n=10)
SortStabilizedPath_100000-8               80.54m ± 1%   71.92m ± 1%  -10.71% (p=0.000 n=10)
BronKerbosch/wikipedia_example-8          11.32µ ± 0%   11.39µ ± 0%   +0.60% (p=0.001 n=10)
BronKerbosch/Batagelj-Zaversnik_Graph-8   60.23µ ± 1%   60.23µ ± 0%        ~ (p=0.631 n=10)
CliqueGraph/simple-8                      32.17µ ± 2%   30.64µ ± 1%   -4.74% (p=0.000 n=10)
CliqueGraph/Batagelj-Zaversnik_Graph-8    87.35µ ± 0%   84.64µ ± 1%   -3.10% (p=0.000 n=10)
geomean                                   203.8µ        199.4µ        -2.15%

pkg: gonum.org/v1/gonum/graph/traverse
                                  │  bench.old  │             bench.new              │
                                  │   sec/op    │   sec/op     vs base               │
WalkAllBreadthFirstGnp_10_tenth-8     1.623µ ± 0%   1.681µ ± 0%  +3.57% (p=0.000 n=10)
WalkAllBreadthFirstGnp_100_tenth-8    75.01µ ± 0%   74.28µ ± 0%  -0.97% (p=0.000 n=10)
WalkAllBreadthFirstGnp_1000_tenth-8   5.749m ± 1%   5.751m ± 0%       ~ (p=0.853 n=10)
WalkAllBreadthFirstGnp_10_half-8      4.082µ ± 0%   4.081µ ± 1%       ~ (p=0.838 n=10)
WalkAllBreadthFirstGnp_100_half-8     326.2µ ± 0%   324.7µ ± 0%  -0.48% (p=0.000 n=10)
WalkAllBreadthFirstGnp_1000_half-8    25.37m ± 0%   25.25m ± 0%  -0.46% (p=0.000 n=10)
WalkAllDepthFirstGnp_10_tenth-8       1.657µ ± 1%   1.693µ ± 0%  +2.14% (p=0.000 n=10)
WalkAllDepthFirstGnp_100_tenth-8      78.37µ ± 1%   77.77µ ± 1%  -0.76% (p=0.011 n=10)
WalkAllDepthFirstGnp_1000_tenth-8     5.696m ± 0%   5.711m ± 0%  +0.28% (p=0.000 n=10)
WalkAllDepthFirstGnp_10_half-8        4.108µ ± 0%   4.120µ ± 0%  +0.30% (p=0.003 n=10)
WalkAllDepthFirstGnp_100_half-8       352.9µ ± 0%   350.9µ ± 0%  -0.58% (p=0.000 n=10)
WalkAllDepthFirstGnp_1000_half-8      24.86m ± 0%   24.92m ± 0%       ~ (p=0.436 n=10)
geomean                               171.1µ        171.6µ       +0.27%

@kortschak
Copy link
Member

Yeah, that looks like a wash. I think we're fine then. I'll take another proper look on the weekend.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants