jemalloc 5
#2628
Replies: 4 comments
-
master vs. jemalloc 5 (oversize_threshold:0)IntelSystem cx01 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +15% || Geometric mean of throughput changes: -10%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 09:21:11 | 2024-01-12 13:10:15 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5491.68 | 5720.66 | +4% || 0.18 | 0.17 | -4% | 0.0001 |
+| TPC-H 02 || 42.43 | 41.96 | -1%˄ || 23.57 | 23.83 | +1%˄ | 0.1903 |
+| TPC-H 03 || 2243.21 | 3722.61 | +66% || 0.45 | 0.27 | -40% | 0.0000 |
+| TPC-H 04 || 1339.93 | 1698.97 | +27% || 0.75 | 0.59 | -21% | 0.0000 |
+| TPC-H 05 || 2858.75 | 3352.27 | +17% || 0.35 | 0.30 | -15% | 0.0000 |
+| TPC-H 06 || 144.98 | 156.59 | +8%˄ || 6.90 | 6.39 | -7%˄ | 0.0000 |
+| TPC-H 07 || 886.04 | 902.91 | +2% || 1.13 | 1.11 | -2% | 0.0000 |
+| TPC-H 08 || 673.67 | 751.74 | +12% || 1.48 | 1.33 | -10% | 0.0000 |
+| TPC-H 09 || 5009.46 | 5670.40 | +13% || 0.20 | 0.18 | -12% | 0.0000 |
+| TPC-H 10 || 2920.33 | 3290.47 | +13% || 0.34 | 0.30 | -11% | 0.0000 |
+| TPC-H 11 || 71.69 | 82.13 | +15%˄ || 13.95 | 12.18 | -13%˄ | 0.0000 |
+| TPC-H 12 || 920.97 | 999.60 | +9% || 1.09 | 1.00 | -8% | 0.0000 |
+| TPC-H 13 || 4392.07 | 4760.60 | +8% || 0.23 | 0.21 | -8% | 0.0000 |
+| TPC-H 14 || 397.76 | 402.24 | +1%˄ || 2.51 | 2.49 | -1%˄ | 0.0008 |
+| TPC-H 15 || 179.68 | 186.67 | +4%˄ || 5.57 | 5.36 | -4%˄ | 0.0000 |
+| TPC-H 16 || 638.04 | 705.69 | +11% || 1.57 | 1.42 | -10% | 0.0000 |
+| TPC-H 17 || 205.22 | 206.65 | +1%˄ || 4.87 | 4.84 | -1%˄ | 0.0000 |
+| TPC-H 18 || 1455.84 | 2037.77 | +40% || 0.69 | 0.49 | -29% | 0.0000 |
+| TPC-H 19 || 248.00 | 245.71 | -1%˄ || 4.03 | 4.07 | +1%˄ | 0.0110 |
+| TPC-H 20 || 373.40 | 384.83 | +3%˄ || 2.68 | 2.60 | -3%˄ | 0.0000 |
+| TPC-H 21 || 4327.73 | 4805.59 | +11% || 0.23 | 0.21 | -10% | 0.0000 |
+| TPC-H 22 || 404.63 | 407.71 | +1%˄ || 2.47 | 2.45 | -1%˄ | 0.0000 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 35225.52 | 40533.76 | +15% || | | | |
+| Geomean || | | || | | -10% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st_s01.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 09:40:19 | 2024-01-12 13:29:23 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+++----------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 4.77 | 4.77 | -0%˄ || 209.54 | 209.67 | +0%˄ | 0.8518 |
+| TPC-H 02 || 3.69 | 3.49 | -6%˄ || 270.53 | 286.68 | +6%˄ | 0.3397 |
+| TPC-H 03 || 0.66 | 0.68 | +3%˄ || 1513.38 | 1470.87 | -3%˄ | 0.0067 |
+| TPC-H 04 || 0.43 | 0.42 | -1%˄ || 2338.82 | 2373.58 | +1%˄ | 0.0000 |
+| TPC-H 05 || 0.99 | 1.00 | +1%˄ || 1010.51 | 997.12 | -1%˄ | 0.0891 |
+| TPC-H 06 || 0.17 | 0.17 | -1%˄ || 5708.08 | 5744.27 | +1%˄ | 0.0949 |
+| TPC-H 07 || 9.22 | 9.89 | +7%˄ || 108.48 | 101.10 | -7%˄ | 0.3563 |
+| TPC-H 08 || 14.49 | 14.33 | -1%˄ || 68.99 | 69.76 | +1%˄ | 0.6732 |
+| TPC-H 09 || 3.92 | 3.51 | -11%˄ || 254.76 | 285.05 | +12%˄ | 0.4343 |
+| TPC-H 10 || 0.75 | 0.74 | -1%˄ || 1331.18 | 1350.45 | +1%˄ | 0.0001 |
+| TPC-H 11 || 0.21 | 0.21 | +0%˄ || 4721.49 | 4702.51 | -0%˄ | 0.6900 |
+| TPC-H 12 || 0.59 | 0.60 | +0%˄ || 1676.59 | 1671.58 | -0%˄ | 0.2717 |
+| TPC-H 13 || 1.90 | 1.89 | -1%˄ || 525.91 | 529.23 | +1%˄ | 0.0314 |
+| TPC-H 14 || 0.33 | 0.31 | -7%˄ || 2976.14 | 3213.28 | +8%˄ | 0.0000 |
+| TPC-H 15 || 1.24 | 1.18 | -5%˄ || 801.43 | 847.00 | +6%˄ | 0.0000 |
+| TPC-H 16 || 1.95 | 1.85 | -5%˄ || 513.16 | 538.92 | +5%˄ | 0.0000 |
+| TPC-H 17 || 0.74 | 0.63 | -15%˄ || 1340.84 | 1580.95 | +18%˄ | 0.1531 |
+| TPC-H 18 || 1.11 | 1.10 | -1%˄ || 898.30 | 905.81 | +1%˄ | 0.0000 |
+| TPC-H 19 || 4.96 | 4.76 | -4%˄ || 201.54 | 210.06 | +4%˄ | 0.0000 |
+| TPC-H 20 || 2.13 | 2.07 | -3%˄ || 468.64 | 482.02 | +3%˄ | 0.1824 |
+| TPC-H 21 || 1.37 | 1.32 | -4%˄ || 727.61 | 757.69 | +4%˄ | 0.3525 |
+| TPC-H 22 || 1.04 | 1.03 | -1%˄ || 960.19 | 967.74 | +1%˄ | 0.0659 |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 56.69 | 55.95 | -1% || | | | |
+| Geomean || | | || | | +3% | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 9 cores, SF 10.0 Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 09:40:47 | 2024-01-12 13:29:51 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 4231.40 | 4265.19 | +1% || 0.23 | 0.23 | -0% | 0.3825 |
+| TPC-H 02 || 25.43 | 24.67 | -3% || 32.92 | 36.58 | +11% | 0.0000 |
+| TPC-H 03 || 902.23 | 901.10 | -0% || 1.10 | 1.10 | +0% | 0.8030 |
+| TPC-H 04 || 439.20 | 433.05 | -1% || 2.23 | 2.27 | +1% | 0.0547 |
+| TPC-H 05 || 630.61 | 627.85 | -0% || 1.57 | 1.57 | -0% | 0.5193 |
+| TPC-H 06 || 42.58 | 43.21 | +1% || 20.08 | 19.98 | -0% | 0.0000 |
+| TPC-H 07 || 241.45 | 242.71 | +1% || 4.05 | 4.03 | -0% | 0.1779 |
+| TPC-H 08 || 223.65 | 223.59 | -0% || 4.37 | 4.37 | +0% | 0.9255 |
+| TPC-H 09 || 1491.36 | 1524.47 | +2% || 0.67 | 0.65 | -2% | 0.0000 |
+| TPC-H 10 || 1587.72 | 1595.67 | +1% || 0.62 | 0.62 | +0% | (run time too short) |
+| TPC-H 11 || 52.51 | 53.27 | +1% || 17.01 | 16.83 | -1% | 0.0000 |
+| TPC-H 12 || 363.40 | 363.65 | +0% || 2.70 | 2.70 | +0% | 0.7559 |
+| TPC-H 13 || 2435.13 | 2432.24 | -0% || 0.40 | 0.40 | -0% | (run time too short) |
+| TPC-H 14 || 92.07 | 92.56 | +1% || 10.10 | 10.07 | -0% | 0.0002 |
+| TPC-H 15 || 120.98 | 123.39 | +2% || 7.98 | 7.75 | -3% | 0.0000 |
+| TPC-H 16 || 506.78 | 503.80 | -1% || 1.95 | 1.95 | -0% | 0.1112 |
+| TPC-H 17 || 58.76 | 59.39 | +1% || 16.01 | 15.67 | -2% | 0.0005 |
+| TPC-H 18 || 1974.68 | 1961.91 | -1% || 0.50 | 0.50 | +0% | (run time too short) |
+| TPC-H 19 || 82.00 | 81.79 | -0% || 11.15 | 11.53 | +3% | 0.2887 |
+| TPC-H 20 || 141.61 | 142.70 | +1% || 6.73 | 6.72 | -0% | 0.0119 |
+| TPC-H 21 || 925.16 | 924.79 | -0% || 1.07 | 1.07 | +0% | 0.9341 |
+| TPC-H 22 || 121.47 | 121.66 | +0% || 7.87 | 7.85 | -0% | 0.3825 |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 16690.19 | 16742.67 | +0% || | | | |
+| Geomean || | | || | | +0% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 9 clients, 9 cores, SF 10.0 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 10:04:27 | 2024-01-12 13:53:22 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5837.26 | 5840.28 | +0% || 0.18 | 0.17 | -3% | 0.9846 |
+| TPC-H 02 || 214.54 | 231.37 | +8% || 0.18 | 0.17 | -2% | 0.7445 |
+| TPC-H 03 || 3041.07 | 3016.53 | -1% || 0.18 | 0.17 | -2% | 0.9267 |
+| TPC-H 04 || 2081.00 | 2193.82 | +5% || 0.18 | 0.17 | -2% | 0.6946 |
+| TPC-H 05 || 3503.26 | 3655.94 | +4% || 0.18 | 0.17 | -2% | 0.6509 |
+| TPC-H 06 || 541.70 | 477.54 | -12% || 0.18 | 0.17 | -2% | 0.5598 |
+| TPC-H 07 || 2432.84 | 2489.71 | +2% || 0.18 | 0.17 | -3% | 0.8530 |
+| TPC-H 08 || 2249.66 | 1891.02 | -16% || 0.18 | 0.17 | -2% | 0.2554 |
+| TPC-H 09 || 5394.67 | 5284.36 | -2% || 0.18 | 0.17 | -2% | 0.7635 |
+| TPC-H 10 || 3907.04 | 3550.03 | -9% || 0.18 | 0.17 | -3% | 0.1920 |
+| TPC-H 11 || 273.11 | 208.45 | -24% || 0.18 | 0.17 | -2% | 0.2760 |
+| TPC-H 12 || 2026.58 | 2253.13 | +11% || 0.18 | 0.17 | -3% | 0.3666 |
+| TPC-H 13 || 4182.22 | 4766.13 | +14% || 0.18 | 0.17 | -2% | 0.0190 |
+| TPC-H 14 || 716.01 | 973.10 | +36% || 0.18 | 0.17 | -2% | 0.0705 |
+| TPC-H 15 || 590.40 | 570.96 | -3% || 0.18 | 0.17 | -2% | 0.8773 |
+| TPC-H 16 || 1395.73 | 1410.56 | +1% || 0.18 | 0.17 | -3% | 0.9325 |
+| TPC-H 17 || 670.38 | 665.52 | -1% || 0.18 | 0.17 | -2% | 0.9750 |
+| TPC-H 18 || 2792.14 | 3002.20 | +8% || 0.18 | 0.17 | -2% | 0.1774 |
+| TPC-H 19 || 672.28 | 716.54 | +7% || 0.18 | 0.17 | -2% | 0.7569 |
+| TPC-H 20 || 1491.54 | 1409.69 | -5% || 0.18 | 0.17 | -2% | 0.7507 |
+| TPC-H 21 || 5409.44 | 5465.28 | +1% || 0.18 | 0.17 | -1% | 0.8879 |
+| TPC-H 22 || 820.96 | 841.50 | +3% || 0.18 | 0.17 | -2% | 0.9088 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 50243.86 | 50913.66 | +1% || | | | |
+| Geomean || | | || | | -2% | |
++----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +18% || Geometric mean of throughput changes: -6%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 10:26:03 | 2024-01-12 14:14:56 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 252.39 | 287.50 | +14%˄ || 3.96 | 3.48 | -12%˄ | 0.0000 |
+| 03 || 67.89 | 69.39 | +2%˄ || 14.73 | 14.41 | -2%˄ | 0.0000 |
+| 06 || 109.87 | 113.82 | +4%˄ || 9.10 | 8.79 | -3%˄ | 0.0000 |
+| 07 || 281.72 | 282.91 | +0%˄ || 3.55 | 3.53 | -0%˄ | 0.2856 |
+| 09 || 637.17 | 663.83 | +4% || 1.57 | 1.51 | -4% | 0.0000 |
+| 10 || 125.10 | 124.78 | -0%˄ || 7.99 | 8.01 | +0%˄ | 0.3414 |
+| 13 || 402.72 | 416.36 | +3%˄ || 2.48 | 2.40 | -3%˄ | 0.0000 |
+| 15 || 106.40 | 109.88 | +3%˄ || 9.40 | 9.10 | -3%˄ | 0.0000 |
+| 16 || 153.10 | 171.29 | +12%˄ || 6.53 | 5.84 | -11%˄ | 0.0000 |
+| 17 || 300.57 | 316.84 | +5%˄ || 3.33 | 3.16 | -5%˄ | 0.0000 |
+| 19 || 104.48 | 106.16 | +2%˄ || 9.57 | 9.42 | -2%˄ | 0.0000 |
+| 25 || 168.11 | 167.46 | -0%˄ || 5.95 | 5.97 | +0%˄ | 0.1605 |
+| 26 || 132.49 | 138.00 | +4%˄ || 7.55 | 7.25 | -4%˄ | 0.0000 |
+| 28 || 611.89 | 640.44 | +5% || 1.63 | 1.56 | -4% | 0.0000 |
+| 29 || 454.77 | 599.40 | +32%˄ || 2.20 | 1.67 | -24%˄ | 0.0000 |
+| 31 || 1212.76 | 1369.28 | +13% || 0.82 | 0.73 | -11% | 0.0000 |
+| 32 || 45.29 | 46.26 | +2%˄ || 22.08 | 21.62 | -2%˄ | 0.0000 |
+| 34 || 157.83 | 158.46 | +0%˄ || 6.34 | 6.31 | -0%˄ | 0.2104 |
+| 35 || 620.29 | 649.24 | +5% || 1.61 | 1.54 | -4% | 0.0000 |
+| 37 || 261.57 | 268.69 | +3%˄ || 3.82 | 3.72 | -3%˄ | 0.0000 |
+| 39a || 1703.38 | 1979.19 | +16% || 0.59 | 0.51 | -14% | 0.0000 |
+| 39b || 1703.11 | 1956.82 | +15% || 0.59 | 0.51 | -13% | 0.0000 |
+| 41 || 281.04 | 275.13 | -2%˄ || 3.56 | 3.63 | +2%˄ | 0.0000 |
+| 42 || 82.20 | 85.39 | +4%˄ || 12.17 | 11.71 | -4%˄ | 0.0000 |
+| 43 || 842.81 | 880.45 | +4% || 1.19 | 1.14 | -4% | 0.0000 |
+| 45 || 113.76 | 118.19 | +4%˄ || 8.79 | 8.46 | -4%˄ | 0.0000 |
+| 48 || 1016.32 | 1213.06 | +19% || 0.98 | 0.82 | -16% | 0.0000 |
+| 50 || 110.74 | 116.17 | +5%˄ || 9.03 | 8.61 | -5%˄ | 0.0000 |
+| 52 || 80.59 | 85.29 | +6%˄ || 12.41 | 11.72 | -6%˄ | 0.0000 |
+| 55 || 77.19 | 80.41 | +4%˄ || 12.95 | 12.44 | -4%˄ | 0.0000 |
+| 62 || 524.41 | 539.27 | +3%˄ || 1.91 | 1.85 | -3%˄ | 0.0000 |
+| 65 || 1814.99 | 2180.90 | +20% || 0.55 | 0.46 | -17% | 0.0000 |
+| 69 || 119.17 | 123.65 | +4%˄ || 8.39 | 8.09 | -4%˄ | 0.0000 |
+| 73 || 78.29 | 81.41 | +4%˄ || 12.77 | 12.28 | -4%˄ | 0.0000 |
+| 79 || 454.84 | 474.80 | +4%˄ || 2.20 | 2.11 | -4%˄ | 0.0000 |
+| 81 || 203.00 | 229.17 | +13%˄ || 4.93 | 4.36 | -11%˄ | 0.0000 |
+| 82 || 335.24 | 348.30 | +4%˄ || 2.98 | 2.87 | -4%˄ | 0.0000 |
+| 83 || 47.46 | 48.22 | +2%˄ || 21.07 | 20.74 | -2%˄ | 0.0002 |
+| 85 || 131.63 | 134.36 | +2%˄ || 7.60 | 7.44 | -2%˄ | 0.0000 |
+| 88 || 613.12 | 636.98 | +4% || 1.63 | 1.57 | -4% | 0.0000 |
+| 91 || 18.95 | 19.37 | +2%˄ || 52.77 | 51.63 | -2%˄ | 0.0000 |
+| 92 || 45.95 | 47.89 | +4%˄ || 21.76 | 20.88 | -4%˄ | 0.0000 |
+| 93 || 3593.29 | 4113.39 | +14% || 0.28 | 0.24 | -13% | 0.0000 |
+| 94 || 98.52 | 100.54 | +2%˄ || 10.15 | 9.95 | -2%˄ | 0.0000 |
+| 95 || 8625.79 | 11945.02 | +38% || 0.12 | 0.08 | -28% | ˅ |
+| 96 || 58.36 | 61.36 | +5%˄ || 17.13 | 16.30 | -5%˄ | 0.0000 |
+| 97 || 3340.67 | 3791.60 | +13% || 0.30 | 0.26 | -12% | 0.0000 |
+| 99 || 984.69 | 1034.81 | +5% || 1.02 | 0.97 | -5% | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 33305.92 | 39401.09 | +18% || | | | |
+| Geomean || | | || | | -6% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
+| || ˅ Insufficient number of runs for p-value calculation |
++---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 9 clients, 9 cores Sum of avg. item runtimes: +7% || Geometric mean of throughput changes: -7%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 10:51:44 | 2024-01-12 14:41:30 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 477.62 | 658.43 | +38% || 0.18 | 0.17 | -7% | 0.0159 |
+| 03 || 254.28 | 265.96 | +5% || 0.18 | 0.17 | -7% | 0.8663 |
+| 06 || 499.63 | 481.63 | -4% || 0.18 | 0.17 | -7% | 0.8338 |
+| 07 || 777.15 | 734.77 | -5% || 0.18 | 0.17 | -6% | 0.7158 |
+| 09 || 659.53 | 691.50 | +5% || 0.18 | 0.17 | -6% | 0.7595 |
+| 10 || 451.15 | 655.25 | +45% || 0.18 | 0.17 | -6% | 0.0983 |
+| 13 || 1198.33 | 1218.52 | +2% || 0.18 | 0.17 | -7% | 0.8941 |
+| 15 || 439.87 | 317.37 | -28% || 0.18 | 0.17 | -6% | 0.0884 |
+| 16 || 529.18 | 505.81 | -4% || 0.18 | 0.17 | -7% | 0.7943 |
+| 17 || 1024.22 | 807.28 | -21% || 0.18 | 0.17 | -7% | 0.1472 |
+| 19 || 525.42 | 495.01 | -6% || 0.18 | 0.17 | -6% | 0.7885 |
+| 25 || 519.86 | 895.63 | +72% || 0.18 | 0.17 | -6% | 0.0028 |
+| 26 || 299.47 | 348.76 | +16% || 0.18 | 0.17 | -7% | 0.4304 |
+| 28 || 960.43 | 1077.05 | +12% || 0.18 | 0.17 | -6% | 0.5077 |
+| 29 || 920.68 | 1197.39 | +30% || 0.18 | 0.17 | -7% | 0.0252 |
+| 31 || 1681.46 | 1887.81 | +12% || 0.18 | 0.17 | -7% | 0.2316 |
+| 32 || 250.92 | 248.71 | -1% || 0.18 | 0.17 | -7% | 0.9767 |
+| 34 || 637.81 | 701.75 | +10% || 0.18 | 0.17 | -7% | 0.6359 |
+| 35 || 1501.14 | 1423.83 | -5% || 0.18 | 0.17 | -6% | 0.6657 |
+| 37 || 620.75 | 640.11 | +3% || 0.18 | 0.17 | -7% | 0.8424 |
+| 39a || 2031.53 | 2014.05 | -1% || 0.18 | 0.17 | -7% | 0.9064 |
+| 39b || 2092.52 | 2405.17 | +15% || 0.18 | 0.17 | -6% | 0.0800 |
+| 41 || 2287.65 | 2116.77 | -7% || 0.18 | 0.17 | -6% | 0.4101 |
+| 42 || 292.31 | 357.06 | +22% || 0.18 | 0.17 | -6% | 0.2639 |
+| 43 || 1419.12 | 1472.63 | +4% || 0.18 | 0.17 | -7% | 0.7048 |
+| 45 || 535.56 | 424.47 | -21% || 0.18 | 0.17 | -7% | 0.1988 |
+| 48 || 1659.67 | 1974.98 | +19% || 0.18 | 0.17 | -7% | 0.0463 |
+| 50 || 454.56 | 573.78 | +26% || 0.18 | 0.17 | -6% | 0.1716 |
+| 52 || 465.70 | 318.56 | -32% || 0.18 | 0.17 | -6% | 0.0643 |
+| 55 || 464.84 | 351.62 | -24% || 0.18 | 0.17 | -6% | 0.2538 |
+| 62 || 1018.71 | 980.18 | -4% || 0.18 | 0.17 | -7% | 0.7579 |
+| 65 || 2864.45 | 3150.02 | +10% || 0.18 | 0.17 | -7% | 0.0225 |
+| 69 || 640.83 | 580.24 | -9% || 0.18 | 0.17 | -7% | 0.5922 |
+| 73 || 448.84 | 426.29 | -5% || 0.18 | 0.17 | -6% | 0.7970 |
+| 79 || 1057.95 | 1140.98 | +8% || 0.18 | 0.17 | -6% | 0.4892 |
+| 81 || 429.30 | 456.24 | +6% || 0.18 | 0.17 | -7% | 0.6256 |
+| 82 || 676.01 | 727.52 | +8% || 0.18 | 0.17 | -7% | 0.5891 |
+| 83 || 250.64 | 255.15 | +2% || 0.18 | 0.17 | -6% | 0.9525 |
+| 85 || 507.32 | 720.44 | +42% || 0.18 | 0.17 | -7% | 0.0291 |
+| 88 || 1435.12 | 1898.87 | +32% || 0.18 | 0.17 | -7% | 0.0383 |
+| 91 || 129.27 | 168.57 | +30% || 0.18 | 0.17 | -6% | 0.4484 |
+| 92 || 222.98 | 188.57 | -15% || 0.18 | 0.17 | -7% | 0.4089 |
+| 93 || 2078.63 | 2272.60 | +9% || 0.18 | 0.17 | -7% | 0.2075 |
+| 94 || 596.02 | 485.62 | -19% || 0.18 | 0.17 | -7% | 0.4042 |
+| 95 || 4771.08 | 5197.18 | +9% || 0.18 | 0.17 | -6% | 0.0423 |
+| 96 || 368.22 | 342.71 | -7% || 0.18 | 0.17 | -7% | 0.7625 |
+| 97 || 3684.72 | 4069.94 | +10% || 0.18 | 0.17 | -7% | 0.0189 |
+| 99 || 1255.99 | 1450.21 | +15% || 0.18 | 0.17 | -7% | 0.1303 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 48368.40 | 51773.00 | +7% || | | | |
+| Geomean || | | || | | -7% | |
++---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 11:12:07 | 2024-01-12 15:01:52 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 54.89 | 53.38 | -3% || 1.63 | 1.67 | +2% | (run time too short) |
+| New-Order || 45.38 | 43.97 | -3% || 18.14 | 18.78 | +3% | 0.0159 |
+| Order-Status || 2.47 | 2.33 | -6% || 1.62 | 1.67 | +3% | (run time too short) |
+| Payment || 4.33 | 4.14 | -4% || 17.39 | 17.94 | +3% | 0.0000 |
+| Stock-Level || 4.15 | 3.97 | -4% || 1.63 | 1.67 | +2% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 111.22 | 107.78 | -3% || | | | |
+| Geomean || | | || | | +3% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 9 clients, 9 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 11:13:13 | 2024-01-12 15:02:58 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 173.65 | 168.23 | -3% || 4.47 | 4.55 | +2% | 0.0128 |
+| unsucc.: || 5.66 | 4.21 | -26% || 0.25 | 0.25 | -1% | |
+| New-Order || 142.81 | 140.66 | -2% || 49.25 | 49.95 | +1% | 0.0008 |
+| unsucc.: || 17.17 | 19.31 | +12% || 3.86 | 4.13 | +7% | |
+| Order-Status || 6.40 | 6.33 | -1% || 4.72 | 4.81 | +2% | 0.6247 |
+| Payment || 9.26 | 8.93 | -4% || 45.65 | 46.50 | +2% | 0.0002 |
+| unsucc.: || 14.47 | 13.67 | -6% || 5.12 | 5.18 | +1% | |
+| Stock-Level || 11.79 | 12.13 | +3% || 4.72 | 4.81 | +2% | 0.4159 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 343.91 | 336.28 | -2% || | | | |
+| Geomean || | | || | | +2% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +7% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 11:33:20 | 2024-01-12 15:23:04 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 157.71 | 153.54 | -3%˄ || 6.34 | 6.51 | +3%˄ | 0.0000 |
+| 10b || 110.99 | 109.10 | -2%˄ || 9.01 | 9.17 | +2%˄ | 0.0000 |
+| 10c || 318.45 | 325.72 | +2%˄ || 3.14 | 3.07 | -2%˄ | 0.0000 |
+| 11a || 16.88 | 16.57 | -2%˄ || 59.25 | 60.34 | +2%˄ | 0.0000 |
+| 11b || 16.36 | 16.36 | +0%˄ || 61.12 | 61.11 | -0%˄ | 0.9657 |
+| 11c || 21.64 | 21.51 | -1%˄ || 46.21 | 46.49 | +1%˄ | 0.0000 |
+| 11d || 24.50 | 24.17 | -1%˄ || 40.82 | 41.37 | +1%˄ | 0.0000 |
+| 12a || 51.42 | 50.31 | -2%˄ || 19.45 | 19.88 | +2%˄ | 0.0000 |
+| 12b || 28.52 | 28.57 | +0%˄ || 35.07 | 35.00 | -0%˄ | 0.0047 |
+| 12c || 88.21 | 87.39 | -1%˄ || 11.34 | 11.44 | +1%˄ | 0.0000 |
+| 13a || 274.14 | 271.58 | -1%˄ || 3.65 | 3.68 | +1%˄ | 0.0000 |
+| 13b || 155.64 | 154.28 | -1%˄ || 6.42 | 6.48 | +1%˄ | 0.0000 |
+| 13c || 119.54 | 118.30 | -1%˄ || 8.36 | 8.45 | +1%˄ | 0.0000 |
+| 13d || 576.20 | 612.83 | +6%˄ || 1.74 | 1.63 | -6%˄ | (run time too short) |
+| 14a || 404.26 | 516.22 | +28%˄ || 2.47 | 1.94 | -22%˄ | 0.0000 |
+| 14b || 228.73 | 226.50 | -1%˄ || 4.37 | 4.42 | +1%˄ | 0.0000 |
+| 14c || 479.99 | 588.82 | +23%˄ || 2.08 | 1.70 | -18%˄ | 0.0000 |
+| 15a || 83.46 | 92.24 | +11%˄ || 11.98 | 10.84 | -10%˄ | 0.0000 |
+| 15b || 82.84 | 91.80 | +11%˄ || 12.07 | 10.89 | -10%˄ | 0.0000 |
+| 15c || 89.13 | 98.48 | +10%˄ || 11.22 | 10.15 | -9%˄ | 0.0000 |
+| 15d || 84.20 | 93.47 | +11%˄ || 11.88 | 10.70 | -10%˄ | 0.0000 |
+| 16a || 2099.14 | 2558.28 | +22% || 0.48 | 0.39 | -18% | 0.0000 |
+| 16b || 3066.25 | 3583.96 | +17% || 0.33 | 0.28 | -14% | 0.0000 |
+| 16c || 2205.01 | 2644.69 | +20% || 0.45 | 0.38 | -17% | 0.0000 |
+| 16d || 2178.24 | 2627.01 | +21% || 0.46 | 0.38 | -17% | 0.0000 |
+| 17a || 569.36 | 568.16 | -0%˄ || 1.76 | 1.76 | +0%˄ | 0.0080 |
+| 17b || 444.20 | 447.68 | +1%˄ || 2.25 | 2.23 | -1%˄ | 0.0000 |
+| 17c || 421.74 | 426.03 | +1%˄ || 2.37 | 2.35 | -1%˄ | 0.0000 |
+| 17d || 499.92 | 501.33 | +0%˄ || 2.00 | 1.99 | -0%˄ | 0.0000 |
+| 17e || 1524.14 | 1613.74 | +6% || 0.66 | 0.62 | -6% | 0.0000 |
+| 17f || 912.61 | 907.98 | -1% || 1.10 | 1.10 | +1% | 0.0000 |
+| 18a || 601.05 | 649.34 | +8%˄ || 1.66 | 1.54 | -7%˄ | 0.0000 |
+| 18b || 110.08 | 110.07 | -0%˄ || 9.08 | 9.08 | +0%˄ | 0.8449 |
+| 18c || 545.85 | 543.13 | -0%˄ || 1.83 | 1.84 | +1%˄ | 0.0000 |
+| 19a || 178.68 | 178.48 | -0%˄ || 5.60 | 5.60 | +0%˄ | 0.1167 |
+| 19b || 125.43 | 124.78 | -1%˄ || 7.97 | 8.01 | +1%˄ | 0.0000 |
+| 19c || 190.43 | 189.31 | -1%˄ || 5.25 | 5.28 | +1%˄ | 0.0000 |
+| 19d || 694.11 | 684.41 | -1% || 1.44 | 1.46 | +1% | 0.0000 |
+| 1a || 10.78 | 10.75 | -0%˄ || 92.75 | 93.02 | +0%˄ | 0.1479 |
+| 1b || 10.14 | 10.07 | -1%˄ || 98.56 | 99.24 | +1%˄ | 0.0000 |
+| 1c || 11.38 | 11.29 | -1%˄ || 87.85 | 88.57 | +1%˄ | 0.0000 |
+| 1d || 10.13 | 10.04 | -1%˄ || 98.74 | 99.61 | +1%˄ | 0.0000 |
+| 20a || 382.30 | 379.89 | -1%˄ || 2.62 | 2.63 | +1%˄ | 0.0000 |
+| 20b || 229.66 | 228.36 | -1%˄ || 4.35 | 4.38 | +1%˄ | 0.0000 |
+| 20c || 223.26 | 221.05 | -1%˄ || 4.48 | 4.52 | +1%˄ | 0.0000 |
+| 21a || 34.67 | 34.69 | +0%˄ || 28.84 | 28.83 | -0%˄ | 0.1944 |
+| 21b || 20.63 | 20.63 | -0%˄ || 48.46 | 48.47 | +0%˄ | 0.6667 |
+| 21c || 34.91 | 34.95 | +0%˄ || 28.64 | 28.61 | -0%˄ | 0.0027 |
+| 22a || 195.19 | 192.21 | -2%˄ || 5.12 | 5.20 | +2%˄ | 0.0000 |
+| 22b || 143.93 | 141.24 | -2%˄ || 6.95 | 7.08 | +2%˄ | 0.0000 |
+| 22c || 468.97 | 465.12 | -1%˄ || 2.13 | 2.15 | +1%˄ | 0.0000 |
+| 22d || 846.27 | 890.31 | +5% || 1.18 | 1.12 | -5% | 0.0000 |
+| 23a || 44.08 | 44.09 | +0%˄ || 22.69 | 22.68 | -0%˄ | 0.7684 |
+| 23b || 46.18 | 46.29 | +0%˄ || 21.65 | 21.60 | -0%˄ | 0.0000 |
+| 23c || 87.15 | 91.90 | +5%˄ || 11.47 | 10.88 | -5%˄ | 0.0000 |
+| 24a || 139.86 | 140.26 | +0%˄ || 7.15 | 7.13 | -0%˄ | 0.0000 |
+| 24b || 118.29 | 117.99 | -0%˄ || 8.45 | 8.48 | +0%˄ | 0.0000 |
+| 25a || 270.34 | 273.96 | +1%˄ || 3.70 | 3.65 | -1%˄ | 0.0000 |
+| 25b || 109.12 | 109.08 | -0%˄ || 9.16 | 9.17 | +0%˄ | 0.7854 |
+| 25c || 913.67 | 917.12 | +0% || 1.09 | 1.09 | -0% | 0.0014 |
+| 26a || 165.97 | 164.52 | -1%˄ || 6.03 | 6.08 | +1%˄ | 0.0000 |
+| 26b || 130.07 | 129.69 | -0%˄ || 7.69 | 7.71 | +0%˄ | 0.0000 |
+| 26c || 240.42 | 238.34 | -1%˄ || 4.16 | 4.20 | +1%˄ | 0.0000 |
+| 27a || 24.91 | 24.74 | -1%˄ || 40.14 | 40.41 | +1%˄ | 0.0000 |
+| 27b || 24.33 | 24.25 | -0%˄ || 41.09 | 41.23 | +0%˄ | 0.0004 |
+| 27c || 34.94 | 34.90 | -0%˄ || 28.62 | 28.65 | +0%˄ | 0.0231 |
+| 28a || 287.41 | 283.77 | -1%˄ || 3.48 | 3.52 | +1%˄ | 0.0000 |
+| 28b || 40.32 | 40.22 | -0%˄ || 24.80 | 24.86 | +0%˄ | 0.0000 |
+| 28c || 318.86 | 315.65 | -1%˄ || 3.14 | 3.17 | +1%˄ | 0.0000 |
+| 29a || 99.79 | 99.87 | +0%˄ || 10.02 | 10.01 | -0%˄ | 0.6101 |
+| 29b || 75.14 | 75.12 | -0%˄ || 13.31 | 13.31 | +0%˄ | 0.8795 |
+| 29c || 143.92 | 144.35 | +0%˄ || 6.95 | 6.93 | -0%˄ | 0.0000 |
+| 2a || 51.46 | 51.70 | +0%˄ || 19.43 | 19.34 | -0%˄ | 0.0000 |
+| 2b || 42.18 | 41.82 | -1%˄ || 23.71 | 23.91 | +1%˄ | 0.0000 |
+| 2c || 23.14 | 23.11 | -0%˄ || 43.20 | 43.27 | +0%˄ | 0.0002 |
+| 2d || 72.64 | 72.05 | -1%˄ || 13.77 | 13.88 | +1%˄ | 0.0000 |
+| 30a || 147.45 | 147.61 | +0%˄ || 6.78 | 6.77 | -0%˄ | 0.0039 |
+| 30b || 130.70 | 130.16 | -0%˄ || 7.65 | 7.68 | +0%˄ | 0.0000 |
+| 30c || 369.56 | 369.55 | -0%˄ || 2.71 | 2.71 | +0%˄ | 0.9839 |
+| 31a || 142.54 | 142.73 | +0%˄ || 7.02 | 7.01 | -0%˄ | 0.2320 |
+| 31b || 120.22 | 120.15 | -0%˄ || 8.32 | 8.32 | +0%˄ | 0.3458 |
+| 31c || 165.31 | 165.76 | +0%˄ || 6.05 | 6.03 | -0%˄ | 0.0000 |
+| 32a || 15.69 | 15.67 | -0%˄ || 63.70 | 63.82 | +0%˄ | 0.0001 |
+| 32b || 37.96 | 37.58 | -1%˄ || 26.34 | 26.60 | +1%˄ | 0.0000 |
+| 33a || 23.30 | 23.29 | -0%˄ || 42.92 | 42.93 | +0%˄ | 0.6347 |
+| 33b || 22.76 | 22.63 | -1%˄ || 43.93 | 44.18 | +1%˄ | 0.0000 |
+| 33c || 26.38 | 26.38 | -0%˄ || 37.90 | 37.91 | +0%˄ | 0.5669 |
+| 3a || 123.04 | 122.89 | -0%˄ || 8.13 | 8.14 | +0%˄ | 0.0807 |
+| 3b || 14.29 | 14.32 | +0%˄ || 69.94 | 69.83 | -0%˄ | 0.0031 |
+| 3c || 435.09 | 479.80 | +10%˄ || 2.30 | 2.08 | -9%˄ | 0.0000 |
+| 4a || 115.20 | 137.08 | +19%˄ || 8.68 | 7.29 | -16%˄ | 0.0000 |
+| 4b || 13.23 | 13.41 | +1%˄ || 75.58 | 74.58 | -1%˄ | 0.0000 |
+| 4c || 127.87 | 154.27 | +21%˄ || 7.82 | 6.48 | -17%˄ | 0.0000 |
+| 5a || 58.27 | 57.15 | -2%˄ || 17.16 | 17.50 | +2%˄ | 0.0000 |
+| 5b || 137.31 | 133.88 | -2%˄ || 7.28 | 7.47 | +3%˄ | 0.0000 |
+| 5c || 189.74 | 187.89 | -1%˄ || 5.27 | 5.32 | +1%˄ | 0.0000 |
+| 6a || 99.70 | 100.20 | +1%˄ || 10.03 | 9.98 | -1%˄ | 0.0000 |
+| 6b || 113.76 | 114.10 | +0%˄ || 8.79 | 8.76 | -0%˄ | 0.0000 |
+| 6c || 95.07 | 94.86 | -0%˄ || 10.52 | 10.54 | +0%˄ | 0.0000 |
+| 6d || 501.99 | 508.99 | +1%˄ || 1.99 | 1.96 | -1%˄ | 0.0000 |
+| 6e || 99.75 | 100.20 | +0%˄ || 10.03 | 9.98 | -0%˄ | 0.0000 |
+| 6f || 669.65 | 666.00 | -1% || 1.49 | 1.50 | +1% | 0.0000 |
+| 7a || 53.41 | 54.04 | +1%˄ || 18.72 | 18.50 | -1%˄ | 0.0000 |
+| 7b || 48.84 | 49.08 | +1%˄ || 20.48 | 20.37 | -1%˄ | 0.0002 |
+| 7c || 565.27 | 574.66 | +2%˄ || 1.77 | 1.74 | -2%˄ | 0.0000 |
+| 8a || 38.87 | 38.82 | -0%˄ || 25.73 | 25.75 | +0%˄ | 0.1545 |
+| 8b || 36.40 | 35.99 | -1%˄ || 27.47 | 27.78 | +1%˄ | 0.0000 |
+| 8c || 1790.72 | 1898.98 | +6% || 0.56 | 0.53 | -6% | 0.0000 |
+| 8d || 300.28 | 295.48 | -2%˄ || 3.33 | 3.38 | +2%˄ | 0.0000 |
+| 9a || 185.67 | 183.37 | -1%˄ || 5.39 | 5.45 | +1%˄ | 0.0000 |
+| 9b || 108.73 | 107.15 | -1%˄ || 9.20 | 9.33 | +1%˄ | 0.0000 |
+| 9c || 272.32 | 270.85 | -1%˄ || 3.67 | 3.69 | +1%˄ | 0.0000 |
+| 9d || 465.30 | 455.99 | -2%˄ || 2.15 | 2.19 | +2%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 33767.10 | 36262.47 | +7% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 9 clients, 9 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 12:15:10 | 2024-01-12 16:05:30 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 189.93 | 313.99 | +65% || 0.18 | 0.18 | +0% | 0.0284 |
+| 10b || 158.00 | 173.91 | +10% || 0.18 | 0.18 | +0% | 0.6527 |
+| 10c || 351.66 | 520.65 | +48% || 0.18 | 0.18 | -0% | 0.0027 |
+| 11a || 43.67 | 45.44 | +4% || 0.18 | 0.18 | +0% | 0.8614 |
+| 11b || 80.16 | 41.54 | -48% || 0.18 | 0.18 | +0% | 0.2170 |
+| 11c || 94.00 | 73.63 | -22% || 0.18 | 0.18 | +0% | 0.3775 |
+| 11d || 76.83 | 70.64 | -8% || 0.18 | 0.18 | -0% | 0.7115 |
+| 12a || 161.64 | 163.90 | +1% || 0.18 | 0.18 | -0% | 0.9473 |
+| 12b || 70.72 | 83.02 | +17% || 0.18 | 0.18 | +0% | 0.6442 |
+| 12c || 287.98 | 270.55 | -6% || 0.18 | 0.18 | -0% | 0.7258 |
+| 13a || 465.21 | 421.15 | -9% || 0.18 | 0.18 | +0% | 0.3013 |
+| 13b || 207.58 | 232.95 | +12% || 0.18 | 0.18 | +0% | 0.5327 |
+| 13c || 188.45 | 225.24 | +20% || 0.18 | 0.18 | +0% | 0.3159 |
+| 13d || 788.11 | 784.45 | -0% || 0.18 | 0.18 | +0% | 0.9506 |
+| 14a || 628.44 | 677.34 | +8% || 0.18 | 0.18 | -0% | 0.4768 |
+| 14b || 453.41 | 445.65 | -2% || 0.18 | 0.18 | +0% | 0.8965 |
+| 14c || 780.58 | 859.87 | +10% || 0.17 | 0.18 | +0% | 0.2909 |
+| 15a || 161.57 | 181.74 | +12% || 0.18 | 0.18 | +0% | 0.6493 |
+| 15b || 117.25 | 130.84 | +12% || 0.18 | 0.18 | +0% | 0.5835 |
+| 15c || 161.87 | 162.73 | +1% || 0.18 | 0.18 | +0% | 0.9807 |
+| 15d || 143.31 | 184.73 | +29% || 0.18 | 0.18 | +0% | 0.1581 |
+| 16a || 2370.61 | 2275.93 | -4% || 0.17 | 0.18 | +0% | 0.3205 |
+| 16b || 3327.60 | 3366.27 | +1% || 0.17 | 0.18 | +0% | 0.6768 |
+| 16c || 2376.47 | 2363.63 | -1% || 0.17 | 0.18 | +1% | 0.8962 |
+| 16d || 2347.46 | 2348.99 | +0% || 0.17 | 0.18 | +0% | 0.9880 |
+| 17a || 998.91 | 950.83 | -5% || 0.18 | 0.18 | +0% | 0.6283 |
+| 17b || 810.43 | 786.03 | -3% || 0.18 | 0.18 | +0% | 0.8049 |
+| 17c || 731.59 | 624.19 | -15% || 0.18 | 0.18 | +0% | 0.2429 |
+| 17d || 779.13 | 835.23 | +7% || 0.17 | 0.18 | +0% | 0.6105 |
+| 17e || 1561.07 | 1518.82 | -3% || 0.18 | 0.18 | -0% | 0.6466 |
+| 17f || 1287.29 | 1223.21 | -5% || 0.18 | 0.18 | -0% | 0.5258 |
+| 18a || 727.86 | 695.39 | -4% || 0.18 | 0.18 | +0% | 0.6415 |
+| 18b || 201.11 | 268.55 | +34% || 0.18 | 0.18 | -0% | 0.1789 |
+| 18c || 856.20 | 715.11 | -16% || 0.18 | 0.18 | +0% | 0.0474 |
+| 19a || 444.62 | 444.32 | -0% || 0.18 | 0.18 | +0% | 0.9964 |
+| 19b || 256.87 | 424.28 | +65% || 0.18 | 0.18 | +0% | 0.0069 |
+| 19c || 511.80 | 490.73 | -4% || 0.18 | 0.18 | +0% | 0.7709 |
+| 19d || 1352.92 | 1214.75 | -10% || 0.18 | 0.18 | -0% | 0.1706 |
+| 1a || 49.73 | 69.58 | +40% || 0.18 | 0.18 | -0% | 0.6139 |
+| 1b || 23.17 | 19.67 | -15% || 0.18 | 0.18 | -1% | 0.3993 |
+| 1c || 32.13 | 26.33 | -18% || 0.18 | 0.18 | -0% | 0.4756 |
+| 1d || 67.75 | 28.79 | -58% || 0.18 | 0.18 | +0% | 0.0798 |
+| 20a || 588.81 | 629.78 | +7% || 0.18 | 0.18 | +0% | 0.5870 |
+| 20b || 403.40 | 378.01 | -6% || 0.18 | 0.18 | -0% | 0.6009 |
+| 20c || 481.04 | 414.22 | -14% || 0.18 | 0.18 | +0% | 0.2955 |
+| 21a || 76.82 | 66.95 | -13% || 0.18 | 0.18 | +0% | 0.4484 |
+| 21b || 65.17 | 122.59 | +88% || 0.18 | 0.18 | +0% | 0.0933 |
+| 21c || 77.10 | 79.71 | +3% || 0.18 | 0.18 | +0% | 0.8615 |
+| 22a || 480.77 | 481.11 | +0% || 0.18 | 0.18 | +0% | 0.9963 |
+| 22b || 279.25 | 295.40 | +6% || 0.18 | 0.18 | +0% | 0.7021 |
+| 22c || 661.54 | 775.60 | +17% || 0.18 | 0.18 | +0% | 0.0808 |
+| 22d || 977.12 | 945.05 | -3% || 0.18 | 0.18 | -0% | 0.6687 |
+| 23a || 156.05 | 123.24 | -21% || 0.18 | 0.18 | +0% | 0.2478 |
+| 23b || 162.82 | 87.78 | -46% || 0.18 | 0.18 | +0% | 0.0778 |
+| 23c || 182.71 | 165.27 | -10% || 0.18 | 0.18 | -0% | 0.6324 |
+| 24a || 255.32 | 265.70 | +4% || 0.18 | 0.18 | +0% | 0.8079 |
+| 24b || 175.77 | 180.84 | +3% || 0.18 | 0.18 | +0% | 0.9082 |
+| 25a || 514.36 | 509.53 | -1% || 0.18 | 0.18 | +0% | 0.9448 |
+| 25b || 234.36 | 185.93 | -21% || 0.18 | 0.18 | +0% | 0.3259 |
+| 25c || 1031.43 | 960.12 | -7% || 0.18 | 0.18 | -0% | 0.4231 |
+| 26a || 372.84 | 425.63 | +14% || 0.18 | 0.18 | -0% | 0.4834 |
+| 26b || 219.45 | 225.78 | +3% || 0.18 | 0.18 | -0% | 0.8678 |
+| 26c || 503.16 | 420.21 | -16% || 0.18 | 0.18 | +0% | 0.1462 |
+| 27a || 113.61 | 72.85 | -36% || 0.18 | 0.18 | +0% | 0.0993 |
+| 27b || 141.91 | 117.35 | -17% || 0.18 | 0.18 | -0% | 0.5137 |
+| 27c || 95.18 | 66.42 | -30% || 0.18 | 0.18 | -0% | 0.1505 |
+| 28a || 632.93 | 603.01 | -5% || 0.18 | 0.18 | +0% | 0.6643 |
+| 28b || 162.90 | 135.86 | -17% || 0.18 | 0.18 | -0% | 0.3748 |
+| 28c || 602.99 | 599.79 | -1% || 0.18 | 0.18 | +0% | 0.9631 |
+| 29a || 216.37 | 241.69 | +12% || 0.18 | 0.18 | +0% | 0.5716 |
+| 29b || 125.05 | 143.72 | +15% || 0.18 | 0.18 | +0% | 0.4495 |
+| 29c || 264.96 | 237.54 | -10% || 0.18 | 0.18 | -0% | 0.5254 |
+| 2a || 119.91 | 169.84 | +42% || 0.18 | 0.18 | +0% | 0.1870 |
+| 2b || 138.11 | 114.19 | -17% || 0.18 | 0.18 | -0% | 0.3644 |
+| 2c || 59.89 | 76.77 | +28% || 0.18 | 0.18 | +0% | 0.2913 |
+| 2d || 233.10 | 164.89 | -29% || 0.18 | 0.18 | -0% | 0.0598 |
+| 30a || 310.99 | 338.56 | +9% || 0.18 | 0.18 | -0% | 0.6188 |
+| 30b || 243.08 | 279.49 | +15% || 0.18 | 0.18 | +0% | 0.5647 |
+| 30c || 720.78 | 714.22 | -1% || 0.18 | 0.18 | +0% | 0.9391 |
+| 31a || 294.87 | 281.17 | -5% || 0.18 | 0.18 | -0% | 0.7814 |
+| 31b || 234.24 | 189.33 | -19% || 0.18 | 0.18 | +0% | 0.2710 |
+| 31c || 338.56 | 277.47 | -18% || 0.18 | 0.18 | +0% | 0.1533 |
+| 32a || 36.02 | 65.28 | +81% || 0.18 | 0.18 | +0% | 0.1022 |
+| 32b || 100.89 | 116.62 | +16% || 0.18 | 0.18 | -0% | 0.4747 |
+| 33a || 66.59 | 71.25 | +7% || 0.18 | 0.18 | +0% | 0.8030 |
+| 33b || 44.81 | 53.44 | +19% || 0.18 | 0.18 | +0% | 0.3588 |
+| 33c || 101.59 | 79.66 | -22% || 0.18 | 0.18 | -0% | 0.5373 |
+| 3a || 234.59 | 284.56 | +21% || 0.18 | 0.18 | -0% | 0.3736 |
+| 3b || 50.04 | 50.15 | +0% || 0.18 | 0.18 | +0% | 0.9952 |
+| 3c || 493.25 | 586.23 | +19% || 0.18 | 0.18 | +0% | 0.0995 |
+| 4a || 170.91 | 195.80 | +15% || 0.18 | 0.18 | +0% | 0.5131 |
+| 4b || 44.78 | 62.24 | +39% || 0.18 | 0.18 | +0% | 0.4023 |
+| 4c || 218.99 | 184.88 | -16% || 0.18 | 0.18 | -0% | 0.4232 |
+| 5a || 155.23 | 153.88 | -1% || 0.18 | 0.18 | +0% | 0.9739 |
+| 5b || 200.61 | 180.62 | -10% || 0.18 | 0.18 | -0% | 0.5960 |
+| 5c || 212.07 | 277.70 | +31% || 0.18 | 0.18 | -0% | 0.0730 |
+| 6a || 116.34 | 161.78 | +39% || 0.18 | 0.18 | +0% | 0.1449 |
+| 6b || 168.88 | 172.79 | +2% || 0.18 | 0.18 | +0% | 0.9032 |
+| 6c || 151.55 | 137.68 | -9% || 0.18 | 0.18 | -0% | 0.6802 |
+| 6d || 635.74 | 641.29 | +1% || 0.18 | 0.18 | -0% | 0.9334 |
+| 6e || 142.47 | 150.26 | +5% || 0.18 | 0.18 | +0% | 0.8560 |
+| 6f || 1045.62 | 1057.41 | +1% || 0.17 | 0.18 | +1% | 0.8946 |
+| 7a || 160.61 | 141.13 | -12% || 0.18 | 0.18 | +0% | 0.6690 |
+| 7b || 95.82 | 109.18 | +14% || 0.18 | 0.18 | +0% | 0.5201 |
+| 7c || 1004.74 | 1132.91 | +13% || 0.18 | 0.18 | +0% | 0.2702 |
+| 8a || 100.10 | 122.49 | +22% || 0.18 | 0.18 | +0% | 0.3838 |
+| 8b || 113.96 | 88.01 | -23% || 0.18 | 0.18 | +0% | 0.2599 |
+| 8c || 1887.37 | 1946.61 | +3% || 0.18 | 0.18 | +0% | 0.4876 |
+| 8d || 581.36 | 498.40 | -14% || 0.18 | 0.18 | +0% | 0.2949 |
+| 9a || 480.09 | 446.30 | -7% || 0.18 | 0.18 | +0% | 0.6172 |
+| 9b || 327.87 | 347.12 | +6% || 0.18 | 0.18 | +0% | 0.7840 |
+| 9c || 658.52 | 680.00 | +3% || 0.18 | 0.18 | -0% | 0.7775 |
+| 9d || 1076.05 | 862.29 | -20% || 0.18 | 0.18 | +0% | 0.0064 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 50551.20 | 50375.15 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +7% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 12:35:31 | 2024-01-12 16:25:50 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 333.36 | 339.03 | +2%˄ || 3.00 | 2.95 | -2%˄ | 0.0251 |
+| 1.2 || 100.48 | 96.49 | -4%˄ || 9.95 | 10.36 | +4%˄ | 0.0000 |
+| 1.3 || 97.13 | 93.12 | -4%˄ || 10.29 | 10.74 | +4%˄ | 0.0000 |
+| 2.1 || 519.02 | 518.16 | -0%˄ || 1.93 | 1.93 | +0%˄ | 0.2993 |
+| 2.2 || 273.10 | 269.66 | -1%˄ || 3.66 | 3.71 | +1%˄ | 0.0000 |
+| 2.3 || 180.58 | 176.96 | -2%˄ || 5.54 | 5.65 | +2%˄ | 0.0000 |
+| 3.1 || 2795.44 | 2954.40 | +6% || 0.36 | 0.34 | -5% | 0.0000 |
+| 3.2 || 255.71 | 257.82 | +1%˄ || 3.91 | 3.88 | -1%˄ | 0.0000 |
+| 3.3 || 115.89 | 115.91 | +0%˄ || 8.63 | 8.63 | -0%˄ | 0.9205 |
+| 3.4 || 108.70 | 107.78 | -1%˄ || 9.20 | 9.28 | +1%˄ | 0.0007 |
+| 4.1 || 3604.11 | 4133.10 | +15% || 0.28 | 0.24 | -13% | 0.0000 |
+| 4.2 || 802.09 | 795.49 | -1% || 1.25 | 1.26 | +1% | 0.0313 |
+| 4.3 || 265.13 | 264.68 | -0%˄ || 3.77 | 3.78 | +0%˄ | 0.4312 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 9450.73 | 10122.61 | +7% || | | | |
+| Geomean || | | || | | -1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 9 clients, 9 cores Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 12:42:54 | 2024-01-12 16:33:13 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 598.45 | 634.25 | +6% || 0.68 | 0.67 | -2% | 0.3810 |
+| 1.2 || 364.32 | 355.09 | -3% || 0.68 | 0.67 | -2% | 0.7985 |
+| 1.3 || 243.63 | 233.12 | -4% || 0.68 | 0.67 | -2% | 0.6406 |
+| 2.1 || 1443.83 | 1447.21 | +0% || 0.68 | 0.67 | -2% | 0.9613 |
+| 2.2 || 820.53 | 753.04 | -8% || 0.68 | 0.67 | -2% | 0.2387 |
+| 2.3 || 315.86 | 322.48 | +2% || 0.68 | 0.67 | -2% | 0.8203 |
+| 3.1 || 2845.01 | 2865.10 | +1% || 0.68 | 0.67 | -2% | 0.7986 |
+| 3.2 || 741.94 | 724.29 | -2% || 0.68 | 0.67 | -2% | 0.7295 |
+| 3.3 || 406.63 | 458.68 | +13% || 0.68 | 0.67 | -2% | 0.1855 |
+| 3.4 || 458.96 | 381.76 | -17% || 0.68 | 0.67 | -2% | 0.0543 |
+| 4.1 || 2478.33 | 2578.72 | +4% || 0.68 | 0.67 | -2% | 0.1387 |
+| 4.2 || 1757.90 | 1859.51 | +6% || 0.68 | 0.67 | -2% | 0.2103 |
+| 4.3 || 645.33 | 734.03 | +14% || 0.68 | 0.67 | -2% | 0.0916 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 13120.73 | 13347.29 | +2% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+AMDSystem cx18 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -5%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 09:22:17 | 2024-01-12 13:29:53 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5974.10 | 6080.17 | +2% || 0.17 | 0.16 | -2% | 0.0455 |
+| TPC-H 02 || 50.27 | 48.18 | -4%˄ || 19.89 | 20.75 | +4%˄ | 0.0003 |
+| TPC-H 03 || 2481.71 | 2989.20 | +20% || 0.40 | 0.33 | -17% | 0.0000 |
+| TPC-H 04 || 2077.15 | 2408.49 | +16% || 0.48 | 0.42 | -14% | 0.0000 |
+| TPC-H 05 || 4964.73 | 5335.46 | +7% || 0.20 | 0.19 | -7% | 0.0000 |
+| TPC-H 06 || 206.92 | 218.17 | +5%˄ || 4.83 | 4.58 | -5%˄ | 0.0000 |
+| TPC-H 07 || 1104.50 | 1119.12 | +1% || 0.91 | 0.89 | -1% | 0.0005 |
+| TPC-H 08 || 1012.61 | 1114.46 | +10% || 0.99 | 0.90 | -9% | 0.0000 |
+| TPC-H 09 || 7484.31 | 8380.60 | +12% || 0.13 | 0.12 | -11% | ˅ |
+| TPC-H 10 || 3142.14 | 3410.08 | +9% || 0.32 | 0.29 | -8% | 0.0000 |
+| TPC-H 11 || 84.59 | 94.83 | +12%˄ || 11.82 | 10.55 | -11%˄ | 0.0000 |
+| TPC-H 12 || 1944.90 | 1950.72 | +0% || 0.51 | 0.51 | -0% | 0.4792 |
+| TPC-H 13 || 6403.66 | 6411.94 | +0% || 0.16 | 0.16 | -0% | 0.7698 |
+| TPC-H 14 || 668.80 | 668.84 | +0% || 1.50 | 1.50 | -0% | 0.9893 |
+| TPC-H 15 || 264.91 | 268.32 | +1%˄ || 3.77 | 3.73 | -1%˄ | 0.0001 |
+| TPC-H 16 || 829.73 | 861.71 | +4% || 1.21 | 1.16 | -4% | 0.0000 |
+| TPC-H 17 || 278.49 | 282.46 | +1%˄ || 3.59 | 3.54 | -1%˄ | 0.0000 |
+| TPC-H 18 || 1613.66 | 1983.88 | +23% || 0.62 | 0.50 | -19% | 0.0000 |
+| TPC-H 19 || 315.77 | 315.22 | -0%˄ || 3.17 | 3.17 | +0%˄ | 0.5946 |
+| TPC-H 20 || 595.51 | 602.22 | +1%˄ || 1.68 | 1.66 | -1%˄ | 0.0711 |
+| TPC-H 21 || 7906.32 | 8074.85 | +2% || 0.13 | 0.12 | -2% | ˅ |
+| TPC-H 22 || 615.56 | 624.80 | +2% || 1.62 | 1.60 | -1% | 0.0000 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 50020.34 | 53243.72 | +6% || | | | |
+| Geomean || | | || | | -5% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
+| || ˅ Insufficient number of runs for p-value calculation |
++----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 09:43:38 | 2024-01-12 13:51:09 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+++----------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 9.54 | 9.65 | +1%˄ || 104.75 | 103.58 | -1%˄ | 0.3667 |
+| TPC-H 02 || 4.09 | 3.33 | -18%˄ || 244.55 | 299.76 | +23%˄ | 0.0009 |
+| TPC-H 03 || 0.65 | 0.65 | +0%˄ || 1543.36 | 1542.39 | -0%˄ | 0.9472 |
+| TPC-H 04 || 0.43 | 0.43 | +0%˄ || 2341.10 | 2330.38 | -0%˄ | 0.2143 |
+| TPC-H 05 || 1.04 | 1.06 | +1%˄ || 959.27 | 945.56 | -1%˄ | 0.1077 |
+| TPC-H 06 || 0.21 | 0.21 | +1%˄ || 4710.51 | 4663.22 | -1%˄ | 0.1312 |
+| TPC-H 07 || 11.14 | 9.65 | -13%˄ || 89.79 | 103.56 | +15%˄ | 0.0293 |
+| TPC-H 08 || 14.82 | 14.27 | -4%˄ || 67.45 | 70.09 | +4%˄ | 0.1175 |
+| TPC-H 09 || 3.89 | 3.83 | -2%˄ || 256.87 | 260.88 | +2%˄ | 0.9120 |
+| TPC-H 10 || 0.72 | 0.72 | -0%˄ || 1390.40 | 1393.43 | +0%˄ | 0.6052 |
+| TPC-H 11 || 0.20 | 0.20 | +0%˄ || 4874.27 | 4867.90 | -0%˄ | 0.8882 |
+| TPC-H 12 || 0.66 | 0.67 | +1%˄ || 1519.16 | 1500.78 | -1%˄ | 0.5146 |
+| TPC-H 13 || 2.07 | 2.04 | -1%˄ || 483.55 | 490.15 | +1%˄ | 0.0000 |
+| TPC-H 14 || 0.33 | 0.32 | -3%˄ || 3014.06 | 3118.35 | +3%˄ | 0.0087 |
+| TPC-H 15 || 1.24 | 1.19 | -4%˄ || 806.65 | 836.23 | +4%˄ | 0.0000 |
+| TPC-H 16 || 2.12 | 2.01 | -5%˄ || 471.15 | 496.78 | +5%˄ | 0.0000 |
+| TPC-H 17 || 0.60 | 0.57 | -5%˄ || 1673.50 | 1760.08 | +5%˄ | 0.6979 |
+| TPC-H 18 || 1.16 | 1.16 | +0%˄ || 859.25 | 858.17 | -0%˄ | 0.5001 |
+| TPC-H 19 || 5.30 | 5.34 | +1%˄ || 188.50 | 187.38 | -1%˄ | 0.0000 |
+| TPC-H 20 || 2.19 | 2.17 | -1%˄ || 455.46 | 460.70 | +1%˄ | 0.5454 |
+| TPC-H 21 || 1.47 | 1.44 | -2%˄ || 681.03 | 696.16 | +2%˄ | 0.6126 |
+| TPC-H 22 || 1.13 | 1.08 | -4%˄ || 886.22 | 923.37 | +4%˄ | 0.0000 |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 64.99 | 61.99 | -5% || | | | |
+| Geomean || | | || | | +3% | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 09:44:07 | 2024-01-12 13:51:38 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 5506.25 | 5505.97 | -0% || 0.17 | 0.17 | -0% | (run time too short) |
+| TPC-H 02 || 56.39 | 55.10 | -2% || 15.88 | 16.33 | +3% | 0.0118 |
+| TPC-H 03 || 1197.72 | 1181.28 | -1% || 0.82 | 0.83 | +2% | (run time too short) |
+| TPC-H 04 || 907.95 | 874.45 | -4% || 1.08 | 1.13 | +5% | 0.0031 |
+| TPC-H 05 || 1129.94 | 1107.07 | -2% || 0.87 | 0.88 | +2% | (run time too short) |
+| TPC-H 06 || 63.77 | 64.05 | +0% || 14.60 | 14.57 | -0% | 0.4365 |
+| TPC-H 07 || 376.50 | 366.76 | -3% || 2.62 | 2.68 | +3% | 0.0000 |
+| TPC-H 08 || 415.63 | 408.59 | -2% || 2.37 | 2.40 | +1% | 0.0002 |
+| TPC-H 09 || 2776.19 | 2737.38 | -1% || 0.35 | 0.35 | +0% | (run time too short) |
+| TPC-H 10 || 1865.46 | 1841.46 | -1% || 0.53 | 0.53 | +0% | (run time too short) |
+| TPC-H 11 || 100.49 | 99.52 | -1% || 9.48 | 9.55 | +1% | 0.1480 |
+| TPC-H 12 || 742.13 | 722.13 | -3% || 1.33 | 1.37 | +2% | 0.0000 |
+| TPC-H 13 || 3993.84 | 3981.02 | -0% || 0.25 | 0.25 | +0% | 0.6558 |
+| TPC-H 14 || 167.09 | 165.77 | -1% || 5.80 | 5.85 | +1% | 0.0913 |
+| TPC-H 15 || 187.69 | 186.61 | -1% || 5.17 | 5.18 | +0% | 0.0560 |
+| TPC-H 16 || 1051.95 | 1029.98 | -2% || 0.93 | 0.95 | +2% | (run time too short) |
+| TPC-H 17 || 93.36 | 91.90 | -2% || 10.15 | 10.32 | +2% | 0.0012 |
+| TPC-H 18 || 2717.45 | 2751.32 | +1% || 0.37 | 0.35 | -5% | (run time too short) |
+| TPC-H 19 || 137.20 | 130.23 | -5% || 7.00 | 7.42 | +6% | 0.0000 |
+| TPC-H 20 || 253.77 | 250.10 | -1% || 3.87 | 3.90 | +1% | 0.0100 |
+| TPC-H 21 || 1661.10 | 1617.77 | -3% || 0.60 | 0.62 | +3% | 0.0441 |
+| TPC-H 22 || 159.09 | 157.08 | -1% || 6.08 | 6.15 | +1% | 0.0004 |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 25560.97 | 25325.54 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 10:08:08 | 2024-01-12 14:15:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6350.69 | 6495.56 | +2% || 0.88 | 0.89 | +1% | 0.1605 |
+| TPC-H 02 || 654.70 | 598.12 | -9% || 0.88 | 0.89 | +1% | 0.5414 |
+| TPC-H 03 || 3581.34 | 3492.57 | -2% || 0.88 | 0.89 | +1% | 0.6063 |
+| TPC-H 04 || 2909.63 | 2987.40 | +3% || 0.88 | 0.89 | +1% | 0.6421 |
+| TPC-H 05 || 5138.90 | 4828.13 | -6% || 0.88 | 0.89 | +1% | 0.1812 |
+| TPC-H 06 || 970.65 | 909.13 | -6% || 0.88 | 0.89 | +1% | 0.5735 |
+| TPC-H 07 || 3969.62 | 3976.48 | +0% || 0.88 | 0.89 | +1% | 0.9759 |
+| TPC-H 08 || 2891.97 | 2822.56 | -2% || 0.88 | 0.89 | +1% | 0.7081 |
+| TPC-H 09 || 7687.52 | 7279.37 | -5% || 0.88 | 0.88 | +1% | 0.1068 |
+| TPC-H 10 || 5285.22 | 4934.42 | -7% || 0.88 | 0.89 | +1% | 0.0941 |
+| TPC-H 11 || 566.18 | 568.77 | +0% || 0.88 | 0.89 | +1% | 0.9737 |
+| TPC-H 12 || 3260.57 | 3344.82 | +3% || 0.88 | 0.89 | +1% | 0.6398 |
+| TPC-H 13 || 6089.85 | 6094.98 | +0% || 0.88 | 0.89 | +1% | 0.9725 |
+| TPC-H 14 || 1462.65 | 1267.61 | -13% || 0.88 | 0.89 | +1% | 0.0844 |
+| TPC-H 15 || 734.05 | 727.40 | -1% || 0.88 | 0.89 | +1% | 0.9124 |
+| TPC-H 16 || 2883.77 | 3021.16 | +5% || 0.88 | 0.89 | +1% | 0.4230 |
+| TPC-H 17 || 1029.00 | 1018.62 | -1% || 0.88 | 0.89 | +1% | 0.9334 |
+| TPC-H 18 || 3954.17 | 3954.95 | +0% || 0.88 | 0.89 | +1% | 0.9946 |
+| TPC-H 19 || 1150.66 | 1230.19 | +7% || 0.88 | 0.89 | +1% | 0.5337 |
+| TPC-H 20 || 2234.63 | 2514.76 | +13% || 0.88 | 0.89 | +1% | 0.1138 |
+| TPC-H 21 || 7897.45 | 7891.31 | -0% || 0.88 | 0.89 | +1% | 0.9840 |
+| TPC-H 22 || 1290.70 | 1360.00 | +5% || 0.88 | 0.89 | +1% | 0.6072 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 71993.92 | 71318.31 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +10% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 10:30:09 | 2024-01-12 14:37:20 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 295.17 | 330.04 | +12%˄ || 3.39 | 3.03 | -11%˄ | 0.0000 |
+| 03 || 100.82 | 98.59 | -2%˄ || 9.92 | 10.14 | +2%˄ | 0.0598 |
+| 06 || 146.11 | 140.52 | -4%˄ || 6.84 | 7.12 | +4%˄ | 0.0105 |
+| 07 || 364.05 | 367.25 | +1%˄ || 2.75 | 2.72 | -1%˄ | 0.0264 |
+| 09 || 1091.82 | 1105.73 | +1% || 0.92 | 0.90 | -1% | 0.0006 |
+| 10 || 156.71 | 154.83 | -1%˄ || 6.38 | 6.46 | +1%˄ | 0.0000 |
+| 13 || 568.66 | 569.88 | +0%˄ || 1.76 | 1.75 | -0%˄ | 0.5112 |
+| 15 || 131.44 | 132.25 | +1%˄ || 7.61 | 7.56 | -1%˄ | 0.0038 |
+| 16 || 181.30 | 198.45 | +9%˄ || 5.52 | 5.04 | -9%˄ | 0.0000 |
+| 17 || 406.36 | 424.66 | +5%˄ || 2.46 | 2.35 | -4%˄ | 0.0000 |
+| 19 || 134.20 | 135.04 | +1%˄ || 7.45 | 7.41 | -1%˄ | 0.0012 |
+| 25 || 199.52 | 200.19 | +0%˄ || 5.01 | 5.00 | -0%˄ | 0.1824 |
+| 26 || 148.77 | 152.74 | +3%˄ || 6.72 | 6.55 | -3%˄ | 0.0000 |
+| 28 || 808.11 | 808.10 | -0% || 1.24 | 1.24 | +0% | 0.9943 |
+| 29 || 583.97 | 736.86 | +26%˄ || 1.71 | 1.36 | -21%˄ | (run time too short) |
+| 31 || 1516.34 | 1594.57 | +5% || 0.66 | 0.63 | -5% | 0.0000 |
+| 32 || 46.57 | 47.51 | +2%˄ || 21.47 | 21.05 | -2%˄ | 0.0000 |
+| 34 || 214.02 | 220.09 | +3%˄ || 4.67 | 4.54 | -3%˄ | 0.0000 |
+| 35 || 786.65 | 811.47 | +3% || 1.27 | 1.23 | -3% | 0.0000 |
+| 37 || 294.70 | 310.00 | +5%˄ || 3.39 | 3.23 | -5%˄ | 0.0001 |
+| 39a || 2142.90 | 2287.46 | +7% || 0.47 | 0.44 | -6% | 0.0000 |
+| 39b || 2121.99 | 2320.53 | +9% || 0.47 | 0.43 | -9% | 0.0000 |
+| 41 || 298.84 | 293.37 | -2%˄ || 3.35 | 3.41 | +2%˄ | 0.0000 |
+| 42 || 107.50 | 109.24 | +2%˄ || 9.30 | 9.15 | -2%˄ | 0.0000 |
+| 43 || 1033.70 | 1059.80 | +3% || 0.97 | 0.94 | -2% | 0.0000 |
+| 45 || 168.89 | 167.83 | -1%˄ || 5.92 | 5.96 | +1%˄ | 0.0001 |
+| 48 || 1090.78 | 1254.84 | +15% || 0.92 | 0.80 | -13% | 0.0000 |
+| 50 || 148.91 | 152.76 | +3%˄ || 6.72 | 6.55 | -3%˄ | 0.0000 |
+| 52 || 107.26 | 110.37 | +3%˄ || 9.32 | 9.06 | -3%˄ | 0.0000 |
+| 55 || 101.12 | 103.12 | +2%˄ || 9.89 | 9.70 | -2%˄ | 0.0000 |
+| 62 || 608.66 | 616.60 | +1% || 1.64 | 1.62 | -1% | 0.0000 |
+| 65 || 2234.44 | 2468.91 | +10% || 0.45 | 0.41 | -9% | 0.0000 |
+| 69 || 148.75 | 153.27 | +3%˄ || 6.72 | 6.52 | -3%˄ | 0.0000 |
+| 73 || 101.01 | 104.01 | +3%˄ || 9.90 | 9.61 | -3%˄ | 0.0000 |
+| 79 || 617.84 | 627.80 | +2% || 1.62 | 1.59 | -2% | 0.0000 |
+| 81 || 244.17 | 262.86 | +8%˄ || 4.10 | 3.80 | -7%˄ | 0.0000 |
+| 82 || 396.10 | 401.35 | +1%˄ || 2.52 | 2.49 | -1%˄ | 0.1186 |
+| 83 || 56.88 | 57.16 | +0%˄ || 17.58 | 17.49 | -0%˄ | 0.4370 |
+| 85 || 176.03 | 176.63 | +0%˄ || 5.68 | 5.66 | -0%˄ | 0.0000 |
+| 88 || 916.18 | 945.04 | +3% || 1.09 | 1.06 | -3% | 0.0000 |
+| 91 || 26.11 | 26.12 | +0%˄ || 38.29 | 38.27 | -0%˄ | 0.8341 |
+| 92 || 80.78 | 80.37 | -1%˄ || 12.38 | 12.44 | +1%˄ | 0.0172 |
+| 93 || 5186.17 | 5426.38 | +5% || 0.19 | 0.18 | -4% | 0.0000 |
+| 94 || 152.07 | 151.02 | -1%˄ || 6.58 | 6.62 | +1%˄ | 0.0340 |
+| 95 || 9225.22 | 11548.53 | +25% || 0.11 | 0.09 | -20% | ˅ |
+| 96 || 79.09 | 82.21 | +4%˄ || 12.64 | 12.16 | -4%˄ | 0.0000 |
+| 97 || 3688.47 | 4007.57 | +9% || 0.27 | 0.25 | -8% | 0.0000 |
+| 99 || 1145.84 | 1171.05 | +2% || 0.87 | 0.85 | -2% | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 40580.97 | 44704.93 | +10% || | | | |
+| Geomean || | | || | | -4% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
+| || ˅ Insufficient number of runs for p-value calculation |
++---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 10:58:38 | 2024-01-12 15:06:11 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 757.74 | 797.65 | +5% || 0.83 | 0.83 | -0% | 0.5718 |
+| 03 || 328.68 | 319.40 | -3% || 0.83 | 0.83 | -0% | 0.8265 |
+| 06 || 1006.57 | 939.85 | -7% || 0.83 | 0.83 | -0% | 0.5156 |
+| 07 || 1011.82 | 1157.73 | +14% || 0.83 | 0.83 | -0% | 0.1565 |
+| 09 || 1050.09 | 988.59 | -6% || 0.83 | 0.83 | -0% | 0.5979 |
+| 10 || 862.53 | 861.93 | -0% || 0.83 | 0.83 | -0% | 0.9952 |
+| 13 || 1899.29 | 1666.79 | -12% || 0.83 | 0.83 | -0% | 0.0796 |
+| 15 || 557.62 | 636.58 | +14% || 0.83 | 0.83 | -0% | 0.3155 |
+| 16 || 898.82 | 881.41 | -2% || 0.83 | 0.83 | -0% | 0.8496 |
+| 17 || 1431.23 | 1560.89 | +9% || 0.83 | 0.83 | -0% | 0.3105 |
+| 19 || 828.70 | 734.36 | -11% || 0.83 | 0.83 | -0% | 0.2443 |
+| 25 || 1235.98 | 1245.80 | +1% || 0.83 | 0.83 | -0% | 0.9333 |
+| 26 || 724.48 | 558.30 | -23% || 0.83 | 0.83 | -0% | 0.0239 |
+| 28 || 1835.30 | 1981.14 | +8% || 0.83 | 0.83 | -0% | 0.3177 |
+| 29 || 1982.18 | 1971.23 | -1% || 0.83 | 0.83 | -0% | 0.9349 |
+| 31 || 3038.70 | 3174.50 | +4% || 0.83 | 0.83 | -0% | 0.4054 |
+| 32 || 260.84 | 398.83 | +53% || 0.83 | 0.83 | -0% | 0.0581 |
+| 34 || 856.78 | 943.74 | +10% || 0.83 | 0.83 | -0% | 0.3924 |
+| 35 || 2672.08 | 2482.42 | -7% || 0.83 | 0.83 | -0% | 0.2109 |
+| 37 || 646.34 | 593.03 | -8% || 0.83 | 0.83 | -0% | 0.3881 |
+| 39a || 3119.62 | 3255.28 | +4% || 0.83 | 0.83 | -0% | 0.3446 |
+| 39b || 2997.20 | 2958.63 | -1% || 0.83 | 0.83 | -0% | 0.7360 |
+| 41 || 4322.49 | 4393.32 | +2% || 0.83 | 0.83 | -0% | 0.7202 |
+| 42 || 559.01 | 587.97 | +5% || 0.83 | 0.83 | -0% | 0.6845 |
+| 43 || 1745.39 | 1572.80 | -10% || 0.83 | 0.83 | -0% | 0.1472 |
+| 45 || 900.79 | 864.79 | -4% || 0.83 | 0.83 | -0% | 0.7248 |
+| 48 || 2977.71 | 2844.61 | -4% || 0.83 | 0.83 | -0% | 0.4326 |
+| 50 || 985.02 | 971.69 | -1% || 0.83 | 0.83 | -0% | 0.8698 |
+| 52 || 576.57 | 552.11 | -4% || 0.83 | 0.83 | -0% | 0.7640 |
+| 55 || 495.79 | 531.22 | +7% || 0.83 | 0.83 | -0% | 0.5861 |
+| 62 || 1124.86 | 1154.36 | +3% || 0.83 | 0.83 | -0% | 0.6983 |
+| 65 || 4748.27 | 4761.63 | +0% || 0.83 | 0.83 | -0% | 0.8946 |
+| 69 || 965.08 | 961.60 | -0% || 0.83 | 0.83 | -0% | 0.9696 |
+| 73 || 580.19 | 715.01 | +23% || 0.83 | 0.83 | -0% | 0.0800 |
+| 79 || 1765.36 | 1655.13 | -6% || 0.83 | 0.83 | -0% | 0.2649 |
+| 81 || 861.21 | 840.47 | -2% || 0.83 | 0.83 | -0% | 0.7946 |
+| 82 || 860.64 | 876.14 | +2% || 0.83 | 0.83 | -1% | 0.8329 |
+| 83 || 430.23 | 414.38 | -4% || 0.83 | 0.83 | -0% | 0.8206 |
+| 85 || 913.91 | 935.64 | +2% || 0.83 | 0.83 | -0% | 0.7757 |
+| 88 || 3410.03 | 3586.26 | +5% || 0.83 | 0.83 | -0% | 0.4527 |
+| 91 || 267.03 | 274.83 | +3% || 0.83 | 0.83 | -0% | 0.8558 |
+| 92 || 508.73 | 502.05 | -1% || 0.83 | 0.83 | -0% | 0.9445 |
+| 93 || 2462.53 | 2387.96 | -3% || 0.83 | 0.83 | -0% | 0.4934 |
+| 94 || 1011.12 | 939.98 | -7% || 0.83 | 0.83 | -0% | 0.4805 |
+| 95 || 5856.28 | 6193.71 | +6% || 0.83 | 0.83 | -0% | 0.1497 |
+| 96 || 475.20 | 466.93 | -2% || 0.83 | 0.83 | -0% | 0.8851 |
+| 97 || 5772.05 | 5887.11 | +2% || 0.83 | 0.83 | -0% | 0.4322 |
+| 99 || 1478.37 | 1459.96 | -1% || 0.83 | 0.83 | -0% | 0.8233 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 76056.46 | 76439.73 | +1% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 11:19:08 | 2024-01-12 15:26:36 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 59.74 | 60.62 | +1% || 1.52 | 1.55 | +2% | (run time too short) |
+| New-Order || 48.36 | 47.19 | -2% || 17.02 | 17.34 | +2% | 0.0903 |
+| Order-Status || 2.64 | 2.67 | +1% || 1.52 | 1.55 | +2% | (run time too short) |
+| Payment || 4.58 | 4.62 | +1% || 16.30 | 16.51 | +1% | 0.2692 |
+| Stock-Level || 4.37 | 4.15 | -5% || 1.52 | 1.55 | +2% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 119.68 | 119.25 | -0% || | | | |
+| Geomean || | | || | | +2% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 11:20:16 | 2024-01-12 15:27:43 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 455.94 | 446.82 | -2% || 12.10 | 12.38 | +2% | 0.0317 |
+| unsucc.: || 11.94 | 13.53 | +13% || 13.05 | 13.17 | +1% | |
+| New-Order || 328.44 | 319.54 | -3% || 138.30 | 141.62 | +2% | 0.0000 |
+| unsucc.: || 26.14 | 26.10 | -0% || 144.68 | 145.90 | +1% | |
+| Order-Status || 19.40 | 19.07 | -2% || 25.16 | 25.56 | +2% | 0.4739 |
+| Payment || 18.46 | 17.40 | -6% || 103.10 | 106.52 | +3% | 0.0000 |
+| unsucc.: || 13.21 | 13.44 | +2% || 167.34 | 168.26 | +1% | |
+| Stock-Level || 37.19 | 36.56 | -2% || 25.16 | 25.56 | +2% | 0.4765 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 859.42 | 839.38 | -2% || | | | |
+| Geomean || | | || | | +2% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +7% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 11:40:29 | 2024-01-12 15:47:54 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 207.17 | 199.08 | -4%˄ || 4.83 | 5.02 | +4%˄ | 0.0530 |
+| 10b || 186.95 | 184.97 | -1%˄ || 5.35 | 5.41 | +1%˄ | 0.0000 |
+| 10c || 396.42 | 406.86 | +3%˄ || 2.52 | 2.46 | -3%˄ | 0.0000 |
+| 11a || 23.85 | 23.97 | +0%˄ || 41.91 | 41.72 | -0%˄ | 0.0000 |
+| 11b || 23.66 | 23.76 | +0%˄ || 42.25 | 42.08 | -0%˄ | 0.0075 |
+| 11c || 29.39 | 29.12 | -1%˄ || 34.02 | 34.34 | +1%˄ | 0.0000 |
+| 11d || 32.87 | 32.54 | -1%˄ || 30.41 | 30.73 | +1%˄ | 0.0000 |
+| 12a || 65.49 | 65.44 | -0%˄ || 15.27 | 15.28 | +0%˄ | 0.5927 |
+| 12b || 32.36 | 32.69 | +1%˄ || 30.90 | 30.59 | -1%˄ | 0.0000 |
+| 12c || 118.25 | 118.35 | +0%˄ || 8.46 | 8.45 | -0%˄ | 0.5423 |
+| 13a || 335.97 | 335.78 | -0%˄ || 2.98 | 2.98 | +0%˄ | 0.5504 |
+| 13b || 208.04 | 206.89 | -1%˄ || 4.81 | 4.83 | +1%˄ | 0.0001 |
+| 13c || 146.54 | 146.01 | -0%˄ || 6.82 | 6.85 | +0%˄ | 0.0019 |
+| 13d || 719.11 | 754.54 | +5% || 1.39 | 1.33 | -5% | 0.0000 |
+| 14a || 506.21 | 641.15 | +27%˄ || 1.98 | 1.56 | -21%˄ | (run time too short) |
+| 14b || 286.23 | 286.22 | -0%˄ || 3.49 | 3.49 | +0%˄ | 0.9542 |
+| 14c || 589.67 | 721.14 | +22%˄ || 1.70 | 1.39 | -18%˄ | (run time too short) |
+| 15a || 88.86 | 101.51 | +14%˄ || 11.25 | 9.85 | -12%˄ | 0.0000 |
+| 15b || 89.52 | 101.19 | +13%˄ || 11.17 | 9.88 | -12%˄ | 0.0000 |
+| 15c || 94.82 | 106.40 | +12%˄ || 10.55 | 9.40 | -11%˄ | 0.0000 |
+| 15d || 93.68 | 104.76 | +12%˄ || 10.67 | 9.55 | -11%˄ | 0.0000 |
+| 16a || 2744.05 | 3267.51 | +19% || 0.36 | 0.31 | -16% | 0.0000 |
+| 16b || 3906.11 | 4517.30 | +16% || 0.26 | 0.22 | -14% | 0.0000 |
+| 16c || 2839.15 | 3355.07 | +18% || 0.35 | 0.30 | -15% | 0.0000 |
+| 16d || 2822.49 | 3354.78 | +19% || 0.35 | 0.30 | -16% | 0.0000 |
+| 17a || 923.22 | 934.58 | +1% || 1.08 | 1.07 | -1% | 0.0000 |
+| 17b || 763.92 | 774.20 | +1% || 1.31 | 1.29 | -1% | 0.0000 |
+| 17c || 737.09 | 745.86 | +1% || 1.36 | 1.34 | -1% | 0.0000 |
+| 17d || 883.77 | 886.95 | +0% || 1.13 | 1.13 | -0% | 0.0538 |
+| 17e || 2234.79 | 2316.59 | +4% || 0.45 | 0.43 | -4% | 0.0000 |
+| 17f || 1393.65 | 1391.51 | -0% || 0.72 | 0.72 | +0% | 0.2040 |
+| 18a || 795.88 | 876.15 | +10% || 1.26 | 1.14 | -9% | 0.0000 |
+| 18b || 178.91 | 181.77 | +2%˄ || 5.59 | 5.50 | -2%˄ | 0.0000 |
+| 18c || 778.28 | 780.14 | +0% || 1.28 | 1.28 | -0% | 0.1090 |
+| 19a || 241.08 | 241.16 | +0%˄ || 4.15 | 4.15 | -0%˄ | 0.7688 |
+| 19b || 183.77 | 184.02 | +0%˄ || 5.44 | 5.43 | -0%˄ | 0.5754 |
+| 19c || 255.58 | 256.30 | +0%˄ || 3.91 | 3.90 | -0%˄ | 0.0010 |
+| 19d || 904.48 | 892.01 | -1% || 1.11 | 1.12 | +1% | 0.0000 |
+| 1a || 13.70 | 13.69 | -0%˄ || 72.96 | 73.04 | +0%˄ | 0.7258 |
+| 1b || 12.79 | 12.86 | +0%˄ || 78.13 | 77.75 | -0%˄ | 0.0845 |
+| 1c || 15.58 | 15.47 | -1%˄ || 64.16 | 64.64 | +1%˄ | 0.0012 |
+| 1d || 12.74 | 12.86 | +1%˄ || 78.46 | 77.75 | -1%˄ | 0.0000 |
+| 20a || 640.31 | 639.11 | -0% || 1.56 | 1.56 | +0% | 0.2666 |
+| 20b || 369.86 | 372.41 | +1%˄ || 2.70 | 2.69 | -1%˄ | 0.0003 |
+| 20c || 362.34 | 363.08 | +0%˄ || 2.76 | 2.75 | -0%˄ | 0.1588 |
+| 21a || 42.82 | 42.75 | -0%˄ || 23.35 | 23.39 | +0%˄ | 0.6673 |
+| 21b || 25.35 | 25.63 | +1%˄ || 39.44 | 39.01 | -1%˄ | 0.0000 |
+| 21c || 43.12 | 43.54 | +1%˄ || 23.19 | 22.97 | -1%˄ | 0.0000 |
+| 22a || 238.91 | 237.53 | -1%˄ || 4.19 | 4.21 | +1%˄ | 0.0000 |
+| 22b || 175.74 | 175.48 | -0%˄ || 5.69 | 5.70 | +0%˄ | 0.0351 |
+| 22c || 573.95 | 582.50 | +1%˄ || 1.74 | 1.72 | -1%˄ | 0.0000 |
+| 22d || 1048.34 | 1072.90 | +2% || 0.95 | 0.93 | -2% | 0.0000 |
+| 23a || 51.99 | 51.74 | -0%˄ || 19.23 | 19.32 | +0%˄ | 0.2074 |
+| 23b || 64.28 | 63.76 | -1%˄ || 15.56 | 15.68 | +1%˄ | 0.0000 |
+| 23c || 98.80 | 104.25 | +6%˄ || 10.12 | 9.59 | -5%˄ | 0.0000 |
+| 24a || 217.32 | 219.63 | +1%˄ || 4.60 | 4.55 | -1%˄ | 0.0000 |
+| 24b || 182.85 | 183.27 | +0%˄ || 5.47 | 5.46 | -0%˄ | 0.4848 |
+| 25a || 420.23 | 430.93 | +3%˄ || 2.38 | 2.32 | -2%˄ | 0.0000 |
+| 25b || 170.46 | 170.78 | +0%˄ || 5.87 | 5.86 | -0%˄ | 0.5648 |
+| 25c || 1404.81 | 1417.37 | +1% || 0.71 | 0.71 | -1% | 0.0000 |
+| 26a || 263.17 | 261.31 | -1%˄ || 3.80 | 3.83 | +1%˄ | 0.0021 |
+| 26b || 213.71 | 211.99 | -1%˄ || 4.68 | 4.72 | +1%˄ | 0.0000 |
+| 26c || 385.44 | 382.30 | -1%˄ || 2.59 | 2.62 | +1%˄ | 0.0001 |
+| 27a || 30.00 | 29.94 | -0%˄ || 33.33 | 33.39 | +0%˄ | 0.2652 |
+| 27b || 29.40 | 29.35 | -0%˄ || 34.01 | 34.06 | +0%˄ | 0.1382 |
+| 27c || 42.96 | 43.38 | +1%˄ || 23.28 | 23.05 | -1%˄ | 0.0000 |
+| 28a || 339.20 | 340.15 | +0%˄ || 2.95 | 2.94 | -0%˄ | 0.0000 |
+| 28b || 50.04 | 50.05 | +0%˄ || 19.98 | 19.98 | -0%˄ | 0.9628 |
+| 28c || 381.01 | 383.45 | +1%˄ || 2.62 | 2.61 | -1%˄ | 0.0000 |
+| 29a || 117.70 | 118.68 | +1%˄ || 8.50 | 8.43 | -1%˄ | 0.0000 |
+| 29b || 90.99 | 92.40 | +2%˄ || 10.99 | 10.82 | -2%˄ | 0.0000 |
+| 29c || 216.68 | 218.43 | +1%˄ || 4.61 | 4.58 | -1%˄ | 0.0013 |
+| 2a || 78.27 | 77.29 | -1%˄ || 12.78 | 12.94 | +1%˄ | 0.0000 |
+| 2b || 61.99 | 61.99 | +0%˄ || 16.13 | 16.13 | -0%˄ | 0.9408 |
+| 2c || 34.53 | 34.98 | +1%˄ || 28.96 | 28.59 | -1%˄ | 0.0369 |
+| 2d || 106.60 | 106.07 | -1%˄ || 9.38 | 9.43 | +1%˄ | 0.2494 |
+| 30a || 229.03 | 232.91 | +2%˄ || 4.37 | 4.29 | -2%˄ | 0.0000 |
+| 30b || 198.87 | 199.77 | +0%˄ || 5.03 | 5.01 | -0%˄ | 0.0870 |
+| 30c || 533.17 | 531.88 | -0%˄ || 1.88 | 1.88 | +0%˄ | 0.0752 |
+| 31a || 216.16 | 219.15 | +1%˄ || 4.63 | 4.56 | -1%˄ | 0.0000 |
+| 31b || 185.46 | 186.31 | +0%˄ || 5.39 | 5.37 | -0%˄ | 0.0040 |
+| 31c || 250.36 | 252.71 | +1%˄ || 3.99 | 3.96 | -1%˄ | 0.0000 |
+| 32a || 22.94 | 23.25 | +1%˄ || 43.58 | 43.01 | -1%˄ | 0.0000 |
+| 32b || 54.35 | 53.29 | -2%˄ || 18.40 | 18.76 | +2%˄ | 0.0000 |
+| 33a || 26.90 | 27.41 | +2%˄ || 37.17 | 36.48 | -2%˄ | 0.0000 |
+| 33b || 26.22 | 26.60 | +1%˄ || 38.13 | 37.58 | -1%˄ | 0.0000 |
+| 33c || 30.19 | 30.56 | +1%˄ || 33.11 | 32.72 | -1%˄ | 0.0000 |
+| 3a || 180.12 | 179.18 | -1%˄ || 5.55 | 5.58 | +1%˄ | 0.0910 |
+| 3b || 18.89 | 19.01 | +1%˄ || 52.93 | 52.59 | -1%˄ | 0.0000 |
+| 3c || 627.10 | 690.72 | +10% || 1.59 | 1.45 | -9% | 0.0000 |
+| 4a || 157.54 | 184.35 | +17%˄ || 6.35 | 5.42 | -15%˄ | 0.0000 |
+| 4b || 17.29 | 17.29 | +0%˄ || 57.82 | 57.81 | -0%˄ | 0.8937 |
+| 4c || 177.19 | 206.03 | +16%˄ || 5.64 | 4.85 | -14%˄ | 0.0000 |
+| 5a || 76.16 | 75.85 | -0%˄ || 13.13 | 13.18 | +0%˄ | 0.2218 |
+| 5b || 166.48 | 170.05 | +2%˄ || 6.01 | 5.88 | -2%˄ | 0.0000 |
+| 5c || 232.95 | 228.53 | -2%˄ || 4.29 | 4.38 | +2%˄ | 0.0000 |
+| 6a || 166.98 | 170.26 | +2%˄ || 5.99 | 5.87 | -2%˄ | 0.0000 |
+| 6b || 189.64 | 188.52 | -1%˄ || 5.27 | 5.30 | +1%˄ | 0.0162 |
+| 6c || 159.50 | 159.11 | -0%˄ || 6.27 | 6.28 | +0%˄ | 0.5065 |
+| 6d || 822.62 | 838.82 | +2% || 1.22 | 1.19 | -2% | 0.0000 |
+| 6e || 166.41 | 169.43 | +2%˄ || 6.01 | 5.90 | -2%˄ | 0.0000 |
+| 6f || 1059.86 | 1066.98 | +1% || 0.94 | 0.94 | -1% | 0.0000 |
+| 7a || 58.18 | 59.11 | +2%˄ || 17.19 | 16.92 | -2%˄ | 0.0000 |
+| 7b || 53.61 | 54.28 | +1%˄ || 18.65 | 18.42 | -1%˄ | 0.0000 |
+| 7c || 763.67 | 770.30 | +1% || 1.31 | 1.30 | -1% | 0.0000 |
+| 8a || 54.70 | 54.31 | -1%˄ || 18.28 | 18.41 | +1%˄ | 0.0000 |
+| 8b || 49.80 | 49.08 | -1%˄ || 20.08 | 20.37 | +1%˄ | 0.0000 |
+| 8c || 2199.03 | 2348.54 | +7% || 0.45 | 0.43 | -6% | 0.0000 |
+| 8d || 362.78 | 364.57 | +0%˄ || 2.76 | 2.74 | -0%˄ | 0.0000 |
+| 9a || 250.33 | 247.28 | -1%˄ || 3.99 | 4.04 | +1%˄ | 0.0000 |
+| 9b || 155.56 | 155.41 | -0%˄ || 6.43 | 6.43 | +0%˄ | 0.0832 |
+| 9c || 371.28 | 370.05 | -0%˄ || 2.69 | 2.70 | +0%˄ | 0.0006 |
+| 9d || 635.56 | 634.49 | -0% || 1.57 | 1.58 | +0% | 0.8377 |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 46436.14 | 49526.89 | +7% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 12:31:09 | 2024-01-12 16:39:03 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 264.99 | 280.28 | +6% || 0.91 | 0.90 | -0% | 0.5701 |
+| 10b || 187.08 | 210.87 | +13% || 0.91 | 0.91 | -0% | 0.2517 |
+| 10c || 557.11 | 613.92 | +10% || 0.91 | 0.90 | -0% | 0.1713 |
+| 11a || 84.30 | 70.89 | -16% || 0.91 | 0.90 | -0% | 0.4255 |
+| 11b || 74.81 | 80.16 | +7% || 0.91 | 0.91 | -0% | 0.7382 |
+| 11c || 100.87 | 106.88 | +6% || 0.91 | 0.90 | -0% | 0.6712 |
+| 11d || 125.97 | 131.24 | +4% || 0.91 | 0.91 | -0% | 0.8541 |
+| 12a || 222.73 | 239.37 | +7% || 0.91 | 0.90 | -0% | 0.5339 |
+| 12b || 94.47 | 103.65 | +10% || 0.91 | 0.91 | -0% | 0.7588 |
+| 12c || 567.25 | 467.46 | -18% || 0.91 | 0.90 | -0% | 0.0300 |
+| 13a || 753.81 | 755.80 | +0% || 0.91 | 0.90 | -0% | 0.9652 |
+| 13b || 295.65 | 316.86 | +7% || 0.91 | 0.91 | +0% | 0.4669 |
+| 13c || 280.48 | 296.22 | +6% || 0.91 | 0.91 | -0% | 0.6039 |
+| 13d || 1194.75 | 1143.38 | -4% || 0.91 | 0.90 | -0% | 0.2777 |
+| 14a || 1040.63 | 999.25 | -4% || 0.91 | 0.90 | -0% | 0.4376 |
+| 14b || 640.81 | 670.31 | +5% || 0.91 | 0.90 | -0% | 0.5011 |
+| 14c || 1220.50 | 1218.59 | -0% || 0.91 | 0.90 | -0% | 0.9725 |
+| 15a || 149.13 | 175.67 | +18% || 0.91 | 0.90 | -0% | 0.1406 |
+| 15b || 172.25 | 181.51 | +5% || 0.91 | 0.90 | -0% | 0.7088 |
+| 15c || 201.65 | 182.25 | -10% || 0.91 | 0.90 | -0% | 0.4129 |
+| 15d || 227.67 | 219.25 | -4% || 0.91 | 0.90 | -0% | 0.7348 |
+| 16a || 2982.58 | 3046.13 | +2% || 0.90 | 0.90 | +0% | 0.3998 |
+| 16b || 4462.46 | 4436.49 | -1% || 0.90 | 0.90 | +0% | 0.7375 |
+| 16c || 3125.95 | 3229.94 | +3% || 0.91 | 0.90 | -0% | 0.1529 |
+| 16d || 3144.65 | 3180.23 | +1% || 0.90 | 0.90 | -0% | 0.6424 |
+| 17a || 1060.09 | 1160.13 | +9% || 0.91 | 0.90 | -0% | 0.0891 |
+| 17b || 1049.43 | 801.12 | -24% || 0.91 | 0.90 | -0% | 0.0001 |
+| 17c || 791.93 | 768.60 | -3% || 0.91 | 0.90 | -0% | 0.6747 |
+| 17d || 877.80 | 891.21 | +2% || 0.91 | 0.90 | -0% | 0.8032 |
+| 17e || 1922.64 | 1932.17 | +0% || 0.91 | 0.90 | -0% | 0.8796 |
+| 17f || 1509.57 | 1384.83 | -8% || 0.91 | 0.90 | -0% | 0.0364 |
+| 18a || 1045.19 | 1036.71 | -1% || 0.91 | 0.90 | -0% | 0.8745 |
+| 18b || 243.75 | 234.25 | -4% || 0.91 | 0.91 | -0% | 0.6919 |
+| 18c || 1076.43 | 1085.69 | +1% || 0.90 | 0.90 | +0% | 0.8803 |
+| 19a || 826.70 | 726.61 | -12% || 0.91 | 0.91 | -0% | 0.0785 |
+| 19b || 515.38 | 558.50 | +8% || 0.91 | 0.90 | -0% | 0.3811 |
+| 19c || 796.58 | 847.56 | +6% || 0.91 | 0.91 | +0% | 0.3970 |
+| 19d || 1746.52 | 1851.44 | +6% || 0.91 | 0.90 | -0% | 0.1729 |
+| 1a || 37.80 | 76.08 | +101% || 0.91 | 0.91 | -0% | 0.0732 |
+| 1b || 39.37 | 35.93 | -9% || 0.91 | 0.91 | -0% | 0.6734 |
+| 1c || 62.88 | 44.59 | -29% || 0.91 | 0.91 | -0% | 0.2530 |
+| 1d || 36.70 | 48.74 | +33% || 0.91 | 0.90 | -0% | 0.2822 |
+| 20a || 868.40 | 895.39 | +3% || 0.91 | 0.90 | -0% | 0.6082 |
+| 20b || 621.78 | 656.55 | +6% || 0.91 | 0.90 | -0% | 0.4197 |
+| 20c || 619.48 | 579.81 | -6% || 0.91 | 0.90 | -0% | 0.3143 |
+| 21a || 106.82 | 104.69 | -2% || 0.91 | 0.91 | -0% | 0.8882 |
+| 21b || 151.66 | 114.82 | -24% || 0.91 | 0.90 | -0% | 0.1062 |
+| 21c || 131.42 | 102.15 | -22% || 0.91 | 0.90 | -0% | 0.0859 |
+| 22a || 742.08 | 683.39 | -8% || 0.91 | 0.90 | -0% | 0.2549 |
+| 22b || 470.20 | 475.03 | +1% || 0.91 | 0.90 | -0% | 0.9054 |
+| 22c || 1105.99 | 1088.16 | -2% || 0.91 | 0.90 | -0% | 0.7753 |
+| 22d || 1327.74 | 1457.00 | +10% || 0.91 | 0.90 | -0% | 0.0621 |
+| 23a || 251.03 | 239.09 | -5% || 0.91 | 0.91 | -0% | 0.6629 |
+| 23b || 157.32 | 186.56 | +19% || 0.91 | 0.91 | -0% | 0.2252 |
+| 23c || 249.92 | 244.06 | -2% || 0.91 | 0.91 | -0% | 0.8399 |
+| 24a || 326.98 | 341.26 | +4% || 0.91 | 0.90 | -0% | 0.6151 |
+| 24b || 209.14 | 252.03 | +21% || 0.91 | 0.90 | -0% | 0.1288 |
+| 25a || 736.87 | 723.99 | -2% || 0.90 | 0.90 | -0% | 0.8103 |
+| 25b || 193.28 | 182.48 | -6% || 0.91 | 0.90 | -0% | 0.6204 |
+| 25c || 1396.27 | 1439.54 | +3% || 0.91 | 0.90 | -0% | 0.5084 |
+| 26a || 475.56 | 469.07 | -1% || 0.91 | 0.90 | -0% | 0.8570 |
+| 26b || 312.58 | 302.60 | -3% || 0.91 | 0.90 | -0% | 0.7521 |
+| 26c || 647.29 | 697.25 | +8% || 0.91 | 0.90 | -0% | 0.2640 |
+| 27a || 154.28 | 172.21 | +12% || 0.91 | 0.90 | -0% | 0.5416 |
+| 27b || 162.51 | 195.05 | +20% || 0.91 | 0.90 | -0% | 0.1977 |
+| 27c || 108.22 | 106.99 | -1% || 0.91 | 0.91 | -0% | 0.9392 |
+| 28a || 1022.05 | 930.05 | -9% || 0.90 | 0.90 | +0% | 0.1107 |
+| 28b || 298.01 | 288.00 | -3% || 0.91 | 0.90 | -0% | 0.7662 |
+| 28c || 1057.64 | 981.65 | -7% || 0.91 | 0.90 | -0% | 0.2427 |
+| 29a || 270.79 | 279.24 | +3% || 0.91 | 0.91 | -0% | 0.7745 |
+| 29b || 188.73 | 187.62 | -1% || 0.91 | 0.91 | -0% | 0.9622 |
+| 29c || 330.73 | 347.43 | +5% || 0.91 | 0.90 | -0% | 0.6469 |
+| 2a || 258.60 | 252.14 | -2% || 0.91 | 0.91 | -0% | 0.8194 |
+| 2b || 175.62 | 224.10 | +28% || 0.91 | 0.91 | -0% | 0.0303 |
+| 2c || 136.34 | 117.79 | -14% || 0.91 | 0.91 | -0% | 0.4049 |
+| 2d || 343.70 | 339.73 | -1% || 0.91 | 0.90 | -0% | 0.9174 |
+| 30a || 487.28 | 498.19 | +2% || 0.91 | 0.90 | -0% | 0.7818 |
+| 30b || 312.39 | 345.10 | +10% || 0.91 | 0.90 | -0% | 0.3047 |
+| 30c || 1036.83 | 1018.87 | -2% || 0.91 | 0.90 | -0% | 0.7453 |
+| 31a || 414.88 | 423.36 | +2% || 0.91 | 0.90 | -0% | 0.8168 |
+| 31b || 258.32 | 214.79 | -17% || 0.91 | 0.90 | -0% | 0.1278 |
+| 31c || 459.12 | 487.48 | +6% || 0.91 | 0.91 | -0% | 0.5037 |
+| 32a || 55.55 | 74.20 | +34% || 0.91 | 0.90 | -0% | 0.1499 |
+| 32b || 209.72 | 201.56 | -4% || 0.91 | 0.91 | -0% | 0.7249 |
+| 33a || 82.69 | 95.98 | +16% || 0.91 | 0.90 | -0% | 0.4142 |
+| 33b || 83.54 | 82.53 | -1% || 0.91 | 0.90 | -0% | 0.9503 |
+| 33c || 117.75 | 95.50 | -19% || 0.91 | 0.91 | -0% | 0.1586 |
+| 3a || 548.54 | 527.12 | -4% || 0.91 | 0.90 | -0% | 0.6462 |
+| 3b || 90.97 | 113.14 | +24% || 0.91 | 0.90 | -0% | 0.2807 |
+| 3c || 858.19 | 711.79 | -17% || 0.91 | 0.90 | -0% | 0.0085 |
+| 4a || 238.21 | 284.18 | +19% || 0.91 | 0.91 | -0% | 0.0890 |
+| 4b || 74.06 | 76.87 | +4% || 0.91 | 0.91 | -0% | 0.8686 |
+| 4c || 289.62 | 315.79 | +9% || 0.91 | 0.90 | -0% | 0.4080 |
+| 5a || 274.55 | 288.28 | +5% || 0.91 | 0.91 | -0% | 0.6396 |
+| 5b || 283.58 | 260.54 | -8% || 0.91 | 0.91 | -0% | 0.4493 |
+| 5c || 388.59 | 380.90 | -2% || 0.91 | 0.90 | -0% | 0.8574 |
+| 6a || 160.08 | 138.28 | -14% || 0.91 | 0.91 | -0% | 0.3129 |
+| 6b || 252.10 | 225.00 | -11% || 0.91 | 0.91 | -0% | 0.2587 |
+| 6c || 152.72 | 128.18 | -16% || 0.91 | 0.91 | -0% | 0.1380 |
+| 6d || 750.17 | 768.17 | +2% || 0.91 | 0.90 | -0% | 0.6747 |
+| 6e || 192.65 | 171.75 | -11% || 0.91 | 0.91 | -0% | 0.4046 |
+| 6f || 1415.66 | 1298.18 | -8% || 0.91 | 0.90 | -0% | 0.0514 |
+| 7a || 152.02 | 157.89 | +4% || 0.91 | 0.91 | -0% | 0.7665 |
+| 7b || 139.25 | 166.87 | +20% || 0.91 | 0.90 | -0% | 0.2428 |
+| 7c || 1291.83 | 1313.07 | +2% || 0.91 | 0.90 | -0% | 0.7406 |
+| 8a || 224.02 | 236.17 | +5% || 0.91 | 0.91 | -0% | 0.6782 |
+| 8b || 178.61 | 199.87 | +12% || 0.91 | 0.90 | -0% | 0.4144 |
+| 8c || 2452.57 | 2489.65 | +2% || 0.90 | 0.90 | -0% | 0.5264 |
+| 8d || 790.53 | 828.00 | +5% || 0.91 | 0.90 | -0% | 0.4711 |
+| 9a || 803.65 | 822.52 | +2% || 0.90 | 0.90 | -0% | 0.7423 |
+| 9b || 451.36 | 443.41 | -2% || 0.91 | 0.90 | -0% | 0.8481 |
+| 9c || 984.24 | 1009.97 | +3% || 0.91 | 0.90 | -0% | 0.6496 |
+| 9d || 1454.90 | 1479.93 | +2% || 0.91 | 0.90 | -0% | 0.7090 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 69831.06 | 69870.74 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +7% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 12:51:38 | 2024-01-12 16:59:28 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 405.19 | 415.75 | +3%˄ || 2.47 | 2.41 | -3%˄ | 0.0098 |
+| 1.2 || 116.81 | 111.45 | -5%˄ || 8.56 | 8.97 | +5%˄ | 0.0000 |
+| 1.3 || 111.47 | 101.93 | -9%˄ || 8.97 | 9.81 | +9%˄ | 0.0000 |
+| 2.1 || 852.18 | 881.86 | +3% || 1.17 | 1.13 | -3% | 0.0000 |
+| 2.2 || 443.91 | 461.96 | +4%˄ || 2.25 | 2.16 | -4%˄ | 0.0000 |
+| 2.3 || 256.27 | 264.83 | +3%˄ || 3.90 | 3.78 | -3%˄ | 0.0000 |
+| 3.1 || 3299.88 | 3493.36 | +6% || 0.30 | 0.29 | -6% | 0.0000 |
+| 3.2 || 428.33 | 435.55 | +2%˄ || 2.33 | 2.30 | -2%˄ | 0.0000 |
+| 3.3 || 166.79 | 172.19 | +3%˄ || 6.00 | 5.81 | -3%˄ | 0.0000 |
+| 3.4 || 154.40 | 159.55 | +3%˄ || 6.48 | 6.27 | -3%˄ | 0.0000 |
+| 4.1 || 5151.86 | 5816.76 | +13% || 0.19 | 0.17 | -11% | 0.0000 |
+| 4.2 || 1107.69 | 1092.90 | -1% || 0.90 | 0.91 | +1% | 0.1209 |
+| 4.3 || 362.71 | 367.81 | +1%˄ || 2.76 | 2.72 | -1%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 12857.48 | 13775.92 | +7% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_9d74921e9cd39a9279d485b2d920f75b7c7ea9b7_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 9d74921e9cd39a9279d485b2d920f75b7c7ea9b7-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-01-12 13:00:30 | 2024-01-12 17:08:28 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 967.03 | 924.26 | -4% || 3.24 | 3.27 | +1% | 0.2020 |
+| 1.2 || 568.90 | 559.16 | -2% || 3.24 | 3.27 | +1% | 0.7183 |
+| 1.3 || 329.92 | 340.99 | +3% || 3.24 | 3.27 | +1% | 0.5344 |
+| 2.1 || 2458.63 | 2439.74 | -1% || 3.23 | 3.27 | +1% | 0.7196 |
+| 2.2 || 1327.56 | 1370.88 | +3% || 3.23 | 3.27 | +1% | 0.2429 |
+| 2.3 || 511.68 | 474.46 | -7% || 3.24 | 3.27 | +1% | 0.1192 |
+| 3.1 || 3325.19 | 3232.42 | -3% || 3.23 | 3.26 | +1% | 0.0600 |
+| 3.2 || 1239.68 | 1270.29 | +2% || 3.24 | 3.27 | +1% | 0.4074 |
+| 3.3 || 648.61 | 662.75 | +2% || 3.24 | 3.27 | +1% | 0.6087 |
+| 3.4 || 612.25 | 645.53 | +5% || 3.24 | 3.27 | +1% | 0.2302 |
+| 4.1 || 3877.50 | 3795.26 | -2% || 3.23 | 3.26 | +1% | 0.1027 |
+| 4.2 || 2749.86 | 2768.85 | +1% || 3.23 | 3.26 | +1% | 0.7280 |
+| 4.3 || 1014.79 | 991.66 | -2% || 3.24 | 3.27 | +1% | 0.4640 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 19631.60 | 19476.25 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+ |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I am going to look a little bit further into this issue with a focus on TPC-DS (ST and MT) on Intel. I would like to update to jemalloc 5 as our version is quite dated. But it's probably not possible without investing some further work here. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Histograms get slightly faster. :) 
|
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Just to keep this thing here up-to-date: I have made some progress back in January and will create a PR once #2612 is merged (the only current PR that has an impact on MT performance). I think we can avoid some regressions and then just have to accept a few remaining ones. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Benchmarks for jemalloc 5. Just switching results in a significant performance degradation.
As found by @dey4ss ,
oversize_threshold(also used by Apache Arrow as a "fix" for jemalloc v5) helps to mitigate most of the MT issues, but we still face issues with single-threaded benchmarks (and TPC-DS MT performance remains an issue though).The question might be: do we care about single-threaded performance? I value ST benchmarks to see that we do not decrease efficiency which is easy to hide with MT processing. This would still be the case if we switch to jemalloc 5.
Not sure what to make of these results.
Benchmarks
master vs. jemalloc 5 (default settings)
Intel
System
cx01 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: +15% || Geometric mean of throughput changes: -10%
Configuration Overview - click to expand
+Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 00:32:00 | 2024-01-12 04:20:20 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st_s01.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_st_s01.json | +--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 00:50:56 | 2024-01-12 04:39:30 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | scale_factor | 0.009999999776482582 | 0.009999999776482582 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 9 cores, SF 10.0
Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -5%
Configuration Overview - click to expand
+Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_mt_ordered.json | +-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 9 | 9 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 00:51:24 | 2024-01-12 04:39:57 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | True | True | | utilized_cores_per_numa_node | [9] | [9] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 9 clients, 9 cores, SF 10.0
Sum of avg. item runtimes: +8% || Geometric mean of throughput changes: -8%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 9 | 9 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 9 | 9 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 01:15:02 | 2024-01-12 05:03:29 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | True | True | | utilized_cores_per_numa_node | [9] | [9] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +15% || Geometric mean of throughput changes: -4%
Configuration Overview - click to expand
+Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 01:36:32 | 2024-01-12 05:24:53 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: +18% || Geometric mean of throughput changes: -15%
Configuration Overview - click to expand
+Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 9 | 9 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 9 | 9 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:02:17 | 2024-01-12 05:51:16 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [9] | [9] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%
Configuration Overview - click to expand
+Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:22:38 | 2024-01-12 06:11:36 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | -1 | -1 | | scale_factor | 10 | 10 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 9 | 9 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 9 | 9 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:23:45 | 2024-01-12 06:12:42 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10 | 10 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [9] | [9] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: +10% || Geometric mean of throughput changes: -3%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:43:52 | 2024-01-12 06:32:49 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -5%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 9 | 9 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 9 | 9 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 03:25:21 | 2024-01-12 07:15:14 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [9] | [9] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: +9% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 03:45:40 | 2024-01-12 07:35:34 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -3%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 9 | 9 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 9 | 9 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 03:52:59 | 2024-01-12 07:42:58 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [9] | [9] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+AMD
System
cx18 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -5%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 00:33:02 | 2024-01-12 04:40:10 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -6% || Geometric mean of throughput changes: +3%
Configuration Overview - click to expand
+Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_st_s01.json | +--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 00:54:21 | 2024-01-12 05:01:34 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | scale_factor | 0.009999999776482582 | 0.009999999776482582 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_mt_ordered.json | +-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 64 | 64 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 00:54:50 | 2024-01-12 05:02:02 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | True | True | | utilized_cores_per_numa_node | [64] | [64] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0
Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -5%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 64 | 64 | | clustering | None | None | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 64 | 64 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 01:18:46 | 2024-01-12 05:25:57 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | use_prepared_statements | False | False | | using_scheduler | True | True | | utilized_cores_per_numa_node | [64] | [64] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +11% || Geometric mean of throughput changes: -4%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 01:40:43 | 2024-01-12 05:47:54 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +21% || Geometric mean of throughput changes: -17%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 64 | 64 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 64 | 64 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:09:13 | 2024-01-12 06:16:45 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [64] | [64] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:29:38 | 2024-01-12 06:37:10 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | -1 | -1 | | scale_factor | 10 | 10 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 64 | 64 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 64 | 64 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:30:46 | 2024-01-12 06:38:17 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10 | 10 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [64] | [64] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: +7% || Geometric mean of throughput changes: -3%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 02:50:59 | 2024-01-12 06:58:29 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +8% || Geometric mean of throughput changes: -7%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 64 | 64 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 64 | 64 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 03:41:28 | 2024-01-12 07:49:35 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [64] | [64] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: +8% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_7353be3d8136247725d70f30aacc23d42d18c788_st.json | +-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Ordered | Ordered | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 1 | 1 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 0 | 0 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 04:01:55 | 2024-01-12 08:10:03 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 60000000000 | 60000000000 | | max_runs | 100 | 100 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | using_scheduler | False | False | | verify | False | False | | warmup_duration | 1000000000 | 1000000000 | +-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ | Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_8b53b13dc9408fac45169748c4a08c6e046d25df_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_7353be3d8136247725d70f30aacc23d42d18c788_mt.json | +-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ | GIT-HASH | 8b53b13dc9408fac45169748c4a08c6e046d25df-dirty | 7353be3d8136247725d70f30aacc23d42d18c788-dirty | | benchmark_mode | Shuffled | Shuffled | | build_type | release | release | | chunk_indexes | False | False | | chunk_size | 65535 | 65535 | | clients | 64 | 64 | | compiler | clang 17.0.2 | clang 17.0.2 | | cores | 64 | 64 | | data_preparation_cores | 0 | 0 | | date | 2024-01-12 04:10:46 | 2024-01-12 08:19:00 | | encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} | | max_duration | 1200000000000 | 1200000000000 | | max_runs | -1 | -1 | | scale_factor | 10.0 | 10.0 | | time_unit | ns | ns | | using_scheduler | True | True | | utilized_cores_per_numa_node | [64] | [64] | | verify | False | False | | warmup_duration | 0 | 0 | +-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+Beta Was this translation helpful? Give feedback.
All reactions