/
PERF
133 lines (128 loc) · 14 KB
/
PERF
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
cpython38_gcc.json
==================
Performance version: 1.0.1
Report on Linux-5.2.9-229_fbk15_hardened_4185_g357f49b36602-x86_64-with-glibc2.29
Number of logical CPUs: 48
Start date: 2021-04-21 12:16:08.671369
End date: 2021-04-21 12:42:30.856566
cinder_jit_noframe_gcc.json
===========================
Performance version: 1.0.1
Report on Linux-5.2.9-229_fbk15_hardened_4185_g357f49b36602-x86_64-with-glibc2.29
Number of logical CPUs: 48
Start date: 2021-04-21 14:02:14.995382
End date: 2021-04-21 15:11:41.250542
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| Benchmark | cpython38_gcc.json | cinder_jit_noframe_gcc.json | Change | Significance |
+=========================+====================+=============================+===============+=========================+
| 2to3 | 514 ms | 2.37 sec | 4.62x slower | Significant (t=-59.26) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| chameleon | 14.8 ms | 8.25 ms | 1.80x faster | Significant (t=100.07) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| chaos | 178 ms | 127 ms | 1.40x faster | Significant (t=47.94) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| crypto_pyaes | 189 ms | 178 ms | 1.06x faster | Significant (t=9.90) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| deltablue | 11.1 ms | 4.09 ms | 2.72x faster | Significant (t=190.28) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| dulwich_log | 115 ms | 114 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| fannkuch | 741 ms | 612 ms | 1.21x faster | Significant (t=54.31) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| float | 189 ms | 94.7 ms | 1.99x faster | Significant (t=103.89) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| genshi_text | 46.3 ms | 30.1 ms | 1.54x faster | Significant (t=39.56) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| genshi_xml | 97.9 ms | 76.8 ms | 1.28x faster | Significant (t=19.89) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| go | 392 ms | 240 ms | 1.63x faster | Significant (t=80.37) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| hexiom | 14.9 ms | 11.6 ms | 1.29x faster | Significant (t=57.64) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| json_dumps | 19.6 ms | 18.8 ms | 1.04x faster | Significant (t=7.24) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| json_loads | 40.8 us | 38.4 us | 1.06x faster | Significant (t=14.21) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| logging_format | 14.8 us | 9.13 us | 1.62x faster | Significant (t=48.60) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| logging_silent | 313 ns | 111 ns | 2.82x faster | Significant (t=161.06) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| logging_simple | 13.5 us | 7.84 us | 1.73x faster | Significant (t=65.87) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| mako | 26.4 ms | 14.7 ms | 1.80x faster | Significant (t=90.39) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| meteor_contest | 157 ms | 138 ms | 1.14x faster | Significant (t=19.38) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| nbody | 204 ms | 221 ms | 1.09x slower | Significant (t=-21.53) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| nqueens | 160 ms | 251 ms | 1.56x slower | Significant (t=-41.45) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| pathlib | 29.4 ms | 23.8 ms | 1.24x faster | Significant (t=24.39) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| pickle | 13.7 us | 13.1 us | 1.05x faster | Significant (t=6.24) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| pickle_dict | 36.7 us | 33.9 us | 1.08x faster | Significant (t=23.11) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| pickle_list | 5.76 us | 5.30 us | 1.09x faster | Significant (t=16.84) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| pickle_pure_python | 717 us | 392 us | 1.83x faster | Significant (t=49.09) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| pidigits | 253 ms | 253 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| pyflate | 1.07 sec | 660 ms | 1.62x faster | Significant (t=98.84) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| python_startup | 14.9 ms | 268 ms | 18.00x slower | Significant (t=-436.22) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| python_startup_no_site | 10.5 ms | 205 ms | 19.42x slower | Significant (t=-136.94) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| raytrace | 770 ms | 384 ms | 2.00x faster | Significant (t=101.47) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| regex_compile | 277 ms | 180 ms | 1.54x faster | Significant (t=67.60) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| regex_dna | 267 ms | 269 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| regex_effbot | 4.58 ms | 4.61 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| regex_v8 | 33.9 ms | 31.8 ms | 1.06x faster | Significant (t=11.90) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| richards | 104 ms | 29.4 ms | 3.53x faster | Significant (t=102.67) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| scimark_fft | 583 ms | 429 ms | 1.36x faster | Significant (t=77.02) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| scimark_lu | 244 ms | 133 ms | 1.84x faster | Significant (t=150.78) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| scimark_monte_carlo | 161 ms | 98.3 ms | 1.64x faster | Significant (t=71.35) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| scimark_sor | 317 ms | 159 ms | 1.99x faster | Significant (t=162.74) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| scimark_sparse_mat_mult | 7.40 ms | 5.60 ms | 1.32x faster | Significant (t=22.18) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| spectral_norm | 235 ms | 148 ms | 1.58x faster | Significant (t=26.67) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| sqlalchemy_declarative | 281 ms | 285 ms | 1.02x slower | Not significant |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| sqlalchemy_imperative | 55.2 ms | 61.4 ms | 1.11x slower | Significant (t=-6.36) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| sqlite_synth | 4.41 us | 3.91 us | 1.13x faster | Significant (t=9.87) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| telco | 10.5 ms | 9.32 ms | 1.13x faster | Significant (t=11.79) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| tornado_http | 264 ms | 225 ms | 1.17x faster | Significant (t=39.74) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| unpack_sequence | 76.8 ns | 47.9 ns | 1.60x faster | Significant (t=89.47) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| unpickle | 23.1 us | 21.2 us | 1.09x faster | Significant (t=11.76) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| unpickle_list | 6.98 us | 6.48 us | 1.08x faster | Significant (t=18.10) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| unpickle_pure_python | 518 us | 281 us | 1.84x faster | Significant (t=178.74) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| xml_etree_generate | 153 ms | 115 ms | 1.33x faster | Significant (t=50.22) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| xml_etree_iterparse | 161 ms | 152 ms | 1.06x faster | Significant (t=7.30) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| xml_etree_parse | 221 ms | 212 ms | 1.04x faster | Significant (t=5.69) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
| xml_etree_process | 122 ms | 80.0 ms | 1.53x faster | Significant (t=59.13) |
+-------------------------+--------------------+-----------------------------+---------------+-------------------------+
Skipped 5 benchmarks only in cpython38_gcc.json: django_template, sympy_expand, sympy_integrate, sympy_str, sympy_sum