Skip to content

Latest commit

 

History

History
214 lines (192 loc) · 25.2 KB

bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-3.10.4.md

File metadata and controls

214 lines (192 loc) · 25.2 KB

Results vs. 3.10.4

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: linux-x86_64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.11x faster
  • HPT reliability: 99.92%
  • HPT 99th percentile: 1.01x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
2to3 348 ms 340 ms: 1.03x faster
chameleon 9.68 ms 8.17 ms: 1.19x faster
docutils 3.30 sec 3.39 sec: 1.03x slower
html5lib 88.9 ms 80.9 ms: 1.10x faster
tornado_http 136 ms 106 ms: 1.29x faster
Geometric mean (ref) 1.11x faster

Benchmarks with tag 'asyncio':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
async_tree_io 1.77 sec 985 ms: 1.80x faster
async_tree_none 728 ms 406 ms: 1.79x faster
async_tree_memoization 870 ms 510 ms: 1.71x faster
async_tree_cpu_io_mixed 1.02 sec 642 ms: 1.58x faster
Geometric mean (ref) 1.72x faster

Benchmarks with tag 'math':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
float 117 ms 97.0 ms: 1.21x faster
nbody 154 ms 137 ms: 1.12x faster
pidigits 191 ms 191 ms: 1.00x slower
Geometric mean (ref) 1.10x faster

Benchmarks with tag 'regex':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
regex_v8 27.8 ms 25.0 ms: 1.11x faster
regex_dna 227 ms 230 ms: 1.01x slower
regex_effbot 3.63 ms 3.80 ms: 1.05x slower
regex_compile 188 ms 203 ms: 1.08x slower
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'serialize':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
json_dumps 14.2 ms 11.1 ms: 1.27x faster
xml_etree_process 79.1 ms 70.0 ms: 1.13x faster
pickle_pure_python 484 us 439 us: 1.10x faster
tomli_loads 3.14 sec 2.85 sec: 1.10x faster
xml_etree_parse 168 ms 153 ms: 1.10x faster
json_loads 31.2 us 28.8 us: 1.09x faster
unpickle_pure_python 331 us 307 us: 1.08x faster
pickle_list 5.08 us 5.12 us: 1.01x slower
xml_etree_generate 99.4 ms 100 ms: 1.01x slower
unpickle_list 5.20 us 5.43 us: 1.04x slower
pickle 10.7 us 11.9 us: 1.11x slower
unpickle 14.4 us 16.2 us: 1.12x slower
pickle_dict 29.6 us 35.5 us: 1.20x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (1): xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
python_startup 14.6 ms 10.9 ms: 1.34x faster
python_startup_no_site 5.93 ms 7.21 ms: 1.21x slower
Geometric mean (ref) 1.05x faster

Benchmarks with tag 'template':

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
mako 16.3 ms 14.8 ms: 1.10x faster
django_template 48.2 ms 44.1 ms: 1.09x faster
genshi_text 31.8 ms 34.3 ms: 1.08x slower
genshi_xml 66.0 ms 75.0 ms: 1.14x slower
Geometric mean (ref) 1.00x slower

All benchmarks:

Benchmark bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
typing_runtime_protocols 544 us 199 us: 2.74x faster
generators 80.1 ms 31.1 ms: 2.58x faster
async_tree_io 1.77 sec 985 ms: 1.80x faster
async_tree_none 728 ms 406 ms: 1.79x faster
asyncio_tcp 922 ms 528 ms: 1.75x faster
deltablue 7.91 ms 4.63 ms: 1.71x faster
async_tree_memoization 870 ms 510 ms: 1.71x faster
async_tree_cpu_io_mixed 1.02 sec 642 ms: 1.58x faster
pylint 551 ms 370 ms: 1.49x faster
raytrace 507 ms 343 ms: 1.48x faster
coroutines 35.1 ms 24.6 ms: 1.43x faster
asyncio_tcp_ssl 2.57 sec 1.88 sec: 1.37x faster
scimark_sor 220 ms 162 ms: 1.36x faster
python_startup 14.6 ms 10.9 ms: 1.34x faster
richards_super 94.7 ms 71.5 ms: 1.32x faster
tornado_http 136 ms 106 ms: 1.29x faster
chaos 115 ms 89.7 ms: 1.29x faster
crypto_pyaes 128 ms 99.9 ms: 1.28x faster
logging_simple 8.30 us 6.49 us: 1.28x faster
thrift 1.07 ms 840 us: 1.28x faster
json_dumps 14.2 ms 11.1 ms: 1.27x faster
logging_format 9.09 us 7.26 us: 1.25x faster
go 240 ms 192 ms: 1.25x faster
sqlglot_parse 2.17 ms 1.76 ms: 1.23x faster
richards 79.3 ms 64.5 ms: 1.23x faster
float 117 ms 97.0 ms: 1.21x faster
sqlglot_transpile 2.57 ms 2.15 ms: 1.20x faster
chameleon 9.68 ms 8.17 ms: 1.19x faster
scimark_monte_carlo 118 ms 100 ms: 1.18x faster
djangocms 38.4 us 33.1 us: 1.16x faster
logging_silent 190 ns 166 ns: 1.15x faster
xml_etree_process 79.1 ms 70.0 ms: 1.13x faster
aiohttp 1.44 ms 1.28 ms: 1.12x faster
pyflate 716 ms 638 ms: 1.12x faster
dask 441 ms 394 ms: 1.12x faster
nbody 154 ms 137 ms: 1.12x faster
pathlib 20.5 ms 18.4 ms: 1.11x faster
gunicorn 1.53 ms 1.38 ms: 1.11x faster
dulwich_log 84.3 ms 75.8 ms: 1.11x faster
regex_v8 27.8 ms 25.0 ms: 1.11x faster
mako 16.3 ms 14.8 ms: 1.10x faster
pickle_pure_python 484 us 439 us: 1.10x faster
tomli_loads 3.14 sec 2.85 sec: 1.10x faster
html5lib 88.9 ms 80.9 ms: 1.10x faster
xml_etree_parse 168 ms 153 ms: 1.10x faster
django_template 48.2 ms 44.1 ms: 1.09x faster
pycparser 1.58 sec 1.44 sec: 1.09x faster
json_loads 31.2 us 28.8 us: 1.09x faster
spectral_norm 170 ms 157 ms: 1.08x faster
unpickle_pure_python 331 us 307 us: 1.08x faster
bench_thread_pool 986 us 934 us: 1.06x faster
comprehensions 28.8 us 27.4 us: 1.05x faster
mypy2 894 ms 862 ms: 1.04x faster
scimark_lu 176 ms 170 ms: 1.03x faster
sympy_sum 196 ms 191 ms: 1.03x faster
2to3 348 ms 340 ms: 1.03x faster
deepcopy_reduce 4.17 us 4.07 us: 1.02x faster
deepcopy_memo 58.5 us 57.6 us: 1.01x faster
json 5.69 ms 5.62 ms: 1.01x faster
sympy_integrate 25.8 ms 25.6 ms: 1.01x faster
sqlglot_normalize 143 ms 142 ms: 1.00x faster
pidigits 191 ms 191 ms: 1.00x slower
pickle_list 5.08 us 5.12 us: 1.01x slower
fannkuch 532 ms 536 ms: 1.01x slower
xml_etree_generate 99.4 ms 100 ms: 1.01x slower
sqlglot_optimize 69.2 ms 69.9 ms: 1.01x slower
pprint_pformat 2.10 sec 2.13 sec: 1.01x slower
sqlite_synth 3.02 us 3.07 us: 1.01x slower
regex_dna 227 ms 230 ms: 1.01x slower
asyncio_websockets 559 ms 568 ms: 1.02x slower
pprint_safe_repr 1.02 sec 1.04 sec: 1.02x slower
deepcopy 479 us 491 us: 1.02x slower
sympy_str 346 ms 354 ms: 1.02x slower
docutils 3.30 sec 3.39 sec: 1.03x slower
scimark_fft 466 ms 482 ms: 1.03x slower
sympy_expand 566 ms 586 ms: 1.04x slower
unpickle_list 5.20 us 5.43 us: 1.04x slower
regex_effbot 3.63 ms 3.80 ms: 1.05x slower
scimark_sparse_mat_mult 6.47 ms 6.81 ms: 1.05x slower
hexiom 10.4 ms 11.0 ms: 1.06x slower
meteor_contest 120 ms 127 ms: 1.06x slower
gc_traversal 3.62 ms 3.87 ms: 1.07x slower
regex_compile 188 ms 203 ms: 1.08x slower
genshi_text 31.8 ms 34.3 ms: 1.08x slower
mdp 2.85 sec 3.13 sec: 1.10x slower
flaskblogging 8.58 ms 9.44 ms: 1.10x slower
async_generators 444 ms 488 ms: 1.10x slower
pickle 10.7 us 11.9 us: 1.11x slower
nqueens 106 ms 119 ms: 1.12x slower
unpickle 14.4 us 16.2 us: 1.12x slower
create_gc_cycles 1.62 ms 1.84 ms: 1.14x slower
genshi_xml 66.0 ms 75.0 ms: 1.14x slower
coverage 79.4 ms 94.4 ms: 1.19x slower
pickle_dict 29.6 us 35.5 us: 1.20x slower
python_startup_no_site 5.93 ms 7.21 ms: 1.21x slower
telco 7.27 ms 9.73 ms: 1.34x slower
Geometric mean (ref) 1.11x faster

Benchmark hidden because not significant (2): xml_etree_iterparse, bench_mp_pool Ignored benchmarks (3) of results/bm-20220323-3.10.4-9d38120/bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120.json: sqlalchemy_declarative, sqlalchemy_imperative, unpack_sequence Ignored benchmarks (5) of results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json: async_tree_cpu_io_mixed_tg, async_tree_io_tg, async_tree_memoization_tg, async_tree_none_tg, bpe_tokeniser

HPT report

  • Reliability score: 99.92% likely to be faster
  • 90% likely to have a speedup of 1.04x
  • 95% likely to have a speedup of 1.03x
  • 99% likely to have a speedup of 1.01x

Memory

  • memory change: 1.13x