Skip to content

Latest commit

 

History

History
219 lines (198 loc) · 28.3 KB

bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-3.11.0.md

File metadata and controls

219 lines (198 loc) · 28.3 KB

Results vs. 3.11.0

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: linux-x86_64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.09x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.07x slower
  • Memory change: 1.05x

Benchmarks with tag 'apps':

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
2to3 287 ms 348 ms: 1.21x slower
chameleon 7.92 ms 8.85 ms: 1.12x slower
docutils 2.85 sec 3.46 sec: 1.22x slower
html5lib 72.2 ms 87.7 ms: 1.21x slower
tornado_http 124 ms 130 ms: 1.05x slower
Geometric mean (ref) 1.16x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
async_tree_memoization 629 ms 476 ms: 1.32x faster
async_tree_memoization_tg 600 ms 455 ms: 1.32x faster
async_tree_io_tg 1.15 sec 878 ms: 1.32x faster
async_tree_none_tg 474 ms 367 ms: 1.29x faster
async_tree_none 518 ms 401 ms: 1.29x faster
async_tree_io 1.17 sec 915 ms: 1.28x faster
async_tree_cpu_io_mixed_tg 750 ms 602 ms: 1.25x faster
async_tree_cpu_io_mixed 753 ms 654 ms: 1.15x faster
Geometric mean (ref) 1.28x faster

Benchmarks with tag 'math':

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
pidigits 251 ms 255 ms: 1.02x slower
float 74.9 ms 96.2 ms: 1.28x slower
nbody 92.9 ms 122 ms: 1.31x slower
Geometric mean (ref) 1.20x slower

Benchmarks with tag 'regex':

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
regex_v8 24.4 ms 25.9 ms: 1.06x slower
regex_dna 227 ms 245 ms: 1.08x slower
regex_effbot 3.34 ms 3.63 ms: 1.09x slower
regex_compile 156 ms 218 ms: 1.40x slower
Geometric mean (ref) 1.15x slower

Benchmarks with tag 'serialize':

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
json_dumps 13.3 ms 11.3 ms: 1.17x faster
json_loads 28.9 us 25.0 us: 1.16x faster
xml_etree_parse 155 ms 145 ms: 1.06x faster
pickle_dict 32.3 us 33.3 us: 1.03x slower
unpickle_list 4.60 us 4.81 us: 1.05x slower
xml_etree_iterparse 107 ms 114 ms: 1.06x slower
pickle 9.89 us 11.0 us: 1.11x slower
unpickle 13.3 us 15.3 us: 1.15x slower
pickle_list 3.94 us 4.59 us: 1.17x slower
xml_etree_generate 79.7 ms 96.2 ms: 1.21x slower
xml_etree_process 55.9 ms 68.0 ms: 1.22x slower
unpickle_pure_python 238 us 304 us: 1.27x slower
tomli_loads 2.25 sec 2.94 sec: 1.31x slower
pickle_pure_python 316 us 430 us: 1.36x slower
Geometric mean (ref) 1.10x slower

Benchmarks with tag 'startup':

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
python_startup_no_site 7.73 ms 8.93 ms: 1.15x slower
python_startup 10.7 ms 13.2 ms: 1.23x slower
Geometric mean (ref) 1.19x slower

Benchmarks with tag 'template':

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
django_template 39.3 ms 45.7 ms: 1.16x slower
genshi_xml 57.1 ms 68.1 ms: 1.19x slower
genshi_text 25.5 ms 32.6 ms: 1.28x slower
mako 11.0 ms 14.5 ms: 1.32x slower
Geometric mean (ref) 1.24x slower

All benchmarks:

Benchmark bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509 bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
typing_runtime_protocols 532 us 198 us: 2.68x faster
asyncio_tcp_ssl 3.07 sec 1.60 sec: 1.91x faster
asyncio_tcp 747 ms 392 ms: 1.91x faster
generators 54.6 ms 34.9 ms: 1.56x faster
async_tree_memoization 629 ms 476 ms: 1.32x faster
async_tree_memoization_tg 600 ms 455 ms: 1.32x faster
async_tree_io_tg 1.15 sec 878 ms: 1.32x faster
pylint 514 ms 394 ms: 1.31x faster
async_tree_none_tg 474 ms 367 ms: 1.29x faster
async_tree_none 518 ms 401 ms: 1.29x faster
async_tree_io 1.17 sec 915 ms: 1.28x faster
async_tree_cpu_io_mixed_tg 750 ms 602 ms: 1.25x faster
coroutines 27.8 ms 22.8 ms: 1.22x faster
json_dumps 13.3 ms 11.3 ms: 1.17x faster
json_loads 28.9 us 25.0 us: 1.16x faster
async_tree_cpu_io_mixed 753 ms 654 ms: 1.15x faster
logging_simple 7.24 us 6.78 us: 1.07x faster
xml_etree_parse 155 ms 145 ms: 1.06x faster
logging_format 7.71 us 7.35 us: 1.05x faster
pathlib 18.9 ms 18.1 ms: 1.05x faster
pidigits 251 ms 255 ms: 1.02x slower
json 5.58 ms 5.68 ms: 1.02x slower
bench_thread_pool 1.00 ms 1.02 ms: 1.02x slower
pickle_dict 32.3 us 33.3 us: 1.03x slower
sympy_sum 186 ms 191 ms: 1.03x slower
dask 410 ms 424 ms: 1.03x slower
tornado_http 124 ms 130 ms: 1.05x slower
unpickle_list 4.60 us 4.81 us: 1.05x slower
bench_mp_pool 4.70 ms 4.92 ms: 1.05x slower
regex_v8 24.4 ms 25.9 ms: 1.06x slower
xml_etree_iterparse 107 ms 114 ms: 1.06x slower
raytrace 309 ms 331 ms: 1.07x slower
regex_dna 227 ms 245 ms: 1.08x slower
chaos 74.9 ms 80.8 ms: 1.08x slower
richards_super 63.6 ms 68.7 ms: 1.08x slower
regex_effbot 3.34 ms 3.63 ms: 1.09x slower
sympy_integrate 25.8 ms 28.3 ms: 1.09x slower
comprehensions 25.1 us 27.7 us: 1.10x slower
pickle 9.89 us 11.0 us: 1.11x slower
sympy_str 337 ms 375 ms: 1.11x slower
chameleon 7.92 ms 8.85 ms: 1.12x slower
crypto_pyaes 83.3 ms 93.1 ms: 1.12x slower
meteor_contest 131 ms 146 ms: 1.12x slower
sqlite_synth 2.52 us 2.86 us: 1.13x slower
nqueens 103 ms 117 ms: 1.14x slower
pycparser 1.31 sec 1.50 sec: 1.14x slower
sympy_expand 553 ms 634 ms: 1.15x slower
deltablue 3.97 ms 4.55 ms: 1.15x slower
coverage 66.1 ms 75.9 ms: 1.15x slower
sqlglot_parse 1.51 ms 1.74 ms: 1.15x slower
unpickle 13.3 us 15.3 us: 1.15x slower
python_startup_no_site 7.73 ms 8.93 ms: 1.15x slower
sqlglot_transpile 1.91 ms 2.21 ms: 1.16x slower
dulwich_log 67.4 ms 78.1 ms: 1.16x slower
django_template 39.3 ms 45.7 ms: 1.16x slower
pickle_list 3.94 us 4.59 us: 1.17x slower
sqlglot_normalize 122 ms 142 ms: 1.17x slower
mypy2 762 ms 899 ms: 1.18x slower
deepcopy_reduce 3.40 us 4.04 us: 1.19x slower
gc_traversal 4.15 ms 4.94 ms: 1.19x slower
genshi_xml 57.1 ms 68.1 ms: 1.19x slower
fannkuch 416 ms 500 ms: 1.20x slower
gunicorn 966 us 1.16 ms: 1.20x slower
xml_etree_generate 79.7 ms 96.2 ms: 1.21x slower
aiohttp 986 us 1.19 ms: 1.21x slower
sqlglot_optimize 59.0 ms 71.4 ms: 1.21x slower
2to3 287 ms 348 ms: 1.21x slower
html5lib 72.2 ms 87.7 ms: 1.21x slower
deepcopy 391 us 475 us: 1.22x slower
docutils 2.85 sec 3.46 sec: 1.22x slower
xml_etree_process 55.9 ms 68.0 ms: 1.22x slower
richards 49.7 ms 61.3 ms: 1.23x slower
python_startup 10.7 ms 13.2 ms: 1.23x slower
async_generators 322 ms 398 ms: 1.24x slower
create_gc_cycles 1.58 ms 1.96 ms: 1.24x slower
scimark_lu 114 ms 142 ms: 1.24x slower
flaskblogging 3.88 ms 4.91 ms: 1.27x slower
pprint_pformat 1.67 sec 2.12 sec: 1.27x slower
unpickle_pure_python 238 us 304 us: 1.27x slower
genshi_text 25.5 ms 32.6 ms: 1.28x slower
go 158 ms 202 ms: 1.28x slower
float 74.9 ms 96.2 ms: 1.28x slower
pprint_safe_repr 805 ms 1.04 sec: 1.29x slower
tomli_loads 2.25 sec 2.94 sec: 1.31x slower
nbody 92.9 ms 122 ms: 1.31x slower
mako 11.0 ms 14.5 ms: 1.32x slower
telco 6.81 ms 9.22 ms: 1.35x slower
pickle_pure_python 316 us 430 us: 1.36x slower
regex_compile 156 ms 218 ms: 1.40x slower
scimark_monte_carlo 69.8 ms 98.6 ms: 1.41x slower
pyflate 449 ms 640 ms: 1.42x slower
scimark_sor 110 ms 160 ms: 1.46x slower
hexiom 6.98 ms 10.5 ms: 1.50x slower
logging_silent 100 ns 153 ns: 1.52x slower
scimark_fft 281 ms 428 ms: 1.52x slower
spectral_norm 95.1 ms 146 ms: 1.54x slower
deepcopy_memo 37.5 us 58.2 us: 1.55x slower
scimark_sparse_mat_mult 4.06 ms 6.75 ms: 1.66x slower
Geometric mean (ref) 1.09x slower

Benchmark hidden because not significant (3): mdp, thrift, asyncio_websockets Ignored benchmarks (3) of results/bm-20221024-3.11.0-deaf509/bm-20221024-pythonperf2-x86_64-python-v3.11.0-3.11.0-deaf509.json: sqlalchemy_declarative, sqlalchemy_imperative, unpack_sequence Ignored benchmarks (1) of results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json: bpe_tokeniser

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.09x
  • 95% likely to have a slowdown of 1.08x
  • 99% likely to have a slowdown of 1.07x

Memory

  • memory change: 1.05x