- fork: python
- ref: c15f94d6fbc960790db3
- machine: linux-x86_64
- commit hash: c15f94d
- commit date: 2024-06-08
- overall geometric mean: 1.37x slower
- HPT reliability: 100.00%
- HPT 99th percentile: 1.25x slower
- Memory change: 1.19x
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| 2to3 | 264 ms | 393 ms: 1.49x slower |
| chameleon | 6.70 ms | 12.0 ms: 1.80x slower |
| docutils | 2.66 sec | 3.40 sec: 1.28x slower |
| html5lib | 64.8 ms | 99.0 ms: 1.53x slower |
| tornado_http | 98.1 ms | 134 ms: 1.37x slower |
| Geometric mean | (ref) | 1.48x slower |
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| async_tree_io_tg | 1.29 sec | 874 ms: 1.48x faster |
| async_tree_io | 1.29 sec | 922 ms: 1.40x faster |
| async_tree_memoization_tg | 626 ms | 502 ms: 1.25x faster |
| async_tree_none_tg | 491 ms | 399 ms: 1.23x faster |
| async_tree_none | 528 ms | 447 ms: 1.18x faster |
| async_tree_memoization | 639 ms | 554 ms: 1.15x faster |
| async_tree_cpu_io_mixed_tg | 761 ms | 660 ms: 1.15x faster |
| async_tree_cpu_io_mixed | 749 ms | 712 ms: 1.05x faster |
| Geometric mean | (ref) | 1.23x faster |
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| pidigits | 194 ms | 186 ms: 1.04x faster |
| float | 78.9 ms | 131 ms: 1.66x slower |
| nbody | 96.0 ms | 216 ms: 2.25x slower |
| Geometric mean | (ref) | 1.53x slower |
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| regex_effbot | 3.51 ms | 3.59 ms: 1.02x slower |
| regex_dna | 205 ms | 229 ms: 1.12x slower |
| regex_v8 | 22.9 ms | 26.9 ms: 1.18x slower |
| regex_compile | 141 ms | 213 ms: 1.51x slower |
| Geometric mean | (ref) | 1.19x slower |
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| xml_etree_parse | 164 ms | 145 ms: 1.13x faster |
| xml_etree_iterparse | 108 ms | 111 ms: 1.03x slower |
| json_dumps | 13.3 ms | 13.8 ms: 1.04x slower |
| unpickle_list | 5.21 us | 5.52 us: 1.06x slower |
| pickle_list | 4.59 us | 4.87 us: 1.06x slower |
| json_loads | 29.2 us | 31.7 us: 1.09x slower |
| pickle | 11.0 us | 12.1 us: 1.10x slower |
| unpickle | 13.8 us | 16.5 us: 1.19x slower |
| pickle_dict | 34.6 us | 43.8 us: 1.27x slower |
| xml_etree_generate | 81.1 ms | 109 ms: 1.34x slower |
| tomli_loads | 2.30 sec | 3.19 sec: 1.39x slower |
| xml_etree_process | 56.9 ms | 88.7 ms: 1.56x slower |
| unpickle_pure_python | 242 us | 388 us: 1.61x slower |
| pickle_pure_python | 320 us | 571 us: 1.78x slower |
| Geometric mean | (ref) | 1.22x slower |
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| python_startup_no_site | 6.01 ms | 9.19 ms: 1.53x slower |
| python_startup | 8.56 ms | 13.9 ms: 1.62x slower |
| Geometric mean | (ref) | 1.57x slower |
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| genshi_xml | 53.4 ms | 80.4 ms: 1.50x slower |
| genshi_text | 22.5 ms | 38.5 ms: 1.71x slower |
| django_template | 33.5 ms | 58.2 ms: 1.74x slower |
| mako | 10.7 ms | 20.1 ms: 1.88x slower |
| Geometric mean | (ref) | 1.70x slower |
| Benchmark | bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509 | bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d |
|---|---|---|
| typing_runtime_protocols | 520 us | 251 us: 2.07x faster |
| generators | 74.9 ms | 39.0 ms: 1.92x faster |
| asyncio_tcp_ssl | 3.11 sec | 2.03 sec: 1.53x faster |
| gc_traversal | 4.01 ms | 2.67 ms: 1.50x faster |
| async_tree_io_tg | 1.29 sec | 874 ms: 1.48x faster |
| asyncio_tcp | 875 ms | 591 ms: 1.48x faster |
| async_tree_io | 1.29 sec | 922 ms: 1.40x faster |
| async_tree_memoization_tg | 626 ms | 502 ms: 1.25x faster |
| async_tree_none_tg | 491 ms | 399 ms: 1.23x faster |
| pylint | 476 ms | 393 ms: 1.21x faster |
| async_tree_none | 528 ms | 447 ms: 1.18x faster |
| bench_mp_pool | 24.0 ms | 20.7 ms: 1.16x faster |
| async_tree_memoization | 639 ms | 554 ms: 1.15x faster |
| async_tree_cpu_io_mixed_tg | 761 ms | 660 ms: 1.15x faster |
| xml_etree_parse | 164 ms | 145 ms: 1.13x faster |
| async_tree_cpu_io_mixed | 749 ms | 712 ms: 1.05x faster |
| pidigits | 194 ms | 186 ms: 1.04x faster |
| create_gc_cycles | 1.43 ms | 1.39 ms: 1.03x faster |
| regex_effbot | 3.51 ms | 3.59 ms: 1.02x slower |
| asyncio_websockets | 550 ms | 567 ms: 1.03x slower |
| xml_etree_iterparse | 108 ms | 111 ms: 1.03x slower |
| json_dumps | 13.3 ms | 13.8 ms: 1.04x slower |
| unpickle_list | 5.21 us | 5.52 us: 1.06x slower |
| pickle_list | 4.59 us | 4.87 us: 1.06x slower |
| json_loads | 29.2 us | 31.7 us: 1.09x slower |
| pickle | 11.0 us | 12.1 us: 1.10x slower |
| pathlib | 18.5 ms | 20.5 ms: 1.11x slower |
| regex_dna | 205 ms | 229 ms: 1.12x slower |
| json | 5.24 ms | 5.94 ms: 1.13x slower |
| coroutines | 27.0 ms | 30.7 ms: 1.14x slower |
| comprehensions | 23.6 us | 27.7 us: 1.17x slower |
| regex_v8 | 22.9 ms | 26.9 ms: 1.18x slower |
| unpickle | 13.8 us | 16.5 us: 1.19x slower |
| mdp | 2.77 sec | 3.37 sec: 1.22x slower |
| sqlite_synth | 2.57 us | 3.17 us: 1.23x slower |
| pickle_dict | 34.6 us | 43.8 us: 1.27x slower |
| docutils | 2.66 sec | 3.40 sec: 1.28x slower |
| nqueens | 87.9 ms | 113 ms: 1.29x slower |
| scimark_sparse_mat_mult | 5.03 ms | 6.47 ms: 1.29x slower |
| sympy_integrate | 21.5 ms | 28.3 ms: 1.32x slower |
| meteor_contest | 109 ms | 144 ms: 1.32x slower |
| scimark_fft | 345 ms | 460 ms: 1.33x slower |
| dulwich_log | 64.6 ms | 86.2 ms: 1.33x slower |
| xml_etree_generate | 81.1 ms | 109 ms: 1.34x slower |
| pycparser | 1.19 sec | 1.61 sec: 1.36x slower |
| tornado_http | 98.1 ms | 134 ms: 1.37x slower |
| fannkuch | 405 ms | 561 ms: 1.38x slower |
| tomli_loads | 2.30 sec | 3.19 sec: 1.39x slower |
| crypto_pyaes | 76.7 ms | 108 ms: 1.41x slower |
| sympy_str | 297 ms | 418 ms: 1.41x slower |
| telco | 6.86 ms | 9.68 ms: 1.41x slower |
| aiohttp | 1.12 ms | 1.58 ms: 1.42x slower |
| gunicorn | 1.20 ms | 1.72 ms: 1.43x slower |
| async_generators | 374 ms | 550 ms: 1.47x slower |
| 2to3 | 264 ms | 393 ms: 1.49x slower |
| sympy_sum | 169 ms | 252 ms: 1.49x slower |
| genshi_xml | 53.4 ms | 80.4 ms: 1.50x slower |
| regex_compile | 141 ms | 213 ms: 1.51x slower |
| sqlglot_normalize | 113 ms | 171 ms: 1.52x slower |
| html5lib | 64.8 ms | 99.0 ms: 1.53x slower |
| python_startup_no_site | 6.01 ms | 9.19 ms: 1.53x slower |
| deepcopy | 365 us | 559 us: 1.53x slower |
| sympy_expand | 484 ms | 743 ms: 1.53x slower |
| sqlglot_optimize | 55.3 ms | 85.9 ms: 1.55x slower |
| xml_etree_process | 56.9 ms | 88.7 ms: 1.56x slower |
| mypy2 | 686 ms | 1.07 sec: 1.57x slower |
| deepcopy_memo | 40.2 us | 63.7 us: 1.59x slower |
| deepcopy_reduce | 3.22 us | 5.11 us: 1.59x slower |
| richards_super | 61.9 ms | 99.1 ms: 1.60x slower |
| unpickle_pure_python | 242 us | 388 us: 1.61x slower |
| python_startup | 8.56 ms | 13.9 ms: 1.62x slower |
| spectral_norm | 108 ms | 177 ms: 1.64x slower |
| logging_simple | 6.22 us | 10.3 us: 1.66x slower |
| float | 78.9 ms | 131 ms: 1.66x slower |
| chaos | 71.9 ms | 120 ms: 1.68x slower |
| richards | 49.8 ms | 84.2 ms: 1.69x slower |
| pprint_safe_repr | 747 ms | 1.26 sec: 1.69x slower |
| pprint_pformat | 1.55 sec | 2.63 sec: 1.69x slower |
| hexiom | 6.89 ms | 11.7 ms: 1.70x slower |
| sqlglot_transpile | 1.75 ms | 2.99 ms: 1.71x slower |
| genshi_text | 22.5 ms | 38.5 ms: 1.71x slower |
| logging_format | 6.81 us | 11.7 us: 1.71x slower |
| pyflate | 434 ms | 748 ms: 1.72x slower |
| logging_silent | 111 ns | 192 ns: 1.73x slower |
| scimark_monte_carlo | 70.7 ms | 123 ms: 1.73x slower |
| django_template | 33.5 ms | 58.2 ms: 1.74x slower |
| pickle_pure_python | 320 us | 571 us: 1.78x slower |
| sqlglot_parse | 1.43 ms | 2.57 ms: 1.79x slower |
| chameleon | 6.70 ms | 12.0 ms: 1.80x slower |
| flaskblogging | 7.28 ms | 13.4 ms: 1.85x slower |
| mako | 10.7 ms | 20.1 ms: 1.88x slower |
| raytrace | 309 ms | 586 ms: 1.90x slower |
| scimark_lu | 116 ms | 232 ms: 1.99x slower |
| go | 149 ms | 304 ms: 2.05x slower |
| deltablue | 3.92 ms | 8.28 ms: 2.11x slower |
| scimark_sor | 121 ms | 257 ms: 2.12x slower |
| nbody | 96.0 ms | 216 ms: 2.25x slower |
| bench_thread_pool | 834 us | 3.05 ms: 3.66x slower |
| coverage | 78.8 ms | 760 ms: 9.65x slower |
| thrift | 784 us | 12.8 ms: 16.28x slower |
| Geometric mean | (ref) | 1.37x slower |
| Ignored benchmarks (5) of results/bm-20221024-3.11.0-deaf509/bm-20221024-linux-x86_64-python-v3.11.0-3.11.0-deaf509.json: dask, djangocms, sqlalchemy_declarative, sqlalchemy_imperative, unpack_sequence | ||
| Ignored benchmarks (1) of results/bm-20240608-3.13.0b2+-c15f94d-NOGIL/bm-20240608-linux-x86_64-python-c15f94d6fbc960790db3-3.13.0b2+-c15f94d.json: bpe_tokeniser |
- Reliability score: 100.00% likely to be slow
- 90% likely to have a slowdown of 1.32x
- 95% likely to have a slowdown of 1.30x
- 99% likely to have a slowdown of 1.25x
- memory change: 1.19x