Skip to content

Latest commit

 

History

History
202 lines (177 loc) · 23 KB

bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f-vs-3.12.6.md

File metadata and controls

202 lines (177 loc) · 23 KB

Results vs. 3.12.6

  • fork: python
  • ref: d05140f9f77d7dfc753d
  • machine: linux-x86_64
  • commit hash: d05140f
  • commit date: 2025-01-15
  • overall geometric mean: 1.073x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.07x slower
  • Memory change: 1.35x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
2to3 456 ms 546 ms: 1.20x slower
docutils 4.00 sec 4.14 sec: 1.04x slower
html5lib 88.9 ms 98.0 ms: 1.10x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
async_tree_io_tg 1.93 sec 751 ms: 2.58x faster
async_tree_none_tg 704 ms 316 ms: 2.23x faster
async_tree_io 1.85 sec 877 ms: 2.11x faster
async_tree_memoization_tg 930 ms 504 ms: 1.84x faster
async_tree_cpu_io_mixed_tg 1.10 sec 608 ms: 1.81x faster
async_tree_memoization 977 ms 560 ms: 1.74x faster
async_tree_none 741 ms 430 ms: 1.72x faster
async_tree_cpu_io_mixed 1.08 sec 752 ms: 1.43x faster
asyncio_websockets 748 ms 716 ms: 1.04x faster
coroutines 29.5 ms 34.6 ms: 1.17x slower
Geometric mean (ref) 1.58x faster

Benchmark hidden because not significant (1): async_generators

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
float 123 ms 105 ms: 1.18x faster
pidigits 250 ms 273 ms: 1.09x slower
nbody 119 ms 182 ms: 1.53x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
regex_effbot 5.13 ms 4.22 ms: 1.22x faster
regex_dna 278 ms 300 ms: 1.08x slower
regex_compile 187 ms 223 ms: 1.20x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (1): regex_v8

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
json_loads 37.9 us 41.0 us: 1.08x slower
tomli_loads 2.88 sec 3.14 sec: 1.09x slower
unpickle_pure_python 300 us 347 us: 1.16x slower
pickle_pure_python 436 us 555 us: 1.27x slower
json_dumps 14.3 ms 18.6 ms: 1.30x slower
xml_etree_generate 127 ms 168 ms: 1.32x slower
xml_etree_process 83.7 ms 111 ms: 1.33x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (2): xml_etree_parse, xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
python_startup_no_site 17.6 ms 21.7 ms: 1.23x slower
python_startup 23.7 ms 34.4 ms: 1.45x slower
Geometric mean (ref) 1.34x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
django_template 44.9 ms 59.3 ms: 1.32x slower
genshi_xml 67.6 ms 89.5 ms: 1.32x slower
genshi_text 30.2 ms 41.1 ms: 1.36x slower
mako 15.7 ms 25.7 ms: 1.64x slower
Geometric mean (ref) 1.40x slower

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f
async_tree_io_tg 1.93 sec 751 ms: 2.58x faster
async_tree_none_tg 704 ms 316 ms: 2.23x faster
async_tree_io 1.85 sec 877 ms: 2.11x faster
async_tree_memoization_tg 930 ms 504 ms: 1.84x faster
async_tree_cpu_io_mixed_tg 1.10 sec 608 ms: 1.81x faster
async_tree_memoization 977 ms 560 ms: 1.74x faster
async_tree_none 741 ms 430 ms: 1.72x faster
async_tree_cpu_io_mixed 1.08 sec 752 ms: 1.43x faster
regex_effbot 5.13 ms 4.22 ms: 1.22x faster
float 123 ms 105 ms: 1.18x faster
pycparser 1.79 sec 1.63 sec: 1.10x faster
sqlite_synth 3.87 us 3.61 us: 1.07x faster
asyncio_websockets 748 ms 716 ms: 1.04x faster
docutils 4.00 sec 4.14 sec: 1.04x slower
sqlglot_normalize 157 ms 169 ms: 1.08x slower
regex_dna 278 ms 300 ms: 1.08x slower
scimark_sor 167 ms 180 ms: 1.08x slower
comprehensions 27.1 us 29.3 us: 1.08x slower
json_loads 37.9 us 41.0 us: 1.08x slower
tomli_loads 2.88 sec 3.14 sec: 1.09x slower
pidigits 250 ms 273 ms: 1.09x slower
spectral_norm 156 ms 171 ms: 1.10x slower
html5lib 88.9 ms 98.0 ms: 1.10x slower
scimark_fft 500 ms 554 ms: 1.11x slower
mdp 3.97 sec 4.41 sec: 1.11x slower
scimark_lu 152 ms 171 ms: 1.12x slower
sympy_sum 222 ms 250 ms: 1.13x slower
logging_simple 9.45 us 10.7 us: 1.13x slower
deepcopy_reduce 4.04 us 4.59 us: 1.14x slower
scimark_monte_carlo 96.4 ms 111 ms: 1.15x slower
raytrace 408 ms 470 ms: 1.15x slower
pyflate 727 ms 839 ms: 1.15x slower
bench_thread_pool 3.48 ms 4.03 ms: 1.16x slower
unpickle_pure_python 300 us 347 us: 1.16x slower
json 6.85 ms 7.95 ms: 1.16x slower
generators 41.1 ms 47.9 ms: 1.16x slower
pprint_pformat 1.98 sec 2.31 sec: 1.17x slower
meteor_contest 146 ms 171 ms: 1.17x slower
coroutines 29.5 ms 34.6 ms: 1.17x slower
pprint_safe_repr 967 ms 1.14 sec: 1.18x slower
dulwich_log 100 ms 119 ms: 1.18x slower
bpe_tokeniser 6.59 sec 7.83 sec: 1.19x slower
crypto_pyaes 107 ms 128 ms: 1.19x slower
logging_format 9.59 us 11.5 us: 1.20x slower
regex_compile 187 ms 223 ms: 1.20x slower
2to3 456 ms 546 ms: 1.20x slower
sympy_str 385 ms 461 ms: 1.20x slower
sqlglot_optimize 76.0 ms 91.1 ms: 1.20x slower
sqlalchemy_declarative 218 ms 262 ms: 1.21x slower
richards_super 72.8 ms 88.4 ms: 1.21x slower
python_startup_no_site 17.6 ms 21.7 ms: 1.23x slower
scimark_sparse_mat_mult 6.70 ms 8.30 ms: 1.24x slower
chaos 84.9 ms 105 ms: 1.24x slower
go 172 ms 214 ms: 1.24x slower
logging_silent 139 ns 173 ns: 1.24x slower
fannkuch 540 ms 680 ms: 1.26x slower
hexiom 8.27 ms 10.5 ms: 1.26x slower
sympy_expand 582 ms 736 ms: 1.26x slower
sympy_integrate 29.8 ms 37.7 ms: 1.27x slower
typing_runtime_protocols 224 us 285 us: 1.27x slower
thrift 1.06 ms 1.35 ms: 1.27x slower
pickle_pure_python 436 us 555 us: 1.27x slower
sqlglot_transpile 2.34 ms 3.04 ms: 1.30x slower
json_dumps 14.3 ms 18.6 ms: 1.30x slower
create_gc_cycles 1.94 ms 2.55 ms: 1.32x slower
telco 9.59 ms 12.7 ms: 1.32x slower
xml_etree_generate 127 ms 168 ms: 1.32x slower
django_template 44.9 ms 59.3 ms: 1.32x slower
genshi_xml 67.6 ms 89.5 ms: 1.32x slower
xml_etree_process 83.7 ms 111 ms: 1.33x slower
richards 60.3 ms 81.3 ms: 1.35x slower
genshi_text 30.2 ms 41.1 ms: 1.36x slower
gc_traversal 5.86 ms 8.05 ms: 1.37x slower
sqlalchemy_imperative 24.7 ms 35.7 ms: 1.44x slower
sqlglot_parse 1.79 ms 2.58 ms: 1.44x slower
python_startup 23.7 ms 34.4 ms: 1.45x slower
nbody 119 ms 182 ms: 1.53x slower
coverage 95.4 ms 149 ms: 1.56x slower
deltablue 4.27 ms 6.82 ms: 1.60x slower
mako 15.7 ms 25.7 ms: 1.64x slower
bench_mp_pool 20.7 ms 95.8 ms: 4.63x slower
Geometric mean (ref) 1.11x slower

Benchmark hidden because not significant (9): deepcopy, xml_etree_parse, pathlib, xml_etree_iterparse, regex_v8, async_generators, pylint, deepcopy_memo, nqueens Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (6) of results/bm-20250115-3.14.0a4+-d05140f-NOGIL/bm-20250115-linux-x86_64-python-d05140f9f77d7dfc753d-3.14.0a4+-d05140f.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers

  • Geometric mean (including insignificant results): 1.073x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.09x
  • 95% likely to have a slowdown of 1.08x
  • 99% likely to have a slowdown of 1.07x

Memory

  • memory change: 1.35x