Skip to content

Latest commit

 

History

History
182 lines (155 loc) · 19.7 KB

bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22-vs-3.12.6.md

File metadata and controls

182 lines (155 loc) · 19.7 KB

Results vs. 3.12.6

  • fork: python
  • ref: b52de22ac345ad8583bc
  • machine: linux-x86_64
  • commit hash: b52de22
  • commit date: 2025-01-15
  • overall geometric mean: 1.051x faster
  • HPT reliability: 99.86%
  • HPT 99th percentile: 1.01x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
2to3 456 ms 512 ms: 1.12x slower
docutils 4.00 sec 3.69 sec: 1.08x faster
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (1): html5lib

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
async_tree_io 1.85 sec 882 ms: 2.10x faster
async_tree_io_tg 1.93 sec 979 ms: 1.98x faster
async_tree_memoization_tg 930 ms 497 ms: 1.87x faster
async_tree_none 741 ms 397 ms: 1.87x faster
async_tree_memoization 977 ms 523 ms: 1.87x faster
async_tree_none_tg 704 ms 385 ms: 1.83x faster
async_tree_cpu_io_mixed_tg 1.10 sec 720 ms: 1.53x faster
async_tree_cpu_io_mixed 1.08 sec 780 ms: 1.38x faster
async_generators 589 ms 560 ms: 1.05x faster
coroutines 29.5 ms 31.2 ms: 1.06x slower
asyncio_websockets 748 ms 790 ms: 1.06x slower
Geometric mean (ref) 1.52x faster

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
float 123 ms 116 ms: 1.06x faster
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (2): pidigits, nbody

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
regex_compile 187 ms 174 ms: 1.07x faster
regex_dna 278 ms 294 ms: 1.06x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (2): regex_effbot, regex_v8

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
tomli_loads 2.88 sec 2.59 sec: 1.11x faster
pickle_pure_python 436 us 393 us: 1.11x faster
xml_etree_parse 241 ms 220 ms: 1.09x faster
json_loads 37.9 us 41.7 us: 1.10x slower
xml_etree_iterparse 169 ms 188 ms: 1.11x slower
xml_etree_process 83.7 ms 93.3 ms: 1.12x slower
json_dumps 14.3 ms 17.2 ms: 1.20x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (2): xml_etree_generate, unpickle_pure_python

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
python_startup_no_site 17.6 ms 16.8 ms: 1.04x faster
python_startup 23.7 ms 32.1 ms: 1.35x slower
Geometric mean (ref) 1.14x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
genshi_xml 67.6 ms 71.1 ms: 1.05x slower
mako 15.7 ms 16.9 ms: 1.07x slower
django_template 44.9 ms 50.8 ms: 1.13x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): genshi_text

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22
async_tree_io 1.85 sec 882 ms: 2.10x faster
async_tree_io_tg 1.93 sec 979 ms: 1.98x faster
async_tree_memoization_tg 930 ms 497 ms: 1.87x faster
async_tree_none 741 ms 397 ms: 1.87x faster
async_tree_memoization 977 ms 523 ms: 1.87x faster
async_tree_none_tg 704 ms 385 ms: 1.83x faster
async_tree_cpu_io_mixed_tg 1.10 sec 720 ms: 1.53x faster
async_tree_cpu_io_mixed 1.08 sec 780 ms: 1.38x faster
deepcopy 468 us 359 us: 1.30x faster
deepcopy_memo 52.4 us 42.4 us: 1.24x faster
deepcopy_reduce 4.04 us 3.49 us: 1.16x faster
go 172 ms 149 ms: 1.16x faster
pylint 465 ms 403 ms: 1.15x faster
mdp 3.97 sec 3.50 sec: 1.14x faster
logging_simple 9.45 us 8.32 us: 1.14x faster
richards_super 72.8 ms 65.0 ms: 1.12x faster
raytrace 408 ms 366 ms: 1.11x faster
tomli_loads 2.88 sec 2.59 sec: 1.11x faster
pickle_pure_python 436 us 393 us: 1.11x faster
comprehensions 27.1 us 24.5 us: 1.11x faster
xml_etree_parse 241 ms 220 ms: 1.09x faster
pathlib 31.6 ms 28.9 ms: 1.09x faster
docutils 4.00 sec 3.69 sec: 1.08x faster
scimark_fft 500 ms 464 ms: 1.08x faster
regex_compile 187 ms 174 ms: 1.07x faster
scimark_monte_carlo 96.4 ms 90.5 ms: 1.06x faster
scimark_sor 167 ms 157 ms: 1.06x faster
float 123 ms 116 ms: 1.06x faster
bpe_tokeniser 6.59 sec 6.21 sec: 1.06x faster
logging_silent 139 ns 131 ns: 1.06x faster
pycparser 1.79 sec 1.69 sec: 1.06x faster
pyflate 727 ms 688 ms: 1.06x faster
pprint_pformat 1.98 sec 1.87 sec: 1.06x faster
sqlalchemy_imperative 24.7 ms 23.4 ms: 1.06x faster
async_generators 589 ms 560 ms: 1.05x faster
meteor_contest 146 ms 139 ms: 1.05x faster
python_startup_no_site 17.6 ms 16.8 ms: 1.04x faster
genshi_xml 67.6 ms 71.1 ms: 1.05x slower
regex_dna 278 ms 294 ms: 1.06x slower
coroutines 29.5 ms 31.2 ms: 1.06x slower
asyncio_websockets 748 ms 790 ms: 1.06x slower
scimark_lu 152 ms 163 ms: 1.07x slower
mako 15.7 ms 16.9 ms: 1.07x slower
logging_format 9.59 us 10.4 us: 1.08x slower
bench_thread_pool 3.48 ms 3.78 ms: 1.09x slower
sqlite_synth 3.87 us 4.22 us: 1.09x slower
json_loads 37.9 us 41.7 us: 1.10x slower
json 6.85 ms 7.56 ms: 1.10x slower
xml_etree_iterparse 169 ms 188 ms: 1.11x slower
thrift 1.06 ms 1.18 ms: 1.11x slower
xml_etree_process 83.7 ms 93.3 ms: 1.12x slower
2to3 456 ms 512 ms: 1.12x slower
django_template 44.9 ms 50.8 ms: 1.13x slower
sympy_expand 582 ms 663 ms: 1.14x slower
telco 9.59 ms 11.2 ms: 1.16x slower
json_dumps 14.3 ms 17.2 ms: 1.20x slower
python_startup 23.7 ms 32.1 ms: 1.35x slower
coverage 95.4 ms 131 ms: 1.38x slower
gc_traversal 5.86 ms 9.97 ms: 1.70x slower
create_gc_cycles 1.94 ms 4.59 ms: 2.37x slower
bench_mp_pool 20.7 ms 105 ms: 5.08x slower
Geometric mean (ref) 1.02x faster

Benchmark hidden because not significant (29): nqueens, sqlglot_normalize, sqlalchemy_declarative, sympy_sum, dulwich_log, generators, scimark_sparse_mat_mult, chaos, typing_runtime_protocols, xml_etree_generate, pidigits, pprint_safe_repr, spectral_norm, crypto_pyaes, genshi_text, nbody, hexiom, richards, sympy_integrate, regex_effbot, fannkuch, deltablue, sqlglot_parse, unpickle_pure_python, html5lib, regex_v8, sqlglot_transpile, sqlglot_optimize, sympy_str Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (6) of results/bm-20250115-3.14.0a4+-b52de22/bm-20250115-linux-x86_64-python-b52de22ac345ad8583bc-3.14.0a4+-b52de22.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers

  • Geometric mean (including insignificant results): 1.051x faster

HPT report

  • Reliability score: 99.86% likely to be faster
  • 90% likely to have a speedup of 1.02x
  • 95% likely to have a speedup of 1.02x
  • 99% likely to have a speedup of 1.01x

Memory

  • memory change: 1.13x