Fix #15081 (usability: try to report misuse of exclude options) · runner aws-testrunner-3 · 2026-11-18 22:53:56 UTC
Overall the performance looks unchanged: total time -0.4%, typical package -0.1% (geometric mean of 46 packages that take at least 1 s). 1 package(s) timed out with the PR, see below. Each package was timed once, so changes of a few percent are within the noise.
Each mark is one package: how much longer (up) or shorter (down) the analysis took with the PR, against the time it takes with main (log scale). The shaded band is ±10% (about the same). Short analyses vary a lot between runs; the packages on the right matter most for the total time. Changes beyond the plot are drawn at its edge.
Packages that take at least 1 s with main (46 packages); faster ones are too noisy.
| Package | main | PR | Difference | Change |
|---|---|---|---|---|
| soci_4.1.4 | 136.16 s | 141.30 s | +5.14 s | +3.8% |
| cadabra2_2.4.3.2 | 112.87 s | 114.73 s | +1.86 s | +1.6% |
| netcf_0.2.8 | 8.24 s | 8.78 s | +0.54 s | +6.6% |
| r-cran-nanoarrow_0.9.0 | 18.89 s | 19.10 s | +0.21 s | +1.1% |
| vsearch_2.30.4 | 27.23 s | 27.29 s | +0.06 s | +0.2% |
| pdlzip_1.15 | 2.32 s | 2.33 s | +0.01 s | +0.4% |
| packup_0.6 | 2.21 s | 2.22 s | +0.01 s | +0.5% |
| lua-system_0.7.1 | 1.35 s | 1.36 s | +0.01 s | +0.7% |
| gf-complete_1.0.2+2017.04.10.git.ea75cdf | 1.04 s | 1.05 s | +0.01 s | +1.0% |
| rungetty_1.2 | 0.04 s | 0.05 s | +0.01 s | +25.0% |
No package got more than 10% slower.
No package got more than 10% faster.
| Package | Timed out with |
|---|---|
| gcc-riscv64-unknown-elf_8.3.0.2019.08+dfsg | both |
| Package | main | PR | Difference | Change |
|---|---|---|---|---|
| gcc-riscv64-unknown-elf_8.3.0.2019.08+dfsg | 1800.16 s | 1800.16 s | +0.00 s | +0.0% |
| httrack_3.51.0 | 424.48 s | 407.67 s | -16.81 s | -4.0% |
| soci_4.1.4 | 136.16 s | 141.30 s | +5.14 s | +3.8% |
| cadabra2_2.4.3.2 | 112.87 s | 114.73 s | +1.86 s | +1.6% |
| openms_2.6.0+cleaned1 | 98.64 s | 97.82 s | -0.82 s | -0.8% |
| gcc-h8300-hms_3.4.6+dfsg2 | 83.61 s | 83.59 s | -0.02 s | -0.0% |
| eccodes_2.50.1 | 56.00 s | 55.48 s | -0.52 s | -0.9% |
| magics++_4.17.1 | 52.19 s | 51.58 s | -0.61 s | -1.2% |
| vsearch_2.30.4 | 27.23 s | 27.29 s | +0.06 s | +0.2% |
| qt5-style-kvantum_1.0.7 | 26.62 s | 26.43 s | -0.19 s | -0.7% |
| r-cran-nanoarrow_0.9.0 | 18.89 s | 19.10 s | +0.21 s | +1.1% |
| ericw-tools_2.0.0~alpha11+ds | 11.98 s | 11.96 s | -0.02 s | -0.2% |
| netcf_0.2.8 | 8.24 s | 8.78 s | +0.54 s | +6.6% |
| goban_1.1 | 6.77 s | 6.73 s | -0.04 s | -0.6% |
| vorbis-tools_1.4.3 | 6.44 s | 6.43 s | -0.01 s | -0.2% |
| mujs_1.3.11 | 6.09 s | 6.08 s | -0.01 s | -0.2% |
| alsa-scarlett-gui_1.0~beta9 | 6.03 s | 6.02 s | -0.01 s | -0.2% |
| icon_9.5.25a | 5.36 s | 5.34 s | -0.02 s | -0.4% |
| carbon-c-relay_3.7.4 | 4.81 s | 4.79 s | -0.02 s | -0.4% |
| python-cmarkgfm_2025.10.22 | 4.41 s | 4.36 s | -0.05 s | -1.1% |
| gnomint_1.6.8 | 3.78 s | 3.75 s | -0.03 s | -0.8% |
| vinyl-cache_9.0.1 | 3.69 s | 3.66 s | -0.03 s | -0.8% |
| gnome-shell_51.0 | 3.61 s | 3.61 s | +0.00 s | +0.0% |
| unarr_1.0.1 | 3.56 s | 3.52 s | -0.04 s | -1.1% |
| namazu2_2.0.21 | 3.52 s | 3.50 s | -0.02 s | -0.6% |
| gddrescue_1.30 | 2.93 s | 2.91 s | -0.02 s | -0.7% |
| emacs-pdf-tools_1.3.0 | 2.86 s | 2.85 s | -0.01 s | -0.3% |
| pdlzip_1.15 | 2.32 s | 2.33 s | +0.01 s | +0.4% |
| aaphoto_0.45 | 2.25 s | 2.24 s | -0.01 s | -0.4% |
| packup_0.6 | 2.21 s | 2.22 s | +0.01 s | +0.5% |
| libe-book_0.1.4 | 2.21 s | 2.21 s | +0.00 s | +0.0% |
| gcl27_2.7.1 | 2.20 s | 2.16 s | -0.04 s | -1.8% |
| kf6-kcoreaddons_6.32.0 | 2.18 s | 2.17 s | -0.01 s | -0.5% |
| openvlbi_3.0.3 | 2.05 s | 2.03 s | -0.02 s | -1.0% |
| flex_2.6.4 | 1.84 s | 1.84 s | +0.00 s | +0.0% |
| sidplay-libs_2.1.1 | 1.83 s | 1.82 s | -0.01 s | -0.5% |
| gtklp_1.3.4 | 1.66 s | 1.66 s | +0.00 s | +0.0% |
| lua-system_0.7.1 | 1.35 s | 1.36 s | +0.01 s | +0.7% |
| deepin-qt5dxcb-plugin_5.7.12 | 1.35 s | 1.35 s | +0.00 s | +0.0% |
| xfburn_0.7.2 | 1.31 s | 1.30 s | -0.01 s | -0.8% |
| libvorbisidec_1.2.1+git20180316 | 1.23 s | 1.23 s | +0.00 s | +0.0% |
| libt3widget_1.2.2 | 1.18 s | 1.17 s | -0.01 s | -0.8% |
| jack-example-tools_4 | 1.14 s | 1.14 s | +0.00 s | +0.0% |
| timg_1.6.3 | 1.13 s | 1.12 s | -0.01 s | -0.9% |
| gf-complete_1.0.2+2017.04.10.git.ea75cdf | 1.04 s | 1.05 s | +0.01 s | +1.0% |
| utf8.h_0~git20190120.2a7c5bf | 1.01 s | 1.01 s | +0.00 s | +0.0% |
| aide_0.19.5 | 0.99 s | 0.98 s | -0.01 s | -1.0% |
| sudoku_1.0.5 | 0.93 s | 0.93 s | +0.00 s | +0.0% |
| lmarbles_1.1.2 | 0.90 s | 0.90 s | +0.00 s | +0.0% |
| i2util_1.6 | 0.87 s | 0.87 s | +0.00 s | +0.0% |
| veryfasttree_4.0.5+dfsg | 0.76 s | 0.75 s | -0.01 s | -1.3% |
| qnapi_0.2.3 | 0.72 s | 0.72 s | +0.00 s | +0.0% |
| cunit_2.1-3-dfsg | 0.71 s | 0.71 s | +0.00 s | +0.0% |
| tkrzw-python_0.1.32 | 0.69 s | 0.69 s | +0.00 s | +0.0% |
| kde-spectacle_22.12.3 | 0.57 s | 0.57 s | +0.00 s | +0.0% |
| kf6-ktextwidgets_6.32.0 | 0.55 s | 0.55 s | +0.00 s | +0.0% |
| mew_6.9 | 0.53 s | 0.53 s | +0.00 s | +0.0% |
| usbutils_019 | 0.49 s | 0.49 s | +0.00 s | +0.0% |
| virtualpg_2.0.1 | 0.49 s | 0.49 s | +0.00 s | +0.0% |
| foxtrotgps_1.2.2+bzr331 | 0.45 s | 0.45 s | +0.00 s | +0.0% |
| grilo_0.3.19 | 0.45 s | 0.45 s | +0.00 s | +0.0% |
| rarpd_1.1 | 0.40 s | 0.40 s | +0.00 s | +0.0% |
| libayatana-appindicator_0.6.0 | 0.38 s | 0.38 s | +0.00 s | +0.0% |
| tdbcmysql_1.1.15 | 0.33 s | 0.33 s | +0.00 s | +0.0% |
| ifupdown-ng_0.12.1 | 0.29 s | 0.29 s | +0.00 s | +0.0% |
| qoa_0+git20251017+ds | 0.28 s | 0.28 s | +0.00 s | +0.0% |
| kf6-kdesu_6.32.0 | 0.28 s | 0.28 s | +0.00 s | +0.0% |
| baloo-widgets_26.08.3 | 0.28 s | 0.28 s | +0.00 s | +0.0% |
| kio-gdrive_26.04.0 | 0.26 s | 0.26 s | +0.00 s | +0.0% |
| time_1.10 | 0.26 s | 0.26 s | +0.00 s | +0.0% |
| gtkballs_3.1.5+git20210713.6e53b66 | 0.24 s | 0.24 s | +0.00 s | +0.0% |
| lcas_1.3.20 | 0.24 s | 0.24 s | +0.00 s | +0.0% |
| rust-pango-sys_0.22.11 | 0.19 s | 0.19 s | +0.00 s | +0.0% |
| phnxdeco_0.33 | 0.18 s | 0.18 s | +0.00 s | +0.0% |
| intrusive-shared-ptr_1.6 | 0.13 s | 0.13 s | +0.00 s | +0.0% |
| network-manager-openconnect_1.2.10 | 0.13 s | 0.13 s | +0.00 s | +0.0% |
| avrp_1.0beta3 | 0.11 s | 0.11 s | +0.00 s | +0.0% |
| r-cran-rwiener_1.3-3 | 0.08 s | 0.08 s | +0.00 s | +0.0% |
| shotwell_0.32.15 | 0.07 s | 0.07 s | +0.00 s | +0.0% |
| haskell-unix-compat_0.7.4.1 | 0.07 s | 0.07 s | +0.00 s | +0.0% |
| moria_5.7.15 | 0.07 s | 0.07 s | +0.00 s | +0.0% |
| pps-tools_1.0.3 | 0.06 s | 0.06 s | +0.00 s | +0.0% |
| libapache2-mod-perl2_2.0.13 | 0.06 s | 0.06 s | +0.00 s | +0.0% |
| rungetty_1.2 | 0.04 s | 0.05 s | +0.01 s | +25.0% |
| lxqt-sudo_2.4.0 | 0.03 s | 0.03 s | +0.00 s | +0.0% |
| bvi_1.5.0 | 0.03 s | 0.03 s | +0.00 s | +0.0% |
| libxsettings_0.11 | 0.03 s | 0.03 s | +0.00 s | +0.0% |
| libmpack-lua_1.0.13 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| morbig_0.11.0 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| yacpi_3.0.1 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| crazy-complete_0.3.10 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| eo-spell_3.7 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| python-schedutils_0.6 | 0.02 s | 0.01 s | -0.01 s | -50.0% |
| passes-gtk_0.12 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| carrotsearch-randomizedtesting_2.7.9 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| pgaudit_1.5.0 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| golang-github-pebbe-zmq4_1.4.0 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| mod-vhost-ldap_2.4.0 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| bs2b-ladspa_0.9.1 | 0.02 s | 0.02 s | +0.00 s | +0.0% |
| libcrypt-ssleay-perl_0.73.06 | 0.01 s | 0.01 s | +0.00 s | +0.0% |
Generated 2026-11-19 00:41 UTC from 2026-11-18_14-58-48-0d886c725116-results.txt.