NAME Bencher::Scenario::AppSorted - Benchmark sorted vs is-sorted VERSION This document describes version 0.002 of Bencher::Scenario::AppSorted (from Perl distribution Bencher-Scenario-AppSorted), released on 2021-07-31. SYNOPSIS To run benchmark with default option: % bencher -m AppSorted To run module startup overhead benchmark: % bencher --module-startup -m AppSorted For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run "bencher --help". DESCRIPTION Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details. BENCHMARKED MODULES Version numbers shown below are the versions used when running the sample benchmark. App::sorted 0.002 File::IsSorted 0.0.6 BENCHMARK PARTICIPANTS * sorted (command) Command line: #TEMPLATE: sorted ; true * is-sorted (command) Command line: #TEMPLATE: is-sorted check ; true BENCHMARK DATASETS * 100k-sorted * 100k-unsorted-middle * 100k-unsorted-beginning BENCHMARK SAMPLE RESULTS Sample benchmark #1 Run on: perl: *v5.34.0*, CPU: *Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz (4 cores)*, OS: *GNU/Linux LinuxMint version 19*, OS kernel: *Linux version 5.3.0-68-generic*. Benchmark command (default options): % bencher -m AppSorted Result formatted as table: #table1# | participant | dataset | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples | |-------------+-------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------| | sorted | 100k-sorted | 8.1 | 120 | 0.00% | 96.99% | 0.0011 | 7 | | sorted | 100k-unsorted-middle | 10 | 98 | 27.06% | 55.04% | 0.00018 | 7 | | sorted | 100k-unsorted-beginning | 13 | 75 | 64.21% | 19.97% | 0.00029 | 8 | | is-sorted | 100k-sorted | 13 | 75 | 65.08% | 19.33% | 0.00031 | 7 | | is-sorted | 100k-unsorted-middle | 14 | 70 | 77.62% | 10.91% | 0.00016 | 8 | | is-sorted | 100k-unsorted-beginning | 16 | 63 | 96.99% | 0.00% | 0.00023 | 7 | The above result formatted in Benchmark.pm style: Rate sorted 100k-sorted sorted 100k-unsorted-middle sorted 100k-unsorted-beginning is-sorted 100k-sorted is-sorted 100k-unsorted-middle is-sorted 100k-unsorted-beginning sorted 100k-sorted 8.1/s -- -18% -37% -37% -41% -47% sorted 100k-unsorted-middle 10/s 22% -- -23% -23% -28% -35% sorted 100k-unsorted-beginning 13/s 60% 30% -- 0% -6% -16% is-sorted 100k-sorted 13/s 60% 30% 0% -- -6% -16% is-sorted 100k-unsorted-middle 14/s 71% 39% 7% 7% -- -9% is-sorted 100k-unsorted-beginning 16/s 90% 55% 19% 19% 11% -- Legends: is-sorted 100k-sorted: dataset=100k-sorted participant=is-sorted is-sorted 100k-unsorted-beginning: dataset=100k-unsorted-beginning participant=is-sorted is-sorted 100k-unsorted-middle: dataset=100k-unsorted-middle participant=is-sorted sorted 100k-sorted: dataset=100k-sorted participant=sorted sorted 100k-unsorted-beginning: dataset=100k-unsorted-beginning participant=sorted sorted 100k-unsorted-middle: dataset=100k-unsorted-middle participant=sorted The above result presented as chart: Sample benchmark #2 Benchmark command (benchmarking module startup overhead): % bencher -m AppSorted --module-startup Result formatted as table: #table2# | participant | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples | |---------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------| | File::IsSorted | 32 | 28 | 0.00% | 693.00% | 0.00012 | 7 | | App::sorted | 9 | 5 | 242.68% | 131.41% | 0.00032 | 7 | | perl -e1 (baseline) | 4 | 0 | 693.00% | 0.00% | 0.00016 | 9 | The above result formatted in Benchmark.pm style: Rate F:I A:s perl -e1 (baseline) F:I 31.2/s -- -71% -87% A:s 111.1/s 255% -- -55% perl -e1 (baseline) 250.0/s 700% 125% -- Legends: A:s: mod_overhead_time=5 participant=App::sorted F:I: mod_overhead_time=28 participant=File::IsSorted perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline) The above result presented as chart: To display as an interactive HTML table on a browser, you can add option "--format html+datatables". CONTRIBUTOR perlancar (on netbook-dell-xps13) HOMEPAGE Please visit the project's homepage at . SOURCE Source repository is at . BUGS Please report any bugs or feature requests on the bugtracker website When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature. AUTHOR perlancar COPYRIGHT AND LICENSE This software is copyright (c) 2021 by perlancar@cpan.org. This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.