Skip to content

🎛️ Minimalistic runtime benchmarking utility for Linux

License

Notifications You must be signed in to change notification settings

mebeim/minibench

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Minibench

Minimalistic runtime benchmarking utility for Linux written in plain C99.

Design goals:

  • Concise, well documented, standard-conforming code.
  • No external dependencies of any kind.
  • Smallest possible overhead (within reasonable limits) for the timing code.
  • Ability to perform warm-up runs before starting timed runs.
  • Calculation of total, median, average, standard deviation, minimum and maximum of wall-clock time and CPU time, using an online algorithm where possible (i.e. for everything except median).
  • Preservation of the exit status of the benchmarked program when possible.
  • Ability to mute the benchmarked program's output (stdout and stderr).
  • Ability to early stop a running benchmarking session through CTRL+C (SIGINT).
  • Human readable, pretty-printed output.

Building and installation

Minibench is designed to run on a Linux system, though it will probably also compile and run on other Unix-like systems.

Use make to build, make install to install, and make uninstall to uninstall. Installing will simply create a copy of the compiled bench binary inside ~/.local/bin/, so make sure that directory is in your PATH.

Usage

Invoke bench -h for usage information:

Usage: bench [-hkqQv] [-n COUNT] [-w COUNT] PROGRAM [ARGS...]
Benchmark the running time of PROGRAM invoked with the given ARGS.

Command line options:
  -n COUNT  number of runs of the benchmarked program
  -w COUNT  number of warm-up runs of the benchmarked program before timed runs
  -k        forcibly kill benchmarked program if stopped by a signal, instead of
            waiting for it to continue (default behavior)
  -q        mute benchmarked program redirecting its stdout/stderr to /dev/null
  -Q        forcibly mute benchmarked program closing its stdout/stderr
  -h        show this help message and exit
  -v        print version information and exit

The exit status will be the one of the benchmarked program's last run, unless
stopped or killed by a signal, in which case it will be 128 + signal number.
On error, an error message will be printed before exiting with status 1.

Copyright © 2022-2023 Marco Bonelli. Licensed under the Apache License v2.0.