Skip to content

Wrapper Program to run a number of benchmarking programs with some basic analytics

License

Notifications You must be signed in to change notification settings

driscoll42/benchmarking_suite

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

WARNING: Use at your own risk. This suite will run a number of benchmarks on your computer and could potentially damge it, especially if you're overclocked. Read what this does carefully and run the tests you mean to run.

Python Based Benchmarking Suite

This is a benchmarking suite to automate running various benchmarks on your machine using their CLI interfaces including the following features:

  • Run benchmarking multiple times and compute average + standard deviation
  • Wait a certain amount of time between benchmarks
  • Discard initial runs to cache data
  • Wait for CPU temperature/load to drop below a threshold before running (TODO)
  • Store output into csv for future reference
  • Extract OS, CPU, GPU, driver versions and other system data on each run

Note: This repo does not contain any of the benchmarks inherently as I do not have permission to share them. Please see the Install instructions below for how to set up the benchmarks

Note: Currently only supports Windows-based CPU benchmarks

Note: I have only tested this on my personal computers, if bugs are found please report them!

CPU Benchmarks

Implemented CPU Benchmarks

Benchmark Description Official CLI Documentation Unofficial CLI Documentation Notes
Cinebench R11.5 Link
Cinebench R15 Link
Cinebench R15 Extreme Link
Cinebench R20 Link
Cinebench R23 Link Link
Pi Fast Not really CLI, loads file
y-cruncher Download zip and open "Command Lines.txt"
Blender Link
7 Zip Link
GPUPI 3.3.3 Link
GPUPI 3.2 Link
CPU-Z Download zip and open "cpuz_readme.txt"

Unsupported CPU Benchmarks

Benchmark Reason for Lack of Support CLI Documentation
HWBot x265 No CLI Interface
HWBOT Prime No CLI Interface
Super Pi No CLI Interface
Corona 1.3 No CLI Interface (Anandtech has a special version with CLI)
XTU Not supported on AMD CPUs
Geekbench 3 Requires Pro License for CLI Link
Geekbench 4 Requires Pro License for CLI Link
Geekbench 5 Requires Pro License for CLI Link
SPEC 2006 Requires Pro License for CLI Link
SPEC CPU 2017 Requires Pro License for CLI Link
PCMark2002 Requires Pro License for CLI
PCMark04 Requires Pro License for CLI
PCMark05 Requires Pro License for CLI
PCMark Vantage Requires Pro License for CLI Link
PCMark 7 Requires Pro License for CLI Link
PCMark 8 Requires Pro License for CLI Link
PCMark 10 Requires Pro License for CLI Link
PCMark2002 Requires Pro License for CLI
3DMark99 Requires Pro License for CLI
3DMark2000 Requires Pro License for CLI
3DMark2001 Requires Pro License for CLI
3DMark03 Requires Pro License for CLI
3DMark05 Requires Pro License for CLI
3DMark06 Requires Pro License for CLI
3DMark Vantage Requires Pro License for CLI Link
3DMark 11 Requires Pro License for CLI Link
3DMark Requires Pro License for CLI Link
VRMark Requires Pro License for CLI Link

Potential CPU Benchmarks

Benchmark Official CLI Documentation Unofficial CLI Documentation Notes
pyprime 1.x
pyprime 2.x
AI-benchmark
wPrime
Realbench
Sisoft Sandra Crytp
Dolphin
Handbrake
Cygwin GCC 9.3.0 Compile with MT
Chromium Compile with MSVC, Clang, Ninja
Prime95
Adobe After Effects 2020 Puget Systesms
Matlab R2020 Built-In Bnechmark
Microsfot Excel Large Number Crunching Test
Adobe Acrobat PDF Export PDF to PNG Images
Adobe Photoshop Puget Systems Benchmark
Adobe Premiere Warp Stabilizer
DaVinci Resolve STudio Puget Systems Benchmark
Adobe Premiere Puget Systems Export Test
Adobe Premiere 4K 2 Pass H.264 Export
Office
Agisoft Photoscan 1.3: 2D to 3D Conversion
Application Loading Time: GIMP 2.10.18 from a fresh install
Compile Testing (WIP)
Science
3D Particle Movement v2.1 (Non-AVX + AVX2/AVX512)
NAMD 2.13: Nanoscale Molecular Dynamics on ApoA1 protein
Simulation
Digicortex 1.35: Brain stimulation simulation
Dwarf Fortress 0.44.12: Fantasy world creation and time passage
Rendering
Crysis CPU-Only: Can it run Crysis? What, on just the CPU at 1080p? Sure
POV-Ray 3.7.1: Another Ray Tracing Test
V-Ray: Another popular renderer
Encoding
AES Encoding: Instruction accelerated encoding
WinRAR 5.90: Popular compression tool
Legacy
3DPM v1: Naïve version of 3DPM v2.1 with no acceleration
X264 HD3.0: Vintage transcoding benchmark
Web
Kraken 1.1: Depreciated web test with no successor
Octane 2.0: More comprehensive test (but also deprecated with no successor)
Speedometer 2: List-based web-test with different frameworks
Synthetic
AIDA Memory Bandwidth
Linux OpenSSL Speed (rsa2048 sign/verify, sha256, md5)
LinX 0.9.5 LINPACK (where appropriate)

GPU Benchmarks

Implemented GPU Benchmarks

Benchmark Official CLI Documentation Unofficial CLI Documentation Notes
Cinebench R11.5 Link
Cinebench R15 Link
Cinebench R15 Extreme Link

Potential GPU Benchmarks

Benchmark Official CLI Documentation Unofficial CLI Documentation Notes
GPUPI 3.3.3 Link
GPUPI 3.2 Link
Blender Link
Unigine Benchmarks
Many game benchmarks

Install Instructions

  • Create an Anaconda 3.8 python environment
  • See environment.yml for full list of packages
  • Need to add in about anaconda, benchmark setup, etc...

How to Run

  • Run main.py
  • Add other details

Parameters

TBD

About

Wrapper Program to run a number of benchmarking programs with some basic analytics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages