Parallel I/O Benchmarks, Applications, Traces

Below is a list of parallel I/O benchmarks, applications, and traces I am aware of (in no particular order). Let me (Rajeev Thakur) know if you have any additions or corrections to the list.

Updated: July 18, 2023

Benchmarks

H5bench: A Parallel I/O Benchmark Suite for HDF-5
https://github.com/hpc-io/h5bench
DLIO Benchmark for Scientific Deep Learning Applications
https://github.com/hariharan-devarajan/dlio_benchmark
IOR and mdtest
https://github.com/hpc/ior
WRFIO
https://bitbucket.org/pmalakar/wrfio
MACSio Proxy App
https://codesign.llnl.gov/macsio.php
PnetCDF Benchmarks
http://cucis.ece.northwestern.edu/projects/PnetCDF/#Benchmarks
Performance Test in Parallel I/O (PIO) Library
http://ncar.github.io/ParallelIO/ (see tests/performance directory)
HACC I/O
https://asc.llnl.gov/CORAL-benchmarks/#hacc
FLASH I/O
http://www.ucolick.org/~zingale/flash_benchmark_io/
An updated version for newer versions of parallel NetCDF and HDF-5 is available here .
Effective I/O Bandwidth Benchmark (b_eff_io)
http://www.hlrs.de/mpi/b_eff_io/
NAS BTIO Benchmark
http://www.nas.nasa.gov/Resources/Software/npb.html (see BT in NPB3.3-MPI)
MPI Tile I/O
http://www.mcs.anl.gov/pio-benchmark/
FS_TEST
https://github.com/fs-test/fs_test (see this as a README)
Trace-Driven Scientific I/O Benchmarks
http://www.cs.rochester.edu/research/os/hec-io/
HPIO and S3asim
http://www.eecs.northwestern.edu/~aching/research_webpage/io.html
Noncontig
http://www.mcs.anl.gov/pio-benchmark/
ioperf test in Silo
https://github.com/LLNL/Silo
Pattern I/O Benchmark (John Shalf, LBNL)
pattern_io.tar.gz
MADbench2
http://crd.lbl.gov/departments/computational-science/computational-cosmology-center/c3-research/madbench2/
QIO
http://usqcd.jlab.org/usqcd-docs/qio/
PIO-Bench
ftp://ftp.parl.clemson.edu/pub/pio-bench
An article describing it is at http://www.clustermonkey.net/content/view/87/32/.