gziptest.sh – parallel compression benchmark tests: gzip vs bzip2 vs pigz vs pbzip2 vs lzip vs plzip

Test 3:

Compression level 1 to 3 tests comparing pbzip2 vs lzip vs plzip for multi-threaded tests for 1 to 4 cpu threads. Not sure why but like test #2, pigz didn’t fully utilise all cpu threads hitting peak CPU utilisation at level 2 – 294% and 244% at level 3. Maybe, it’s detecting only the 2 physical cpu cores and not the 2 additional virtual cores ? Pbzip2 and plzip had no problem utilising all cpu threads peaking at 381% and 366% CPU utilisation respectively with 4 cpu threads.

For memory usage, only pigz showed some reasonably sane numbers at 14,368KB peak. Pbzip2 and plzip on the other hand consumed huge amounts of memory peaking at 144,128KB and 683,472KB respectively!

[root@centos57a ~]# ./gziptest.sh
install ./gziptest.sh at /usr/local/src
chmod +x ./gziptest.sh
 
./gziptest.sh help
./gziptest.sh pigzinstall
./gziptest.sh pbzip2install
./gziptest.sh lzipinstall
./gziptest.sh plzipinstall
./gziptest.sh leveltest
./gziptest.sh threadtest
./gziptest.sh levelgzip
./gziptest.sh levelbzip2
./gziptest.sh levelpigz
./gziptest.sh levelpbzip2
./gziptest.sh levellzip
./gziptest.sh threadpigz
./gziptest.sh threadpbzip2
./gziptest.sh threadplzip
./gziptest.sh helpfiles
./gziptest.sh dd