Apache v2.4.1 ApacheBench v2.3 revision 1178079 benchmark tool faster than Apache v2.2’s revision ?
Started Apache v2.4.1 benchmark tests on CentOS 6.2 64bit guest Virtualbox server mainly with using Siege benchmark and ApacheBench benchmark tools. But noticed something interesting in that if I use ApacheBench v2.3 revision 1178079 included with Apache v2.4.1 to test against both Apache v2.2.22 and Apache v2.4.1 webservers, that it’s consistently and repeatedly ~12% faster for both Apache v2.2.22 and v2.4.1 web servers than if I use the ApacheBench v2.3 revision 655654 benchmark version that is included with Apache v2.2.22 !
So the newer version of ApacheBench v2.3 revision 1178079 included in Apache v2.4.1 seems to be faster which means you need to pay attention to which ApacheBench version and revision you use to benchmark and measure against for Apache v2.2 vs Apache v2.4.1 tests as well as for Nginx and Litespeed web server benchmark comparisons. It’s fair to say, to do proper comparison you would need to use the same ApacheBench version and revision.
ApacheBench v2.3 revision comparisons
I installed Apache v2.2.22 via CentOS 64bit YUM repo (/etc prefix) and compiled Apache v2.4.1 on same server (/etc2 prefix) so that ApacheBench benchmark tools would be located at /usr/bin/ab (Apache v2.2.22 version) and /etc2/bin/ab (Apache v2.4.1 version).
Below is ApacheBench v2.3 revision comparison results against just Apache v2.4.1 web server:
With ApacheBench v2.3 revision 655654 benchmark tool included with Apache v2.2.22
static html file
/usr/bin/ab -k -c 300 -n 5000 192.168.56.120:82/phpinfo.html This is ApacheBench, Version 2.3 <$Revision: 655654 $> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Licensed to The Apache Software Foundation, http://www.apache.org/ Server Software: Apache/2.4.1 Server Hostname: 192.168.56.120 Server Port: 82 Document Path: /phpinfo.html Document Length: 57947 bytes Concurrency Level: 300 Time taken for tests: 1.205 seconds Complete requests: 5000 Failed requests: 22 (Connect: 0, Receive: 0, Length: 22, Exceptions: 0) Write errors: 0 Keep-Alive requests: 4978 Total transferred: 298830177 bytes HTML transferred: 297101289 bytes Requests per second: 4150.74 [#/sec] (mean) Time per request: 72.276 [ms] (mean) Time per request: 0.241 [ms] (mean, across all concurrent requests) Transfer rate: 242258.95 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 0 2 8.0 0 43 Processing: 1 66 32.0 60 947 Waiting: 0 16 31.8 11 891 Total: 1 68 36.9 60 951 Percentage of the requests served within a certain time (ms) 50% 60 66% 61 75% 62 80% 64 90% 74 95% 83 98% 189 99% 225 100% 951 (longest request) |
With ApacheBench v2.3 revision 1178079 benchmark tool included with Apache v2.4.1
static html file
/etc2/bin/ab -k -c 300 -n 5000 192.168.56.120:82/phpinfo.html This is ApacheBench, Version 2.3 <$Revision: 1178079 $> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Licensed to The Apache Software Foundation, http://www.apache.org/ Server Software: Apache/2.4.1 Server Hostname: 192.168.56.120 Server Port: 82 Document Path: /phpinfo.html Document Length: 57947 bytes Concurrency Level: 300 Time taken for tests: 1.084 seconds Complete requests: 5000 Failed requests: 0 Write errors: 0 Keep-Alive requests: 5000 Total transferred: 291380300 bytes HTML transferred: 289735000 bytes Requests per second: 4612.75 [#/sec] (mean) Time per request: 65.037 [ms] (mean) Time per request: 0.217 [ms] (mean, across all concurrent requests) Transfer rate: 262512.62 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 0 2 8.8 0 50 Processing: 19 62 7.7 63 121 Waiting: 1 23 11.2 24 71 Total: 19 64 12.4 63 171 Percentage of the requests served within a certain time (ms) 50% 63 66% 64 75% 65 80% 66 90% 67 95% 93 98% 106 99% 109 100% 171 (longest request) |
Repeating the tests over and over, result in the same differences. Basically, ApacheBench v2.3 revision 1178079 included with Apache v2.4.1 is faster than ApacheBench v2.3 revision 655654 included with Apache v2.2.22. Folks have you experienced this as well ? If so, feel free to reply and comment below to this article with your experiences.
