Apache v2.4.1 ApacheBench v2.3 revision 1178079 benchmark tool faster than Apache v2.2′s revision ?

Started Apache v2.4.1 benchmark tests on CentOS 6.2 64bit guest Virtualbox server mainly with using Siege benchmark and ApacheBench benchmark tools. But noticed something interesting in that if I use ApacheBench v2.3 revision 1178079 included with Apache v2.4.1 to test against both Apache v2.2.22 and Apache v2.4.1 webservers, that it’s consistently and repeatedly ~12% faster for both Apache v2.2.22 and v2.4.1 web servers than if I use the ApacheBench v2.3 revision 655654 benchmark version that is included with Apache v2.2.22 !

So the newer version of ApacheBench v2.3 revision 1178079 included in Apache v2.4.1 seems to be faster which means you need to pay attention to which ApacheBench version and revision you use to benchmark and measure against for Apache v2.2 vs Apache v2.4.1 tests as well as for Nginx and Litespeed web server benchmark comparisons. It’s fair to say, to do proper comparison you would need to use the same ApacheBench version and revision.

ApacheBench v2.3 revision comparisons

I installed Apache v2.2.22 via CentOS 64bit YUM repo (/etc prefix) and compiled Apache v2.4.1 on same server (/etc2 prefix) so that ApacheBench benchmark tools would be located at /usr/bin/ab (Apache v2.2.22 version) and /etc2/bin/ab (Apache v2.4.1 version).

Below is ApacheBench v2.3 revision comparison results against just Apache v2.4.1 web server:

With ApacheBench v2.3 revision 655654 benchmark tool included with Apache v2.2.22

static html file

/usr/bin/ab -k -c 300 -n 5000 192.168.56.120:82/phpinfo.html
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
 
Server Software:        Apache/2.4.1
Server Hostname:        192.168.56.120
Server Port:            82
 
Document Path:          /phpinfo.html
Document Length:        57947 bytes
 
Concurrency Level:      300
Time taken for tests:   1.205 seconds
Complete requests:      5000
Failed requests:        22
   (Connect: 0, Receive: 0, Length: 22, Exceptions: 0)
Write errors:           0
Keep-Alive requests:    4978
Total transferred:      298830177 bytes
HTML transferred:       297101289 bytes
Requests per second:    4150.74 [#/sec] (mean)
Time per request:       72.276 [ms] (mean)
Time per request:       0.241 [ms] (mean, across all concurrent requests)
Transfer rate:          242258.95 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    2   8.0      0      43
Processing:     1   66  32.0     60     947
Waiting:        0   16  31.8     11     891
Total:          1   68  36.9     60     951
 
Percentage of the requests served within a certain time (ms)
  50%     60
  66%     61
  75%     62
  80%     64
  90%     74
  95%     83
  98%    189
  99%    225
 100%    951 (longest request)

With ApacheBench v2.3 revision 1178079 benchmark tool included with Apache v2.4.1

static html file

/etc2/bin/ab -k -c 300 -n 5000 192.168.56.120:82/phpinfo.html
This is ApacheBench, Version 2.3 <$Revision: 1178079 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
 
Server Software:        Apache/2.4.1
Server Hostname:        192.168.56.120
Server Port:            82
 
Document Path:          /phpinfo.html
Document Length:        57947 bytes
 
Concurrency Level:      300
Time taken for tests:   1.084 seconds
Complete requests:      5000
Failed requests:        0
Write errors:           0
Keep-Alive requests:    5000
Total transferred:      291380300 bytes
HTML transferred:       289735000 bytes
Requests per second:    4612.75 [#/sec] (mean)
Time per request:       65.037 [ms] (mean)
Time per request:       0.217 [ms] (mean, across all concurrent requests)
Transfer rate:          262512.62 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    2   8.8      0      50
Processing:    19   62   7.7     63     121
Waiting:        1   23  11.2     24      71
Total:         19   64  12.4     63     171
 
Percentage of the requests served within a certain time (ms)
  50%     63
  66%     64
  75%     65
  80%     66
  90%     67
  95%     93
  98%    106
  99%    109
 100%    171 (longest request)

Repeating the tests over and over, result in the same differences. Basically, ApacheBench v2.3 revision 1178079 included with Apache v2.4.1 is faster than ApacheBench v2.3 revision 655654 included with Apache v2.2.22. Folks have you experienced this as well ? If so, feel free to reply and comment below to this article with your experiences.


Previous:
Next:



MaxCDN Site Acceleration

Get Cost Effective Content Delivery
Unbeatable speed, stats, & price
http://www.maxcdn.com



Add Comment Register

Leave a Comment