Forum OpenACS Q&A: More benchmarks:

Collapse
4: More benchmarks: (response to 1)
Posted by Jonathan Ellis on
I ran some more benchmarks, also using ab, since I wanted to see a comparison against IIS. Since the original author didn't specify what page he was serving, I ran mine against the default "It Worked!!" apache page from RH 6.2. (Which has an extra .png image from the regular apache "It Worked!!" page, FWIW.)

I also got wildly varying results testing with 700 requests so I tested with 10000 instead. I kept concurrency level at 50. These results are for PIII/450 single processor servers with 256 MB of RAM.

Short version: IIS kicked AOLServer's and Apache's butts. (Boo hiss!)

On Apache:

Requests per second:    718.39
Transfer rate:          1587.64 kb/s received
Connnection Times (ms)
              min   avg   max
Connect:        0     0     5
Processing:     8    68   618
Total:          8    68   623

On IIS:

Requests per second:    1450.12
Transfer rate:          3143.85 kb/s received
Connnection Times (ms)
              min   avg   max
Connect:        0     1  3280
Processing:     9    32    35
Total:          9    33  3315

On AOLServer:

Requests per second:    745.66
Transfer rate:          1605.40 kb/s received
Connnection Times (ms)
              min   avg   max
Connect:        0     0     5
Processing:    14    52  3055
Total:         14    52  3060

I'm trying to email the author of the linked article asking what page he was serving. I'm curious how he got results of AOLServer being so much faster than Apache. (I'm as willing as the next guy to believe the AOLServer's fast, but I'm just not seeing the kind of difference he was claiming.)

I'm also planning to do a test of dynamic pages with IIS + ColdFusion + Oracle vs AOLServer + Oracle. (Any suggestions of what you'd like to see tested? Please include tcl. :)

BTW, many thanks to the authors of the new OpenACS install guide. BIG help!