In responding to some of the benchmarks posted about the speed and performance of Symfony 2 and how they truly compare to some of the other frameworks out there, Paul Jones has shared his thoughts and process on using his benchmarking system to get some differing results.

Fabien Potencier released Symfony 2.0.0alpha1 last week, along with some benchmarks showing its performance. I am glad to see that Fabien used my benchmarking system and methodology, and am happy to see that he is paying attention to the performance of his framework. I take this as an acceptance on his part that my methodology is legitimate and valid, and that it has value when comparing framework responsiveness.

Paul points out that Fabien's reporting is a bit inaccurate and goes on to talk about how his numbers are off and what a more correct version of the benchmarks would look like. He takes the testing methodology that Fabien used in his process and reapplies it to his benchmarking process using clean Amazon EC2 instances and Siege to run some response/request testing on software running on each framework. Numbers are run for three different comparisons and results are found...but you'll have to read the rest of the post to find those out.