PHP Frameworks Bench

📊 This project attempts to measure the minimum overhead (minimum bootstrap cost) of PHP frameworks in the real world.

So I think the minimum should not include:

• cost of template engine
• cost of database manipulation
• cost of debugging information

Benchmarking on components like template engines or ORM/Database libraries is out of the scope of this project.

• PHP Frameworks Bench
  • Benchmarks
    • Latest
    • OPCache On/Off
  • How to Benchmark
  • Docker
  • Commands
  • Benchmarking Policy
  • Add Your Framework
  • Donate
  • References
  • License

Benchmarks

Latest

Environment

For PHP 8.2 check out this link.

• Ubuntu 22.04 LTS x86_64
  • PHP 8.3.0
  • OPCache Off
  • Apache 2.4.52
  • WRK 4.2.0 (5 min)
  • CPU Core i7-3770K/4.4Ghz
  • Memory 16G

Results (2023/12/1)

These are my benchmarks, not yours. I encourage you to run on your -production equivalent- environments.

framework	requests per second (rps)	relative (rps)	peak memory	relative (mem)
pure-php	27,077.31	321.6	0.42	1.0
kumbia-1.1	5,921.29	70.3	0.54	1.3
fastroute-1.3	4,516.12	53.6	0.56	1.3
phroute-2.2	4,198.83	49.9	0.58	1.4
leaf-3.5	1,487.36	17.7	1.11	2.6
fatfree-3.8	1,453.82	17.3	1.72	4.1
slim-4.12	798.17	9.5	1.57	3.7
ubiquity-2.4.x.dev	705.12	8.4	1.64	3.9
silex-2.3	543.66	6.5	2.20	5.2
yii-2.0-basic	503.76	6.0	2.56	6.1
fuelphp-1.9	429.18	5.1	2.61	6.2
lumen-10.0	325.27	3.9	3.61	8.6
symfony-5.4	309.74	3.7	3.77	9.0
codeigniter-4.4	302.21	3.6	3.62	8.6
symfony-7.0	286.46	3.4	4.07	9.7
symfony-6.4	280.83	3.3	4.11	9.8
cakephp-4.5	246.72	2.9	4.63	11.0
cakephp-5.0	243.96	2.9	4.74	11.3
laravel-10.2	84.19	1.0	13.06	31.0

OPCache On

Check out the video for more information.

How to Benchmark

If you want to have benchmarks on PHP extension frameworks like Phalcon, you need to install the extension first, based on its own documentation.

1- Download & Setup:

# make sure to put it in the root of your web path
$ git clone https://github.com/myaaghubi/PHP-Frameworks-Bench.git

$ cd PHP-Frameworks-Bench

# optional
$ nano config

# run the setup & follow the progress
$ yes | bash setup.sh

2- Make sure everything is ok:

$ bash check.sh
# bash check.sh -t pure-php
# ✔ pure-php

3- Run benchmarks:

# bash benchmark.sh --help
$ bash benchmark.sh

4- Check the results:

• web:

  http://127.0.0.1/PHP-Frameworks-Bench/

• terminal:

  # bash results.sh --help
  bash results.sh

Docker

Results with docker may or may not be reliable but in a situation you can use it like:

1- Change the base in config on the right port(8080 considered):

base="http://127.0.0.1:8080/PHP-Frameworks-Bench"
...

2- Run/download the docker:

$ bash docker-apache.sh

3- Run the benchmark:

# run it in another terminal
$ bash benchmark.sh

Commands

# use bash benchmark.sh --help
$ bash benchmark.sh -f -rapache -t pure-php

# run composer update for frameworks
$ bash update.sh

# to clean them all
# trouble? run it then
# you can use `bash setup.sh` again
$ bash clean.sh

# clear the cache of frameworks
$ bash clear-cache.sh

# show the results table
$ bash results.sh

To specify frameworks, put them with -t ... after each command:

# supported for `setup.sh`, `benchmark.sh`, `update.sh`, `clean.sh`, and `clear-cache.sh`
# bash benchmarks.sh --help
$ bash benchmark.sh -t laravel-10.2/ slim-4.12/ ...
...

Add Your Framework

Check out the Benchmarking Policy, to get more information watch the video OPCache On/Off.

Benchmarking Policy

• Use composer to install frameworks according to their official documentation.
• Use the default configuration.
  • Minimum changes on frameworks to have benchmarks.
  • Don't remove any components/configurations even if there is no use for them.
• Include a controller class to get the Hello World! for each, based on the default template of each framework for controllers.
• Turn off the debug mode and set the environment to production mode.
• General optimization for the production environment, like --optimize-autoloader for the composer.

Some frameworks are optimized more than others, so some developers may think using default configuration is not fair. The dept of optimizing a framework depends on the skills/experiences of the developer too, so it's the rabbit hole and nonsense for ranking. Please note optimizing for the Hello World is not acceptable! Building the fastest Hello World application is not the goal of this project. I think the default configuration of frameworks is a good starting point to have a ranking.

If you find something wrong in my code, feel free to send a PR.

🍔 Donate

Don't forget to donate if you find it useful ☕ 🍺 🍸 🍔

ETH: 0x0ADd51D6855d2DF11BB5F331A3fa345c67a863b2

References

Note: This project is based on php-framework-benchmark, thanks to Kenjis. It is very old and abandoned, so I decided to split it from the origin and change/update it separately.

🙏 Thanks to contributors:

• Joan Miquel

• Rostunov Sergey

📄 For frameworks, I considered the official repos:

• CakePHP
• CodeIgniter
• FastRoute
• FatFree
• FuelPHP
• KumbiaPHP
• Laminas
• Laravel
• Leaf
• Lumen
• PhRoute
• Silex
• Slim
• Symfony
• Ubiquity
• Yii

License

You are allowed to use this plugin/project under the terms of the GNU General Public License version 2.

Copyright (C) 2024 Mohammad Yaaghubi