nginx性能优化及测试
服务器平台：dell r720
处理器: Intel Xeon E5-2609 v2 @ 2.50GHz *2
内存：128G
硬盘：3T raid5
操作系统：CentOS7.2 x64
配置修改：/etc/sysctl.conf
net.ipv4.tcp_syncookies=1
net.ipv4.tcp_tw_reuse=1
net.ipv4.tcp_tw_recycle=1
net.ipv4.tcp_fin_timeout=30
net.core.netdev_max_backlog=20000
net.core.somaxconn=20000
net.ipv4.tcp_max_orphans=20000
net.ipv4.tcp_max_syn_backlog=20000
net.ipv4.tcp_timestamps=0
net.ipv4.tcp_synack_retries=1
net.ipv4.tcp_syn_retries=1
配置修改:/etc/security/limits.conf
* soft nofile 10000
* hard nofile 10000
nginx.conf主要配置：
worker_processes 8;
worker_cpu_affinity 00000001 00000010 00000100 00001000 00010000 00100000 01000000 10000000;
events {
worker_connections 65535;
use epoll;
epoll_events 10000;
}
server {
。。。
location /tmp/ {
alias /tmp/;
autoindex on;
}
}测试样本：
[root@localhost tmp]# ll /tmp/
total 36
-rw-r--r--. 1 root root 10240 Aug 9 03:04 10k.txt
-rw-r--r--. 1 root root 1024 Aug 9 03:03 1k.txt
-rw-r--r--. 1 root root 2048 Aug 9 03:11 2k.txt
-rw-r--r--. 1 root root 3072 Aug 9 03:13 3k.txt
-rw-r--r--. 1 root root 4096 Aug 9 03:16 4k.txt
-rw-r--r--. 1 root root 5120 Aug 9 03:07 5k.txt
客户端与服务器用一个千兆交换机互联，处理器：Intel(R) Core(TM) i5-4460 CPU @ 3.20GHz，内存16G
操作系统：Fedora 22 x64
测试工具：Apache bench
工具安装：sudo dnf install httpd-tools -y
测试命令：
ab -n 1000000 -c 100 http://172.16.1.140/tmp/1k.txt
Document Path: /tmp/1k.txt
Document Length: 1024 bytes
Concurrency Level: 100
Time taken for tests: 25.521 seconds
Complete requests: 1000000
Failed requests: 0
Total transferred: 1274000000 bytes
HTML transferred: 1024000000 bytes
Requests per second: 39183.77 [#/sec] (mean)
Time per request: 2.552 [ms] (mean)
Time per request: 0.026 [ms] (mean, across all concurrent requests)
Transfer rate: 48750.12 [Kbytes/sec] received
服务器网卡目测平均：230Mbit/s
Document Path: /tmp/2k.txt
Document Length: 2048 bytes
Concurrency Level: 100
Time taken for tests: 25.245 seconds
Complete requests: 1000000
Failed requests: 0
Total transferred: 2298000000 bytes
HTML transferred: 2048000000 bytes
Requests per second: 39611.50 [#/sec] (mean)
Time per request: 2.525 [ms] (mean)
Time per request: 0.025 [ms] (mean, across all concurrent requests)
Transfer rate: 88893.78 [Kbytes/sec] received
服务器网卡目测平均：330Mbit/s
Server Software: nginx/1.11.6
Server Hostname: 172.16.1.140
Server Port: 80
Document Path: /tmp/3k.txt
Document Length: 3072 bytes
Concurrency Level: 100
Time taken for tests: 31.855 seconds
Complete requests: 1000000
Failed requests: 0
Total transferred: 3322000000 bytes
HTML transferred: 3072000000 bytes
Requests per second: 31392.34 [#/sec] (mean)
Time per request: 3.185 [ms] (mean)
Time per request: 0.032 [ms] (mean, across all concurrent requests)
Transfer rate: 101841.16 [Kbytes/sec] received
服务器网卡目测平均：491Mbit/s
Document Path: /tmp/4k.txt
Document Length: 4096 bytes
Concurrency Level: 100
Time taken for tests: 39.808 seconds
Complete requests: 1000000
Failed requests: 0
Total transferred: 4347000000 bytes
HTML transferred: 4096000000 bytes
Requests per second: 25120.48 [#/sec] (mean)
Time per request: 3.981 [ms] (mean)
Time per request: 0.040 [ms] (mean, across all concurrent requests)
Transfer rate: 106639.38 [Kbytes/sec] received
服务器网卡目测平均：920Mbit/s
Document Path: /tmp/5k.txt
Document Length: 5120 bytes
Concurrency Level: 100
Time taken for tests: 48.670 seconds
Complete requests: 1000000
Failed requests: 0
Total transferred: 5371000000 bytes
HTML transferred: 5120000000 bytes
Requests per second: 20546.67 [#/sec] (mean)
Time per request: 4.867 [ms] (mean)
Time per request: 0.049 [ms] (mean, across all concurrent requests)
Transfer rate: 107769.70 [Kbytes/sec] received
服务器网卡目测平均：940Mbit/s
Document Path: /tmp/10k.txt
Document Length: 10240 bytes
Concurrency Level: 100
Time taken for tests: 92.317 seconds
Complete requests: 1000000
Failed requests: 0
Total transferred: 10492000000 bytes
HTML transferred: 10240000000 bytes
Requests per second: 10832.30 [#/sec] (mean)
Time per request: 9.232 [ms] (mean)
Time per request: 0.092 [ms] (mean, across all concurrent requests)
Transfer rate: 110988.73 [Kbytes/sec] received
服务器网卡目测平均：955Mbit/s
静态资源放在/tmp（内存文件系统上）
关掉access log 对性能没有影响
服务器有4个网口，由于CPU还有很大余量，预计4个网口同时使用（公网dns负载均衡），10k测试样本能达到接近3.6Gbit/s吞吐量且CPU接近饱和
由于测试样本位于/tmp，因此磁盘io对本次测试无明显影响