• openresty 性能优化

    openresty 性能优化

             

                     

                                     

    ab 压测

             

    命令格式：ab  [options]  url

    1. huli@hudeMacBook-Pro ~ % ab -h
    2. Usage: ab [options] [http[s]://]hostname[:port]/path
    3.  
    4. # 可选参数
    5. Options are:
    6.     -n requests     Number of requests to perform
    7.                     * 发送的请求总数
    8.  
    9.     -c concurrency  Number of multiple requests to make at a time
    10.                     * 请求并发数
    11.  
    12.     -t timelimit    Seconds to max. to spend on benchmarking
    13.                     This implies -n 50000
    14.                     * 压测最多执行的时间
    15.  
    16.     -s timeout      Seconds to max. wait for each response
    17.                     Default is 30 seconds
    18.                     * 响应超时时间，默认30s
    19.  
    20.     -b windowsize   Size of TCP send/receive buffer, in bytes
    21.     -B address      Address to bind to when making outgoing connections
    22.     -p postfile     File containing data to POST. Remember also to set -T
    23.     -u putfile      File containing data to PUT. Remember also to set -T
    24.     -T content-type Content-type header to use for POST/PUT data, eg.
    25.                     'application/x-www-form-urlencoded'
    26.                     Default is 'text/plain'
    27.     -v verbosity    How much troubleshooting info to print
    28.     -w              Print out results in HTML tables
    29.     -i              Use HEAD instead of GET
    30.     -x attributes   String to insert as table attributes
    31.     -y attributes   String to insert as tr attributes
    32.     -z attributes   String to insert as td or th attributes
    33.     -C attribute    Add cookie, eg. 'Apache=1234'. (repeatable)
    34.     -H attribute    Add Arbitrary header line, eg. 'Accept-Encoding: gzip'
    35.                     Inserted after all normal header lines. (repeatable)
    36.     -A attribute    Add Basic WWW Authentication, the attributes
    37.                     are a colon separated username and password.
    38.     -P attribute    Add Basic Proxy Authentication, the attributes
    39.                     are a colon separated username and password.
    40.     -X proxy:port   Proxyserver and port number to use
    41.     -V              Print version number and exit
    42.     -k              Use HTTP KeepAlive feature
    43.     -d              Do not show percentiles served table.
    44.     -S              Do not show confidence estimators and warnings.
    45.     -q              Do not show progress when doing more than 150 requests
    46.     -l              Accept variable document length (use this for dynamic pages)
    47.     -g filename     Output collected data to gnuplot format file.
    48.     -e filename     Output CSV file with percentages served
    49.     -r              Don't exit on socket receive errors.
    50.     -m method       Method name
    51.     -h              Display usage information (this message)
    52.     -I              Disable TLS Server Name Indication (SNI) extension
    53.     -Z ciphersuite  Specify SSL/TLS cipher suite (See openssl ciphers)
    54.     -f protocol     Specify SSL/TLS protocol
    55.                     (TLS1, TLS1.1, TLS1.2 or ALL)
    56.     -E certfile     Specify optional client certificate chain and private key

                 

    使用示例

    1. huli@hudeMacBook-Pro ~ % ab -n 100 https://www.taobao.com/
    2. This is ApacheBench, Version 2.3 <$Revision: 1879490 $>
    3. Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    4. Licensed to The Apache Software Foundation, http://www.apache.org/
    5.  
    6. Benchmarking www.taobao.com (be patient).....done
    7.  
    8.  
    9. Server Software:        Tengine
    10. Server Hostname:        www.taobao.com
    11. Server Port:            443
    12. SSL/TLS Protocol:       TLSv1.2,ECDHE-ECDSA-AES128-GCM-SHA256,256,128
    13. Server Temp Key:        ECDH X25519 253 bits
    14. TLS Server Name:        www.taobao.com
    15.  
    16. Document Path:          /
    17. Document Length:        86840 bytes
    18.  
    19. Concurrency Level:      1                   # 并发数
    20. Time taken for tests:   24.865 seconds      # 完成测试花费的时间
    21. Complete requests:      100                 # 完成发送的请求数
    22. Failed requests:        0                   # 失败的请求数
    23. Total transferred:      8796159 bytes       # 总传输数据量大小
    24. HTML transferred:       8684000 bytes       # html数据量大小
    25. Requests per second:    4.02 [#/sec] (mean) # 平均每秒执行的请求数
    26. Time per request:       248.646 [ms] (mean) # 平均每个请求执行时间
    27. Time per request:       248.646 [ms] (mean, across all concurrent requests)
    28.                                             # 所有并发请求，平均每个请求执行时间
    29. Transfer rate:          345.47 [Kbytes/sec] received       # 传输速率
    30.  
    31. Connection Times (ms)     # 连接耗时：连接、处理、响应等待
    32.               min  mean[+/-sd] median   max
    33. Connect:       96  154 137.2    120    1034
    34. Processing:    74   95  36.1     86     396
    35. Waiting:       26   63  38.6     58     372
    36. Total:        178  248 154.4    207    1125
    37.  
    38. Percentage of the requests served within a certain time (ms)
    39.                           # 请求执行时间分布
    40.   50%    207              # 50%的请求在207ms内执行完成
    41.   66%    218
    42.   75%    235
    43.   80%    245
    44.   90%    328
    45.   95%    467
    46.   98%   1117
    47.   99%   1125
    48.  100%   1125 (longest request)

                      

                               

                                     

    连接数优化

             

    *************

    连接数限制

             

    连接数超出系统限制，通常会报出如下错误：

    too many open files

                  

    用户连接数：临时操作

    1. # 查看当前用户描述符限制
    2. [root@7623085b4b89 /]# ulimit -n
    3. 1048576
    4.  
    5. # 临时修改限制，重启后失效
    6. [root@7623085b4b89 /]# ulimit -n 200000 
    7. [root@7623085b4b89 /]# ulimit -n       
    8. 200000

                 

    用户连接数：永久操作

    1. vi /etc/ssh/sshd_config， 添加如下内容：
    2. * hard nofile 102400
    3. * soft nofile 102400
    4. 保存后退出，重新登录，即可生效
    5.  
    6. # 相关说明
    7. *：表示所有用户
    8. nofile：最大文件打开数

                  

    系统连接数（所有用户连接数总和）：临时操作

    1. 设置连接数：sysctl -w fs.file-max=102400
    2. 查看连接数：sysctl fs.file-max
    3.  
    4.  
    5. # 示例
    6. [root@ab103f74b163 /]# sysctl -w fs.file-max=102400
    7. fs.file-max = 102400
    8. [root@ab103f74b163 /]# sysctl fs.file-max
    9. fs.file-max = 102400

                

    系统连接数：永久操作

    1. # 设置文件描述符术
    2. vi /etc/sysctl.conf
    3. ==> 添加 fs.file-max=102400
    4. 退出后，执行 ==>  sysctl -p
    5.  
    6. # 查看文件描述符数
    7. sysctl fs.file-max
    8. cat /proc/sys/fs/file-max
    9.  
    10.  
    11. # 示例
    12. [root@ab103f74b163 /]# sysctl -w fs.file-max=102400
    13. fs.file-max = 102400
    14. [root@ab103f74b163 /]# sysctl fs.file-max
    15. fs.file-max = 102400
    16. [root@ab103f74b163 /]# cat /proc/sys/fs/file-max
    17. 102400
    18.  
    19. [root@ab103f74b163 /]# vi /etc/sysctl.conf
    20. [root@ab103f74b163 /]# sysctl -p
    21. fs.file-max = 100000
    22.  
    23. [root@ab103f74b163 /]# cat /proc/sys/fs/file-max
    24. 100000
    25. [root@ab103f74b163 /]# sysctl fs.file-max
    26. fs.file-max = 100000

                

    *************

    openresty 设置

             

    nginx.conf

    1. worker_processes auto;          # 工作进程个数，on：根据cpu数自动确定
    2. wprker_rlimit_nofile 65535;     # 最多打开的文件数量
    3.  
    4. events {
    5.     worker_connections 65535;   # 每个工作进程可接受的连接数
    6.     multi_accept on;            # 是否允许一个工作进程响应多个请求
    7. }

              

    *************

    示例

             

    default.conf

    1. server {
    2.     listen       80;
    3.     server_name  localhost;
    4.  
    5.     location / {
    6.         root   /usr/local/openresty/nginx/html;
    7.         index  index.html index.htm;
    8.     }
    9.  
    10.     location /test {
    11.         echo $server_name $remote_addr;
    12.         echo "test";
    13.     }
    14.  
    15.     error_page   500 502 503 504  /50x.html;
    16.     location = /50x.html {
    17.         root   /usr/local/openresty/nginx/html;
    18.     }
    19.  
    20. }

                   

    nginx.conf

    1. ...
    2.  
    3. events {
    4.     worker_connections  1024;
    5. }
    6.  
    7. ...

                 

    创建openresty容器

    1. docker run -it -d --net fixed --ip 172.18.0.2 -p 9000:80 \
    2. -v /Users/huli/lua/openresty/conn/nginx.conf:/usr/local/openresty/nginx/conf/nginx.conf \
    3. -v /Users/huli/lua/openresty/conn/default.conf:/etc/nginx/conf.d/default.conf \
    4. --name open-conn lihu12344/openresty

           

    ab 测试：ab -n 2000 -c 1000 http://localhost:9000/test

    1. # 请求全部执行成功
    2. huli@hudeMacBook-Pro conn % ab -n 2000 -c 1000 http://localhost:9000/test
    3. This is ApacheBench, Version 2.3 <$Revision: 1879490 $>
    4. Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    5. Licensed to The Apache Software Foundation, http://www.apache.org/
    6.  
    7. Benchmarking localhost (be patient)
    8. Completed 200 requests
    9. Completed 400 requests
    10. Completed 600 requests
    11. Completed 800 requests
    12. Completed 1000 requests
    13. Completed 1200 requests
    14. Completed 1400 requests
    15. Completed 1600 requests
    16. Completed 1800 requests
    17. Completed 2000 requests
    18. Finished 2000 requests
    19.  
    20.  
    21. Server Software:        openresty/1.21.4.1
    22. Server Hostname:        localhost
    23. Server Port:            9000
    24.  
    25. Document Path:          /test
    26. Document Length:        31 bytes
    27.  
    28. Concurrency Level:      1000
    29. Time taken for tests:   1.760 seconds
    30. Complete requests:      2000               # 发送请求2000
    31. Failed requests:        0                  # 失败的请求数为0
    32. Total transferred:      348000 bytes
    33. HTML transferred:       62000 bytes
    34. Requests per second:    1136.21 [#/sec] (mean)
    35. Time per request:       880.123 [ms] (mean)
    36. Time per request:       0.880 [ms] (mean, across all concurrent requests)
    37. Transfer rate:          193.07 [Kbytes/sec] received
    38.  
    39. Connection Times (ms)
    40.               min  mean[+/-sd] median   max
    41. Connect:        0   20  13.0     19      51
    42. Processing:    53  719 479.1    437    1434
    43. Waiting:        5  695 471.5    413    1429
    44. Total:         56  739 471.4    459    1446
    45.  
    46. Percentage of the requests served within a certain time (ms)
    47.   50%    459
    48.   66%   1177
    49.   75%   1211
    50.   80%   1319
    51.   90%   1342
    52.   95%   1366
    53.   98%   1388
    54.   99%   1395
    55.  100%   1446 (longest request)

                

    ab 测试：ab -n 2000 -c 2000 http://localhost:9000/test

    1. # 部分请求执行失败
    2. huli@hudeMacBook-Pro conn % ab -n 2000 -c 2000 http://localhost:9000/test
    3. This is ApacheBench, Version 2.3 <$Revision: 1879490 $>
    4. Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    5. Licensed to The Apache Software Foundation, http://www.apache.org/
    6.  
    7. Benchmarking localhost (be patient)
    8. Completed 200 requests
    9. Completed 400 requests
    10. Completed 600 requests
    11. Completed 800 requests
    12. Completed 1000 requests
    13. Completed 1200 requests
    14. Completed 1400 requests
    15. Completed 1600 requests
    16. Completed 1800 requests
    17. Completed 2000 requests
    18. Finished 2000 requests
    19.  
    20.  
    21. Server Software:        openresty/1.21.4.1
    22. Server Hostname:        localhost
    23. Server Port:            9000
    24.  
    25. Document Path:          /test
    26. Document Length:        31 bytes
    27.  
    28. Concurrency Level:      2000
    29. Time taken for tests:   0.856 seconds
    30. Complete requests:      2000              # 发送请求2000
    31. Failed requests:        448               # 448个请求执行失败
    32.    (Connect: 0, Receive: 0, Length: 448, Exceptions: 0)
    33. Total transferred:      270048 bytes
    34. HTML transferred:       48112 bytes
    35. Requests per second:    2337.75 [#/sec] (mean)
    36. Time per request:       855.525 [ms] (mean)
    37. Time per request:       0.428 [ms] (mean, across all concurrent requests)
    38. Transfer rate:          308.25 [Kbytes/sec] received
    39.  
    40. Connection Times (ms)
    41.               min  mean[+/-sd] median   max
    42. Connect:        0   63  21.6     64     104
    43. Processing:   108  488 150.2    383     730
    44. Waiting:        0  401 254.8    378     724
    45. Total:        109  550 131.9    470     779
    46.  
    47. Percentage of the requests served within a certain time (ms)
    48.   50%    470
    49.   66%    646
    50.   75%    695
    51.   80%    710
    52.   90%    727
    53.   95%    744
    54.   98%    762
    55.   99%    764
    56.  100%    779 (longest request)

                

    nginx.conf：修改worker_connections = 2000，重启应用

    1. ...
    2.  
    3. events {
    4.     worker_connections  2000;
    5. }
    6.  
    7. ...

              

    ab 测试：ab -n 2000 -c 2000 http://localhost:9000/test

    1. # 修改worker_connections =2000后，请求全部执行成功
    2. huli@hudeMacBook-Pro conn % ab -n 2000 -c 2000 http://localhost:9000/test
    3. This is ApacheBench, Version 2.3 <$Revision: 1879490 $>
    4. Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    5. Licensed to The Apache Software Foundation, http://www.apache.org/
    6.  
    7. Benchmarking localhost (be patient)
    8. Completed 200 requests
    9. Completed 400 requests
    10. Completed 600 requests
    11. Completed 800 requests
    12. Completed 1000 requests
    13. Completed 1200 requests
    14. Completed 1400 requests
    15. Completed 1600 requests
    16. Completed 1800 requests
    17. Completed 2000 requests
    18. Finished 2000 requests
    19.  
    20.  
    21. Server Software:        openresty/1.21.4.1
    22. Server Hostname:        localhost
    23. Server Port:            9000
    24.  
    25. Document Path:          /test
    26. Document Length:        26 bytes
    27.  
    28. Concurrency Level:      2000
    29. Time taken for tests:   1.126 seconds
    30. Complete requests:      2000              # 请求发送数2000
    31. Failed requests:        0                 # 请求失败数为0
    32. Total transferred:      338000 bytes
    33. HTML transferred:       52000 bytes
    34. Requests per second:    1776.36 [#/sec] (mean)
    35. Time per request:       1125.901 [ms] (mean)
    36. Time per request:       0.563 [ms] (mean, across all concurrent requests)
    37. Transfer rate:          293.17 [Kbytes/sec] received
    38.  
    39. Connection Times (ms)
    40.               min  mean[+/-sd] median   max
    41. Connect:        0   69  25.4     72     112
    42. Processing:   117  607 216.5    586     993
    43. Waiting:        5  602 217.6    583     982
    44. Total:        118  676 199.1    672    1042
    45.  
    46. Percentage of the requests served within a certain time (ms)
    47.   50%    672
    48.   66%    788
    49.   75%    827
    50.   80%    875
    51.   90%    969
    52.   95%    991
    53.   98%   1002
    54.   99%   1013
    55.  100%   1042 (longest request)

                  

                       

                                     

    客户端限制

             

    限制同一个ip并发数

    1. # 同一个ip地址限制10个并发连接
    2. http {
    3.     limit_conn_zone $binary_remote_addr zone=perip:10m;
    4.     limit_conn perip 10;
    5. }
    6.  
    7. # 相关说明
    8. limit_conn_zone：开辟一块内存空间保存客户端ip，空间名称perip，空间大小10m
    9. limit_conn：限制客户端请求数
    10. $binary_remote_addr：以二进制形式保存客户端ip
    11.  
    12. limit_conn_zone、limit_conn也可设置在server、location中，实现不同级别的并发控制

               

    限制虚拟主机的并发数

    1. # 对虚拟主机限制10个并发连接
    2. http {
    3.     limit_conn_zone $server_name zone=perserver:10m;
    4.  
    5.     server {
    6.         listen 80;
    7.         server_name localhost;
    8.  
    9.         limit_conn perserver 10;
    10.     }
    11. }
    12.  
    13. # 相关说明
    14. limit_conn_zone：开辟一块内存空间保存虚拟主机，空间名称perserver，空间大小10m
    15. limit_conn：限制客户端请求数
    16. $server_name：获取虚拟主机

                 

    限制响应的传输速率

    1. # 限制响应传输速率
    2. http {
    3.     limit_rate 100k;
    4.     limit_rate_after 10m;
    5.  
    6.     ...
    7. }
    8.  
    9. # 相关说明
    10. limit_rate：限制传输速率为100kb/s
    11. limit_rate_after：如果设置了该指令，表示传输制定数据量（10m）后，开始限速
    12.                   如果没有设置，则一开始就会进行限速

                 

                     

                                     

    浏览器缓存

             

    nginx 缓存响应头

    1. Last_Modified：nginx自动生成
    2. ETag：nginx自动生成
    3.  
    4. Cache-Control：缓存控制响应头
    5. * Cache-Control:max-age=N   ==> 缓存有效期N秒
    6. * Cache-Control:no-cache    ==> 本地保存缓存，如果没有更新使用本地缓存（304）；
    7.                                 如果有更新，去服务器获取最新的数据（200），并更新本地缓存
    8. * Cache-Control:no-store    ==> 不存储缓存，每次请求都会访问服务器
    9. * Cache-Control:max-age=N,must-revalidate
    10.                             ==> 缓存有效期N秒，过期前直接使用本地缓存
    11.                                 过期后，如果没有更新，直接使用本地缓存（304）
    12.                                 过期后，如果有更新，获取最新数据（200），并更新本地缓存
    13.  
    14. Expires：缓存过期时间

              

    expires 指令设置缓存有效期

    1. server {
    2.  
    3.     ...
    4.  
    5.     location \.(gif|jpg|jpeg|png|bmp|swf)$ {
    6.  
    7.         ...
    8.  
    9.         expires 10d;
    10.     }
    11.  
    12.     location \.(css|js)$ {
    13.  
    14.         ...
    15.  
    16.         expires 12h;
    17.     }
    18. }
    19.  
    20.  
    21. # 相关说明
    22. 即使mginx没有设置expires，浏览器也会自动缓存常见的静态资源（根据拓展名识别静态资源）；
    23. 使用expires可控制浏览器缓存的有效时间
    24. 当浏览器需要更新静态资源时，可设置动态路径（*css?arg=random_int）更新资源

              

                     

  • 相关阅读:
    无胁科技-TVD每日漏洞情报-2022-8-11
    【多线程】线程安全问题
    PyTorch安装与配置教程（2022.11）
    能ping通，TCP就一定能连通吗？
    Miniconda简单操作说明
    java计算机毕业设计摄影网站源码+系统+数据库+lw文档+mybatis+运行部署
    Linux线程基础
    什么是视频内容推荐引擎？
    yolo各模块详解
    毕设 C2C网上拍卖系统论文
  • 原文地址：https://blog.csdn.net/weixin_43931625/article/details/126057578