ip访问次数统计nginx_Linux分析Nginx日志统计IP访问次数的shell脚本

平时运维遇到最多的就是nginx的日志分析了&＃xff0c;要时常做系统监控&＃xff0c;检查IP的访问次数是否有异常&＃xff0c;防止恶意访问。

假设我的nginx日志如下&＃xff1a;

.......

211.253.43.23 - - [03/Jun/2019:11:41:02 &＃43;0800] "GET

211.253.43.23 - - [03/Jun/2019:11:41:25 &＃43;0800] "POST

211.253.43.23 - - [03/Jun/2019:11:41:25 &＃43;0800] "GET

211.253.43.23 - - [03/Jun/2019:11:41:26 &＃43;0800] "GET

39.100.41.229 - - [03/Jun/2019:11:41:56 &＃43;0800] "GET

39.100.41.229 - - [03/Jun/2019:11:41:56 &＃43;0800] "GET

211.253.43.23 - - [03/Jun/2019:11:41:56 &＃43;0800] "POST

211.253.43.23 - - [03/Jun/2019:11:41:57 &＃43;0800] "GET

39.100.41.229 - - [03/Jun/2019:11:42:00 &＃43;0800] "POST

211.253.43.23 - - [03/Jun/2019:11:42:00 &＃43;0800] "GET

211.253.43.23 - - [03/Jun/2019:11:42:08 &＃43;0800] "POST

211.253.43.23 - - [03/Jun/2019:11:42:11 &＃43;0800] "GET

211.253.43.23 - - [03/Jun/2019:11:42:11 &＃43;0800] "GET

211.253.43.23 - - [03/Jun/2019:11:42:12 &＃43;0800] "GET

......

下面是各种统计访问次数的shell代码&＃xff1a;

1.2019年8月6日期间访问次数最多的7个IP&＃xff1a;

[root&＃64;hostname ~]# cat nginx.log | grep &＃39;03/Jun/2019&＃39; | awk &＃39;{print $1}&＃39;| sort | uniq -c | sort -k 1 -nr | head -7

2597 211.253.43.23

64 39.100.41.229

19 118.112.56.37

15 223.72.99.60

10 118.112.58.225

9 182.148.58.232

6 116.236.146.22

#

2.2019年8月6日期间访问次数大于等于10次的所有IP地址&＃xff1a;

[root&＃64;hostname ~]# cat nginx.log | grep &＃39;03/Jun/2019&＃39; | awk &＃39;{print $1}&＃39;| sort | uniq -c | awk &＃39;{if ($1 > 10) print $2}&＃39; | sort -nr

223.72.99.60

211.253.43.23

118.112.56.37

39.100.41.229

3.日志文件中访问次数最多的10个请求(日志每行GET后面的内容)例如 /s?defs&＃61;ascii&project&＃61;linux-3.18.6&＃xff0c;注意不允许有空行&＃xff0c;不包含 /robots.txt&＃xff0c;.js&＃xff0c;.css&＃xff0c;*.png 这类静态文件、图片等访问。

[root&＃64;hostname ~]# cat nginx.log | grep "GET" | grep -Ev &＃39;txt|js|png|css &＃39; | awk &＃39;{ print $7}&＃39;| sort | uniq -c | sort -k 1 -n -r | head -11 | awk &＃39;NR>1 {print $2}&＃39; >output3.txt

**暂无数据**

4.日志文件中访问状态为 404 的所有访问请求地址&＃xff1a;

[root&＃64;hostname ~]# cat nginx.log | grep "404" | grep -Ev &＃39;txt|js|png|css &＃39; | awk &＃39;{print $7}&＃39; | sort | uniq -c |awk &＃39;{print $2}&＃39; >output4.txt

**暂无数据**