> Linux服务器 > nginx >

搭建awstats分析nginx日志

时间:2014-12-12 01:52  来源:linux.it.net.cn   作者:IT网

 用awstats来分析nginx日志,会让运维感觉很直观,也很方便的知道每天有多少pv,用户对那些页面访问得比较多,这样也容易有针对性的去优化web服务器.下面我们来看看怎么安装.
  系统:centos 5.x
  需要的软件包:awstats-7.3.tar.gz

1.修改nginx日志格式
vi /etc/nginx/nginx.conf
 
1 log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
2                   '$status $body_bytes_sent "$http_referer" '
3                   '"$http_user_agent" "$http_x_forwarded_for" "$request_time"';


 
1 access_log  /var/log/www/access.log  main;


ps:
把log_format这段代码放在你nginx的http的定义段中,可以在下面的每一个server中引用此格式,不必在每个server里面都去定义格式.

2.切割nginx日志脚本
vi cut_log.sh
 
01 #!/bin/bash
02 export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin
03 logs_path="/var/log/www/"
04 date_dir=${logs_path}$(date -d "yesterday" +"%Y")/$(date -d "yesterday" +"%m")/$(date -d "yesterday" +"%d")/
05 gzip_date_dir=${logs_path}$(date -d "-2 day" +"%Y")/$(date -d "-2 day" +"%m")/$(date -d "-2 day" +"%d")/
06   
07 mkdir -p $date_dir
08 mv ${logs_path}*access.log $date_dir
09 /usr/sbin/nginx -s reopen
10 /usr/bin/gzip ${gzip_date_dir}*.log


然后丢到crontab里,每天晚上11点57分执行切割:
57 23 * * * /bin/sh /root/webbak/cut_log.sh

3.安装awstats
wget http://awstats.sourceforge.net/files/awstats-7.3.tar.gz
tar zxf awstats-7.3.tar.gz && mv awstats-7.3 /usr/local/awstats
chown -R root:root /usr/local/awstats
chmod -R =rwX /usr/local/awstats
chmod +x /usr/local/awstats/tools/*.pl
chmod +x /usr/local/awstats/wwwroot/cgi-bin/*.pl

执行 tools 目录中的 awstats_configure.pl 配置向导,创建一个新的统计:
cd /usr/local/awstats/tools
./awstats_configure.pl

将会有如下一些提示：
 
01 -----> Running OS detected: Linux, BSD orUnix
02  
03 ----->Check for web server install
04 Enterfull config file path of your Web server.
05 Example:/etc/httpd/httpd.conf
06 Example:/usr/local/apache2/conf/httpd.conf
07 Example:c:\Program files\apache group\apache\conf\httpd.conf Config file path ('none' to skip web server setup):
08 >none #这里添none并回车,因为我们没有使用apache
09 回车之后下一个选项：
10 Yourweb server config file(s) could not be found.
11 Youwill need to setup your web server manually to declare AWStats
12 script as a CGI, if you want tobuild reports dynamically. See AWStats setup documentation (file docs/index.html)
13 ----->Update model config file '/usr/local/awstats/wwwroot/cgi-bin/awstats.model.conf' File awstats.model.conf updated.
14  
15 ----->Need to create a new config file ? Do you want me to build anew AWStats config/profilefile (required if first install) [y/N] ? y #这里选Y,创建一个新的配置文件
16  
17 -----> Define config file name to create
18 What is the name of your web site or profile analysis ?
19 Example: www.mysite.com
20 Example: demo
21 Yourweb site, virtual server or profile name:
22 >blog.slogra.com #这里输入你要分析的域名,或是随便一个你易记的配置名并回车
23  
24 ----->Define config file path In which directory do you plan to store your config file(s) ?
25 Default: /etc/awstats
26 Directorypath to store config file(s) (Enter fordefault):
27 > #直接回车,定义你的配置文件存放的路径,使用默认路径/etc/awstats
28  
29 ----->Create config file '/etc/awstats/awstats.nginx.conf'
30 Configfile /etc/awstats/awstats.nginx.conf created.
31 -----> Add updateprocess inside a scheduler Sorry, configure.pl does not support automatic addto cron yet.
32 You can do it manually by adding the following command to yourcron: /usr/local/awstats/wwwroot/cgi-bin/awstats.pl -update -config=nginx
33 Or if you have several config files and prefer having only onecommand: /usr/local/awstats/tools/awstats_updateall.pl now
34 Press ENTER to continue...#按回车继续
35 A SIMPLE config file has been created: /etc/awstats/awstats.nginx.conf You should have a lookinside to check and change manually main parameters.
36 Youcan then manually update your statistics for'yuyuanchun.com' withcommand: > perl awstats.pl -update -config=nginx
37 Youcan also build static report pages for'nginx' with command:> perl awstats.pl -output=pagetype -config=nginx
38 PressENTER to finish... #回车完成配置文件的创建


完成配置文件的创建后,我们还要修改一下.因为我是按天切割的日志,切割完成后交由awstats去分析.并不是让awstats去分时正在时时增长的也就是正在被写入的日志,这样的好处是不至于遗漏数据,并且分析已经切割完成的日志,更不用担心会有冲突.坏处是我一天切割一次日志,你要等第二天才能看昨天的一些详细数据.

vi /etc/awstats/awstats.blog.slogra.com.conf
把LogFile="/var/log/httpd/mylog.log"
修改为:
LogFile="/var/log/www/%YYYY-24/%MM-24/%DD-24/access.log"
以上的完整路径是切割后保存的nginx日志文件.其中%YYYY-24/%MM-24/%DD-24表示年月日都减去24小时,也就是昨天的日志目录.

4.创建awstats用于记录数据的目录
mkdir -p /var/lib/awstats

5.创建存放awstats生成的静态文件的目录
mkdir -p /var/www/vhosts/blog.slogra.com/awstats/blog.slogra.com

当然也可以用脚本来实现:
vi awstats.sh
 
1 #!/bin/bash
2 export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin
3 mkdir -p /var/www/vhosts/blog.slogra.com/awstats/blog.slogra.com
4 /usr/local/awstats/tools/awstats_buildstaticpages.pl -update  \
5 -config=blog.slogra.com -lang=cn -dir=/var/www/vhosts/blog.slogra.com/awstats/blog.slogra.com  \
6 -awstatsprog=/usr/local/awstats/wwwroot/cgi-bin/awstats.pl


ps:
/usr/local/awstats/tools/awstats_buildstaticpages.pl    Awstats 静态页面生成工具
-update -config=blog.slogra.com     更新配置项
-lang=cn     语言为中文
-dir=/var/www/vhosts/blog.slogra.com/awstats/blog.slogra.com    统计结果输出目录
-awstatsprog=/usr/local/awstats/wwwroot/cgi-bin/awstats.pl    Awstats 日志更新程序路径

然后把awstat.sh也丢到crontab里执行:
59 23 * * * /bin/sh /root/webbak/awstats.sh

最后手动执行下awstats.sh
./awstats.sh
如果你看到它生成了一堆网页,那就说明成功了.

6.修改nginx配置
 
01 server {
02         listen       80;
03         server_name blog.slogra.com;
04         access_log  /var/log/www/access.log  main;
05         root /var/www/vhosts/blog.slogra.com;
06         index index.php index.html index.htm;
07  
08         location ~ ^/awstats/ {
09                 root /var/www/vhosts/blog.slogra.com/;
10                 autoindex on;
11                 index index.html;
12                 access_log off;
13                 auth_basic "Please enter your password:";
14                 auth_basic_user_file /var/www/vhosts/htpasswd;
15                 }
16  
17         location ~ ^/icon/ {
18                 root   /usr/local/awstats/wwwroot;
19                 index  index.html;
20                 access_log off;
21                 }
22 }


然后重启nginx,当然我加了身份认证的,只让自己可以看,保证安全性.好了,awstats的安装配置就到这里了.剩下的就是等生成数据.
ps:本文参考了下面两位的文章而来的.
http://www.wkii.org/use-awstats-automatic-analysis-nginx-log.html
http://lxw66.blog.51cto.com/5547576/1323712
(责任编辑：IT)
    最近关注
    热点内容