Keepalived+Nginx+Tomcat+Redis搭建高可用服务
时间:2020-06-17 11:45 来源:linux.it.net.cn 作者:IT
Keepalived+Nginx+Tomcat+Redis搭建高可用服务
Keepalived作用是检测服务器的状态，Nginx的作用是负载均衡，Tomcat提供web应用，redis提供session共享。
一、环境条件
名称 IP 端口 系统 版本 备注
Keepalived+Nginx 192.168.10.176 8080 Centos6.10 Keepalived v1.2.13+nginx/1.18.0 MASTER
Keepalived+Nginx 192.168.10.177 8080 Centos6.10 Keepalived v1.2.13+nginx/1.18.0 BACKUP
Tomcat+Redis 192.168.10.178 8086/6379 Centos6.10 Tomcat/7.0.53+Redis v3.2.12 Web Server1
Tomcat+Redis 192.168.10.179 8086/6379 Centos6.10 Tomcat/7.0.53+Redis v3.2.12 Web Server2
VIP 192.168.10.110 8080 Centos6.10 虚拟飘移IP
服务器ssh免密码登录配置
ssh-keygen
ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.176
ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.177
ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.178
ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.179
二、Tomcat服务器配置
1.JDK安装
安装jdk、查看jdk版本
[root@server1 ~]# yum -y install java-1.7.0-openjdk
[root@server1 ~]# java -version
2.SERVER1服务器配置
Tomcat部署比较简单，修改端口启动可以正常访问，开放WEB端口，修改server.xml如下
vim conf/server.xml
# 多个Tomcat在同台服务器上需要修改
<Server port="8005" shutdown="SHUTDOWN">
# 修改访问端口
<Connector port="8086" protocol="HTTP/1.1"
connectionTimeout="20000"
redirectPort="8443" />
# 多个Tomcat在同台服务器上需要修改
<Connector port="8009" protocol="AJP/1.3" redirectPort="8443" />
# 配置Engine节点的路由信息，session复制和负载均衡需要用
# 添加jvmRoute="Tomcat01"、每个tomcat都需要修改
<Engine name="Catalina" defaultHost="localhost" jvmRoute="Tomcat01">
# 去掉Cluster注释
<Cluster className="org.apache.catalina.ha.tcp.SimpleTcpCluster"/>
在访问的项目index.jsp页面加上以下代码
<% HttpSession session = request.getSession(); %>
<%= session.getId() %>
3.SERVER2服务器配置
将配置好的tomcat发送到server2，修改jvmRoute=“Tomcat02”
[root@server1 home]# scp -r apache-tomcat-7.0.53 192.168.3.179:/home/
Tomcat没有重启命令，每次修改后还需要关闭再启动，太麻烦，我将关闭和启动整合一下，变成重启，下面是重启脚本，将脚本保存到tomcat/bin/目录，重启直接执行./restart.sh
#!/bin/bash
# -*- coding: UTF-8 -*-
# Filename: restart.sh
# Description: 用于Tomcat重新启动
# Author: SERE
LOGSDIR=../logs
./shutdown.sh &> /dev/null
echo -e "\033[32mINFO: Tomcat close to finish\033[0m"
echo -e "\033[32mINFO: Now restart tomcat\033[0m"
nohup ./startup.sh &> /dev/null
sleep 1
tail -f $LOGSDIR/catalina.out
4.测试web应用
分别启动tomcat进行访问
三、Nginx服务器配置
1.Nginx安装
Nginx yum 源地址：
http://nginx.org/packages/centos/
[root@master ~]# yum -y install nginx
# nginx -t ：测试配置文件是否有语法错误
[root@master ~]# nginx -v
2.Master服务器配置
Nginx转发配置
[root@master ~]# vim /etc/nginx/conf.d/cluster.conf
upstream application {
server 192.168.10.178:8086 weight=1;
server 192.168.10.179:8086 weight=1;
}
server {
listen 8080;
# BACKUP改为：192.168.10.177
server_name 192.168.10.176;
location / {
root /var/www/html;
index index.php index.html index.htm;
proxy_pass http://application;
}
}
测试配置文件是否有语法错误
[root@master ~]# nginx -t
[root@master ~]# service nginx restart
测试负载nginx转发web应用
http://192.168.3.176:8080/application/
3.Backup服务器配置
将nginx转发配置文件发送到backup服务器
[root@master ~]# scp -r /etc/yum.repos.d/nginx.repo 192.168.10.177:/etc/yum.repos.d/
[root@master ~]# scp -r /etc/nginx/conf.d/cluster.conf 192.168.10.177:/etc/nginx/conf.d/
[root@backup ~]# nginx -t
[root@backup ~]# service nginx restart
4.测试负载nginx转发web应用
http://192.168.10.177:8080/application/
四、Redis服务器配置
1.Redis安装
上传jar包到tomcat/lib/目录
[root@server1 ~]# yum -y install redis
下载地址：
https://github.com/jcoleman/tomcat-redis-session-manager
https://download.csdn.net/download/SERE0211/12527300
找不到私信我
commons-pool2-2.2
jedis-2.5.2
tomcat-redis-session-manager-2.0.0
2.SERVER1服务器配置
将jar发送server2服务器
[root@server1 lib]# scp -r commons-pool2-2.2.jar jedis-2.5.2.jar tomcat-redis-session-manager-2.0.0.jar 192.168.10.179:/home/tomcat/lib/
修改conf/context.xml
[root@server1 lib]# vim ../conf/context.xml
# 添加以下内容
<WatchedResource>WEB-INF/web.xml</WatchedResource>
<WatchedResource>${catalina.base}/conf/web.xml</WatchedResource>
<Valve className="com.orangefunction.tomcat.redissessions.RedisSessionHandlerValve" />
<Manager className="com.orangefunction.tomcat.redissessions.RedisSessionManager"
host="localhost"
port="6379"
database="0"
maxInactiveInterval="60"/>
# 一般是从23行开始添加
修改完成重启
[root@server1 ~]# service redis restart
3.SERVER2服务器配置
将context.xml发送server2服务器
[root@server1 bin]# scp ../conf/context.xml 192.168.10.179:/home/apache-tomcat-7.0.53/conf/
# 重启tomcat，redis也需要启动，否则访问报错
[root@server2 ~]# service redis restart
五、Keepalived服务器配置
1.Keepalived安装
[root@master ~]# yum -y install keepalived
2.Master服务器配置
[root@master ~]# vim /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
router_id hostname #机器标识
}
vrrp_instance VI_1 {
state MASTER #主备状态
interface eth0 #监听网卡
virtual_router_id 51 #虚拟路由id
mcast_src_ip 192.168.10.176 #本机IP地址
priority 100 #权重
nopreempt #设置不抢占
advert_int 1 #同步检查时间设置
authentication { #认证配置
auth_type PASS #认证方式
auth_pass 1111 #认证密码
}
track_script {
chk_nginx #执行Nginx监控的服务#
}
virtual_ipaddress { #虚拟IP
192.168.10.110 #虚拟IP池MASTER&&BACKUP, 两个设置必须一样，虚拟ip，可以定义多个
}
}
将master配置好的keepalived.conf发送到backup服务器
[root@master ~] service keepalived restart
[root@master ~] scp /etc/keepalived/keepalived.conf 192.168.10.177:/etc/keepalived/keepalived.conf
1
2
3.Backup服务器配置
[root@master ~]# vim /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
router_id backup #机器标识
}
vrrp_instance VI_1 {
state MASTER #主备状态
interface eth0 #监听网卡
virtual_router_id 51 #虚拟路由id
mcast_src_ip 192.168.10.177 #本机IP地址
priority 100 #权重
nopreempt #设置不抢占
advert_int 1 #同步检查时间设置
authentication { #认证配置
auth_type PASS #认证方式
auth_pass 1111 #认证密码
}
track_script {
chk_nginx #执行Nginx监控的服务#
}
virtual_ipaddress { #虚拟IP
192.168.10.110 #虚拟IP池MASTER&&BACKUP, 两个设置必须一样，虚拟ip，可以定义多个
}
}
# 我将（# priority 100）master和backup设置的是一样的，当一个节点故障，另个节点自动变成主节点
4.测试高可用服务
http://192.168.10.110:8080/application
常用命令：
查看本地IP地址：ip addr
五.参考文档
nginx官网：
https://nginx.org/
redis官网：
https://redis.io/
keepalived官网：
https://www.keepalived.org/
(责任编辑：IT)
| Keepalived+Nginx+Tomcat+Redis搭建高可用服务 Keepalived作用是检测服务器的状态，Nginx的作用是负载均衡，Tomcat提供web应用，redis提供session共享。 一、环境条件 名称 IP 端口 系统 版本 备注 Keepalived+Nginx 192.168.10.176 8080 Centos6.10 Keepalived v1.2.13+nginx/1.18.0 MASTER Keepalived+Nginx 192.168.10.177 8080 Centos6.10 Keepalived v1.2.13+nginx/1.18.0 BACKUP Tomcat+Redis 192.168.10.178 8086/6379 Centos6.10 Tomcat/7.0.53+Redis v3.2.12 Web Server1 Tomcat+Redis 192.168.10.179 8086/6379 Centos6.10 Tomcat/7.0.53+Redis v3.2.12 Web Server2 VIP 192.168.10.110 8080 Centos6.10 虚拟飘移IP 服务器ssh免密码登录配置 ssh-keygen ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.176 ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.177 ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.178 ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.179 二、Tomcat服务器配置 1.JDK安装 安装jdk、查看jdk版本 [root@server1 ~]# yum -y install java-1.7.0-openjdk [root@server1 ~]# java -version 2.SERVER1服务器配置 Tomcat部署比较简单，修改端口启动可以正常访问，开放WEB端口，修改server.xml如下 vim conf/server.xml # 多个Tomcat在同台服务器上需要修改 <Server port="8005" shutdown="SHUTDOWN"> # 修改访问端口 <Connector port="8086" protocol="HTTP/1.1" connectionTimeout="20000" redirectPort="8443" /> # 多个Tomcat在同台服务器上需要修改 <Connector port="8009" protocol="AJP/1.3" redirectPort="8443" /> # 配置Engine节点的路由信息，session复制和负载均衡需要用 # 添加jvmRoute="Tomcat01"、每个tomcat都需要修改 <Engine name="Catalina" defaultHost="localhost" jvmRoute="Tomcat01"> # 去掉Cluster注释 <Cluster className="org.apache.catalina.ha.tcp.SimpleTcpCluster"/> 在访问的项目index.jsp页面加上以下代码 <% HttpSession session = request.getSession(); %> <%= session.getId() %> 3.SERVER2服务器配置 将配置好的tomcat发送到server2，修改jvmRoute=“Tomcat02” [root@server1 home]# scp -r apache-tomcat-7.0.53 192.168.3.179:/home/ Tomcat没有重启命令，每次修改后还需要关闭再启动，太麻烦，我将关闭和启动整合一下，变成重启，下面是重启脚本，将脚本保存到tomcat/bin/目录，重启直接执行./restart.sh #!/bin/bash # -*- coding: UTF-8 -*- # Filename: restart.sh # Description: 用于Tomcat重新启动 # Author: SERE LOGSDIR=../logs ./shutdown.sh &> /dev/null echo -e "\033[32mINFO: Tomcat close to finish\033[0m" echo -e "\033[32mINFO: Now restart tomcat\033[0m" nohup ./startup.sh &> /dev/null sleep 1 tail -f $LOGSDIR/catalina.out 4.测试web应用 分别启动tomcat进行访问 三、Nginx服务器配置 1.Nginx安装 Nginx yum 源地址： http://nginx.org/packages/centos/ [root@master ~]# yum -y install nginx # nginx -t ：测试配置文件是否有语法错误 [root@master ~]# nginx -v 2.Master服务器配置 Nginx转发配置 [root@master ~]# vim /etc/nginx/conf.d/cluster.conf upstream application { server 192.168.10.178:8086 weight=1; server 192.168.10.179:8086 weight=1; } server { listen 8080; # BACKUP改为：192.168.10.177 server_name 192.168.10.176; location / { root /var/www/html; index index.php index.html index.htm; proxy_pass http://application; } } 测试配置文件是否有语法错误 [root@master ~]# nginx -t [root@master ~]# service nginx restart 测试负载nginx转发web应用 http://192.168.3.176:8080/application/ 3.Backup服务器配置 将nginx转发配置文件发送到backup服务器 [root@master ~]# scp -r /etc/yum.repos.d/nginx.repo 192.168.10.177:/etc/yum.repos.d/ [root@master ~]# scp -r /etc/nginx/conf.d/cluster.conf 192.168.10.177:/etc/nginx/conf.d/ [root@backup ~]# nginx -t [root@backup ~]# service nginx restart 4.测试负载nginx转发web应用 http://192.168.10.177:8080/application/ 四、Redis服务器配置 1.Redis安装 上传jar包到tomcat/lib/目录 [root@server1 ~]# yum -y install redis 下载地址： https://github.com/jcoleman/tomcat-redis-session-manager https://download.csdn.net/download/SERE0211/12527300 找不到私信我 commons-pool2-2.2 jedis-2.5.2 tomcat-redis-session-manager-2.0.0 2.SERVER1服务器配置 将jar发送server2服务器 [root@server1 lib]# scp -r commons-pool2-2.2.jar jedis-2.5.2.jar tomcat-redis-session-manager-2.0.0.jar 192.168.10.179:/home/tomcat/lib/ 修改conf/context.xml [root@server1 lib]# vim ../conf/context.xml # 添加以下内容 <WatchedResource>WEB-INF/web.xml</WatchedResource> <WatchedResource>${catalina.base}/conf/web.xml</WatchedResource> <Valve className="com.orangefunction.tomcat.redissessions.RedisSessionHandlerValve" /> <Manager className="com.orangefunction.tomcat.redissessions.RedisSessionManager" host="localhost" port="6379" database="0" maxInactiveInterval="60"/> # 一般是从23行开始添加 修改完成重启 [root@server1 ~]# service redis restart 3.SERVER2服务器配置 将context.xml发送server2服务器 [root@server1 bin]# scp ../conf/context.xml 192.168.10.179:/home/apache-tomcat-7.0.53/conf/ # 重启tomcat，redis也需要启动，否则访问报错 [root@server2 ~]# service redis restart 五、Keepalived服务器配置 1.Keepalived安装 [root@master ~]# yum -y install keepalived 2.Master服务器配置 [root@master ~]# vim /etc/keepalived/keepalived.conf ! Configuration File for keepalived global_defs { router_id hostname #机器标识 } vrrp_instance VI_1 { state MASTER #主备状态 interface eth0 #监听网卡 virtual_router_id 51 #虚拟路由id mcast_src_ip 192.168.10.176 #本机IP地址 priority 100 #权重 nopreempt #设置不抢占 advert_int 1 #同步检查时间设置 authentication { #认证配置 auth_type PASS #认证方式 auth_pass 1111 #认证密码 } track_script { chk_nginx #执行Nginx监控的服务# } virtual_ipaddress { #虚拟IP 192.168.10.110 #虚拟IP池MASTER&&BACKUP, 两个设置必须一样，虚拟ip，可以定义多个 } } 将master配置好的keepalived.conf发送到backup服务器 [root@master ~] service keepalived restart [root@master ~] scp /etc/keepalived/keepalived.conf 192.168.10.177:/etc/keepalived/keepalived.conf 1 2 3.Backup服务器配置 [root@master ~]# vim /etc/keepalived/keepalived.conf ! Configuration File for keepalived global_defs { router_id backup #机器标识 } vrrp_instance VI_1 { state MASTER #主备状态 interface eth0 #监听网卡 virtual_router_id 51 #虚拟路由id mcast_src_ip 192.168.10.177 #本机IP地址 priority 100 #权重 nopreempt #设置不抢占 advert_int 1 #同步检查时间设置 authentication { #认证配置 auth_type PASS #认证方式 auth_pass 1111 #认证密码 } track_script { chk_nginx #执行Nginx监控的服务# } virtual_ipaddress { #虚拟IP 192.168.10.110 #虚拟IP池MASTER&&BACKUP, 两个设置必须一样，虚拟ip，可以定义多个 } } # 我将（# priority 100）master和backup设置的是一样的，当一个节点故障，另个节点自动变成主节点 4.测试高可用服务 http://192.168.10.110:8080/application 常用命令： 查看本地IP地址：ip addr 五.参考文档 nginx官网： https://nginx.org/ redis官网： https://redis.io/ keepalived官网： https://www.keepalived.org/ (责任编辑：IT) |