colben/www.colben.cn
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

update

Browse Source
This commit is contained in:
colben
2021-11-14 14:32:08 +08:00
parent f75ad8bedd
commit b0f6120151
152 changed files with 22219 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

358
content/post/redis-cluster-install.md Normal file
View File

@@ -0,0 +1,358 @@
---
title: "CentOS7 安装 Redis 集群"
date: 2019-11-29T15:14:29+08:00
lastmod: 2019-11-29T15:14:29+08:00
tags: ["redis"]
categories: ["database"]
---
# 环境
- 操作系统: CentOS7.7，关闭 firewalld 和 selinux
- Redis: 5.0.6
- master 实例
- 10.0.4.110:6371
- 10.0.4.110:6372
- 10.0.4.110:6373
- slave 实例
- 10.0.4.111:6371
- 10.0.4.111:6372
- 10.0.4.111:6373
# 编译 redis server
- 在 CentOS7.7 测试服务器上下载、编译
```bash
wget http://download.redis.io/releases/redis-5.0.6.tar.gz
tar xzf redis-5.0.6.tar.gz
cd redis-5.0.6
make
```
- 抽取安装文件
```bash
mkdir -p /opt/redis_cluster/{bin,conf}
cp src/{redis-server,redis-cli,redis-benchmark} /opt/redis_cluster/bin/
# redis-check-rdb 和 redis-check-aof 与 redis-server 校验值一致，无需复制
```
- 创建 /opt/redis_cluster/conf/redis.conf，常用配置如下
```bash
bind 0.0.0.0
protected-mode yes
tcp-backlog 511
timeout 3600
tcp-keepalive 300
daemonize no
supervised no
loglevel notice
always-show-logo no
save 900 1
save 300 10
save 60 10000
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump.rdb
#masterauth "123456"
replica-serve-stale-data yes
replica-read-only yes
repl-diskless-sync no
repl-diskless-sync-delay 5
repl-disable-tcp-nodelay no
replica-priority 100
#requirepass "123456"
maxclients 10000
maxmemory 4294967296
maxmemory-policy volatile-lru
lazyfree-lazy-eviction no
lazyfree-lazy-expire no
lazyfree-lazy-server-del no
replica-lazy-flush no
appendonly no
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
aof-load-truncated yes
aof-use-rdb-preamble yes
lua-time-limit 5000
cluster-enabled yes
cluster-node-timeout 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
latency-monitor-threshold 0
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-size -2
list-compress-depth 0
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
hll-sparse-max-bytes 3000
stream-node-max-bytes 4096
stream-node-max-entries 100
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit replica 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
dynamic-hz yes
aof-rewrite-incremental-fsync yes
rdb-save-incremental-fsync yes
```
- 创建 /opt/redis_cluster/redis@.service，配置如下
```ini
[Unit]
Description=Redis cluster -- node %i
After=network.target
[Service]
ExecStartPre=/usr/bin/ls -d /var/lib/redis_cluster/%i
ExecStart=/opt/redis_cluster/bin/redis-server /opt/redis_cluster/conf/redis.conf \
--daemonize no \
--port %i \
--pidfile /var/run/redis_%i.pid \
--logfile /var/log/redis_cluster/%i.log \
--dir /var/lib/redis_cluster/%i \
--cluster-config-file /var/lib/redis_cluster/%i/nodes.conf
ExecStop=/opt/redis_cluster/bin/redis-cli -h 127.0.0.1 -p %i shutdown
Restart=on-failure
RestartSec=1
[Install]
WantedBy=multi-user.target
```
# 部署
- 把测试机的 /opt/redis_cluster 目录复制到 10.0.4.110 和 10.0.4.111 上
```bash
scp -r /opt/redis_cluster 10.0.4.110:/opt/
scp -r /opt/redis_cluster 10.0.4.111:/opt/
```
- 在 10.0.4.110 和 10.0.4.111 上都执行以下操作
```bash
mv /opt/redis_cluster/redis@.service /usr/lib/systemd/system/
systemctl daemon-reload
mkdir -p /var/lib/redis_cluster/{6371..6373}
mkdir -p /var/log/redis_cluster
```
- 在 10.0.4.110 和 10.0.4.111 上配置实例开机启动
```bash
systemctl enable redis@6371
systemctl enable redis@6372
systemctl enable redis@6373
```
- 在 10.0.4.110 和 10.0.4.111 上启动全部实例
```bash
systemctl start redis@6371
systemctl start redis@6372
systemctl start redis@6373
```
# 配置集群
- 在 10.0.4.110 或 10.0.4.111 上创建集群，指定三个 master 实例
```bash
/opt/redis_cluster/bin/redis-cli \
--cluster create 10.0.4.110:6371 10.0.4.110:6372 10.0.4.110:6373
```
- 输出如下图
![](https://colben.cn/img/dc44a6e8688218edb10ad7f2427b0525132.png)
- 同意配置，输入 "yes"，回车后输出如下图
![](https://colben.cn/img/eb3c0ccd3d0017c18d4eba3a0b776d29e21.png)
- 查看集群当前实例
```bash
/opt/redis_cluster/bin/redis-cli -p 6371 cluster nodes
```
- 输出如下图
![](https://colben.cn/img/0bfe3ac4984fbd6973738dddb20d5bb6c72.png)
- 添加 slave 实例 10.0.4.111:6371，同步 master 10.0.4.110:6371
```bash
/opt/redis_cluster/bin/redis-cli \
--cluster add-node 10.0.4.111:6371 10.0.4.110:6371 \
--cluster-slave \
--cluster-master-id 5be0edaf74d1eec50bbe675f9698397023a943b7
# 上述命令中，10.0.4.111:6371 是待添加实例，10.0.4.110:6371 是已存在集群中的任一实例
# --cluster-slave 指定添加 slave 实例
# --cluster-master-id 指定 10.0.4.110:6371 的 id，即本次添加实例的 master
```
- 输出如下图
![](https://colben.cn/img/cf50fb5da24afb930eab80100707b13efbe.png)
- 添加 slave 实例 10.0.4.111:6372，同步 master 10.0.4.110:6372
```bash
/opt/redis_cluster/bin/redis-cli \
--cluster add-node 10.0.4.111:6372 10.0.4.110:6371 \
--cluster-slave \
--cluster-master-id 96f2225fdd054d8a16b31726fd1eb0b66c612646
```
- 输出如下图
![](https://colben.cn/img/4577cd8a2c7aea037e50fb002f91bb40842.png)
- 添加 slave 实例 10.0.4.111:6373，同步 master 10.0.4.110:6373
```bash
/opt/redis_cluster/bin/redis-cli \
--cluster add-node 10.0.4.111:6373 10.0.4.110:6371 \
--cluster-slave \
--cluster-master-id cd60c238e66c8b4a31355bee4610444a47acef86
```
- 输出如下图
![](https://colben.cn/img/633adea823cad6380030826ce75a44109fb.png)
- 查看集群当前实例
```bash
/opt/redis_cluster/bin/redis-cli -p 6371 cluster nodes
```
- 输出如下图
![](https://colben.cn/img/3d5e7c0b8e7a7e51028d11358f442947367.png)
# Docker 部署
- 安装 docker-ce，参考[这里](https://www.colben.cn/post/docker/#%E5%AE%89%E8%A3%85)
- 安装 docker-compose，参考[这里](https://www.colben.cn/post/docker/#Compose)
- 选择一个较大分区，创建 redis 集群数据目录和日志目录
```bsah
mkdir -p redis_cluster/{db,log}/{6371..6376}
```
- 在同级目录下创建 docker-compose.yml 文件，内容如下
```yml
version: "3.7"
services:
redis-6371:
image: harbor.colben.cn/general/alpine-redis
container_name: redis-6371
restart: on-failure
stop_grace_period: 1m
privileged: true
network_mode: "host"
environment:
_CENV_cluster-enabled: "yes"
_CENV_port: 6371
_CENV_maxmemory: 256MB
# master 和 slave 实例的密码必须一致，可都为空
_CENV_masterauth: Pass_1234
_CENV_requirepass: Pass_1234
# master 节点列表
MASTER_NODES: "127.0.0.1:6371 127.0.0.1:6372 127.0.0.1:6373"
# slave 节点列表
# 可以为空，表示没有 slave 节点
# 不为空时，数量必须与 master 节点数量一致，按顺序依次为 master 节点的从节点
SLAVE_NODES: "127.0.0.1:6374 127.0.0.1:6375 127.0.0.1:6376"
volumes:
- type: bind
source: ./redis_cluster/db/6371
target: /var/lib/redis
- type: bind
source: ./redis_cluster/log/6371
target: /var/log/redis
redis-6372:
image: harbor.colben.cn/general/alpine-redis
container_name: redis-6372
restart: on-failure
stop_grace_period: 1m
privileged: true
network_mode: "host"
environment:
_CENV_cluster-enabled: "yes"
_CENV_port: 6372
_CENV_maxmemory: 256MB
_CENV_masterauth: Pass_1234
_CENV_requirepass: Pass_1234
volumes:
- type: bind
source: ./redis_cluster/db/6372
target: /var/lib/redis
- type: bind
source: ./redis_cluster/log/6372
target: /var/log/redis
redis-6373:
image: harbor.colben.cn/general/alpine-redis
container_name: redis-6373
restart: on-failure
stop_grace_period: 1m
privileged: true
network_mode: "host"
environment:
_CENV_cluster-enabled: "yes"
_CENV_port: 6373
_CENV_maxmemory: 256MB
_CENV_masterauth: Pass_1234
_CENV_requirepass: Pass_1234
volumes:
- type: bind
source: ./redis_cluster/db/6373
target: /var/lib/redis
- type: bind
source: ./redis_cluster/log/6373
target: /var/log/redis
redis-6374:
image: harbor.colben.cn/general/alpine-redis
container_name: redis-6374
restart: on-failure
stop_grace_period: 1m
privileged: true
network_mode: "host"
environment:
_CENV_cluster-enabled: "yes"
_CENV_port: 6374
_CENV_maxmemory: 256MB
_CENV_masterauth: Pass_1234
_CENV_requirepass: Pass_1234
volumes:
- type: bind
source: ./redis_cluster/db/6374
target: /var/lib/redis
- type: bind
source: ./redis_cluster/log/6374
target: /var/log/redis
redis-6375:
image: harbor.colben.cn/general/alpine-redis
container_name: redis-6375
restart: on-failure
stop_grace_period: 1m
privileged: true
network_mode: "host"
environment:
_CENV_cluster-enabled: "yes"
_CENV_port: 6375
_CENV_maxmemory: 256MB
_CENV_masterauth: Pass_1234
_CENV_requirepass: Pass_1234
volumes:
- type: bind
source: ./redis_cluster/db/6375
target: /var/lib/redis
- type: bind
source: ./redis_cluster/log/6375
target: /var/log/redis
redis-6376:
image: harbor.colben.cn/general/alpine-redis
container_name: redis-6376
restart: on-failure
stop_grace_period: 1m
privileged: true
network_mode: "host"
environment:
_CENV_cluster-enabled: "yes"
_CENV_port: 6376
_CENV_maxmemory: 256MB
_CENV_masterauth: Pass_1234
_CENV_requirepass: Pass_1234
volumes:
- type: bind
source: ./redis_cluster/db/6376
target: /var/lib/redis
- type: bind
source: ./redis_cluster/log/6376
target: /var/log/redis
```
- 启动 redis 集群
```bash
docker-compose up -d
```
# 参考
- [redis 官网](https://redis.io/topics/cluster-tutorial)