Docker 搭建Redis集群

目录

1. 3主3从架构说明

2. 3主3从Redis集群配置

2.1关闭防火墙+启动docker后台服务

2.2 新建6个docker容器实例

2.3 进去任意一台redis容器,为6台机器构建集群关系

2.4 进去6381,查看集群状态

3. 主从容错切换迁移

3.1 数据读写存储

3.1.1 查看集群情况

3.2 容错切换迁移

3.2.1 Master6381 宕机

3.2.2 Master6381 重新启动

4. 主从扩容

4.1 新增机器 6387 6388 (run image 变成镜像)

4.2 将6387节点(空槽号)作为master节点加入原集群

4.3 第一次检查集群情况

4.4 重新分配槽号

4.5 第二次检查集群情况

4.6 为6387主节点分配6388从节点

4.7 第三次检查集群情况

5. 主从缩容 (6387和 6388 下线,退出集群)

5.1 删除6388 (从集群中移除6388从节点)

5.2 将6387(Master)的槽号清空,重新分配 (平均分给其他3个master)

5.3 第一次检查集群

5.4 将6387删除

5.5 第三次检查集群

1~2亿条数据需要存储,轻微如何设计这个存储案例?

答:单机单台100%不可能,肯定是分布式存储。redis如何落地?

一般业界有3种解决方案:

(1) 哈希取余分区

(2)一致性哈希算法分区

(3)哈希槽分区

详细解释参考之前的文档: Redis 集群(cluster)_redis集群不用哨兵-CSDN博客

1. 3主3从架构说明

2. 3主3从Redis集群配置

2.1关闭防火墙+启动docker后台服务

sudo systemctl stop firewalld

systemctl start docker

2.2 新建6个docker容器实例

docker run -d --name redis-node-1 --net host --privileged=true -v /mydocker/redis/share/redis-node-1:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6381

docker run -d --name redis-node-2 --net host --privileged=true -v /mydocker/redis/share/redis-node-2:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6382

docker run -d --name redis-node-3 --net host --privileged=true -v /mydocker/redis/share/redis-node-3:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6383

docker run -d --name redis-node-4 --net host --privileged=true -v /mydocker/redis/share/redis-node-4:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6384

docker run -d --name redis-node-5 --net host --privileged=true -v /mydocker/redis/share/redis-node-5:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6385

docker run -d --name redis-node-6 --net host --privileged=true -v /mydocker/redis/share/redis-node-6:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6386

--net host : 使用宿主机deIP和端口,默认
--privileged=true :容器卷,宿主机地址:docker内部地址
--cluster-enabled yes : 开启redis集群
--appendonly yes : 开启持久化


[root@192 ~]# docker ps
CONTAINER ID   IMAGE         COMMAND                   CREATED          STATUS          PORTS     NAMES
6618c6a22bc3   redis:7.2.4   "docker-entrypoint.s…"   7 seconds ago    Up 6 seconds              redis-node-6
edab1b644f47   redis:7.2.4   "docker-entrypoint.s…"   15 seconds ago   Up 14 seconds             redis-node-5
d4cd712628c4   redis:7.2.4   "docker-entrypoint.s…"   23 seconds ago   Up 22 seconds             redis-node-4
7f09330818f1   redis:7.2.4   "docker-entrypoint.s…"   32 seconds ago   Up 31 seconds             redis-node-3
3fab905c25d6   redis:7.2.4   "docker-entrypoint.s…"   40 seconds ago   Up 39 seconds             redis-node-2
8fa8521a26d3   redis:7.2.4   "docker-entrypoint.s…"   3 minutes ago    Up 3 minutes              redis-node-1
[root@192 ~]# 

2.3 进去任意一台redis容器,为6台机器构建集群关系

redis-cli --cluster create 192.168.217.149:6381 192.168.217.149:6382 192.168.217.149:6383 192.168.217.149:6384 192.168.217.149:6385 192.168.217.149:6386 --cluster-replicas 1

--cluster-replicas 1 : 表示为每个master创建一个slave节点

2.4 进去6381,查看集群状态

127.0.0.1:6381> cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:1
cluster_stats_messages_ping_sent:208
cluster_stats_messages_pong_sent:227
cluster_stats_messages_sent:435
cluster_stats_messages_ping_received:222
cluster_stats_messages_pong_received:208
cluster_stats_messages_meet_received:5
cluster_stats_messages_received:435
total_cluster_links_buffer_limit_exceeded:0


127.0.0.1:6381> cluster nodes
826c4e0230f439eb8aca84e3fa6842e0740ee7e2 192.168.217.149:6385@16385 slave 9829684324fd8294650429a00a6ad7dc32ca5357 0 1711277651000 2 connected
2359f4b4eb3d7843ce721a4032b8931f20752cf1 192.168.217.149:6381@16381 myself,master - 0 1711277651000 1 connected 0-5460
da41e72bb921e0c1d013f82df1c481dafb89e91e 192.168.217.149:6386@16386 slave b8b0f5a32e98ef3790108a0009a2e7c8c6115114 0 1711277651740 3 connected
9cd36c05e6125a3251fe7ba937af24da95599617 192.168.217.149:6384@16384 slave 2359f4b4eb3d7843ce721a4032b8931f20752cf1 0 1711277652748 1 connected
b8b0f5a32e98ef3790108a0009a2e7c8c6115114 192.168.217.149:6383@16383 master - 0 1711277652000 3 connected 10923-16383
9829684324fd8294650429a00a6ad7dc32ca5357 192.168.217.149:6382@16382 master - 0 1711277653757 2 connected 5461-10922
127.0.0.1:6381> 

3. 主从容错切换迁移

3.1 数据读写存储

root@192:/data# redis-cli -p 6381
127.0.0.1:6381> keys *
(empty array)
127.0.0.1:6381> set k1 v1
(error) MOVED 12706 192.168.217.149:6383
127.0.0.1:6381> set k2 v2
OK

 添加数据时出现:(error) MOVED 12706 192.168.217.149:6383

需要  redis-cli -p 6381 -c 以集群的方式连接

root@192:/data# redis-cli -p 6381 -c
127.0.0.1:6381> set k2 v2
OK
127.0.0.1:6381> set k1 v1
-> Redirected to slot [12706] located at 192.168.217.149:6383
OK

3.1.1 查看集群情况

root@192:/data# redis-cli --cluster check 192.168.217.149:6381

192.168.217.149:6381 (2359f4b4...) -> 1 keys | 5461 slots | 1 slaves.
192.168.217.149:6383 (b8b0f5a3...) -> 1 keys | 5461 slots | 1 slaves.
192.168.217.149:6382 (98296843...) -> 0 keys | 5462 slots | 1 slaves.
[OK] 2 keys in 3 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.217.149:6381)
M: 2359f4b4eb3d7843ce721a4032b8931f20752cf1 192.168.217.149:6381
   slots:[0-5460] (5461 slots) master
   1 additional replica(s)
S: 826c4e0230f439eb8aca84e3fa6842e0740ee7e2 192.168.217.149:6385
   slots: (0 slots) slave
   replicates 9829684324fd8294650429a00a6ad7dc32ca5357
S: da41e72bb921e0c1d013f82df1c481dafb89e91e 192.168.217.149:6386
   slots: (0 slots) slave
   replicates b8b0f5a32e98ef3790108a0009a2e7c8c6115114
S: 9cd36c05e6125a3251fe7ba937af24da95599617 192.168.217.149:6384
   slots: (0 slots) slave
   replicates 2359f4b4eb3d7843ce721a4032b8931f20752cf1
M: b8b0f5a32e98ef3790108a0009a2e7c8c6115114 192.168.217.149:6383
   slots:[10923-16383] (5461 slots) master
   1 additional replica(s)
M: 9829684324fd8294650429a00a6ad7dc32ca5357 192.168.217.149:6382
   slots:[5461-10922] (5462 slots) master
   1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
root@192:/data# 

3.2 容错切换迁移

3.2.1 Master6381 宕机

[root@192 ~]# docker ps
CONTAINER ID   IMAGE         COMMAND                   CREATED       STATUS       PORTS     NAMES
6618c6a22bc3   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-6
edab1b644f47   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-5
d4cd712628c4   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-4
7f09330818f1   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-3
3fab905c25d6   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-2
8fa8521a26d3   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-1
[root@192 ~]# docker stop redis-node-1
redis-node-1

[root@192 ~]# docker exec -it redis-node-2 /bin/bash

root@192:/data# redis-cli -p 6382 -c

127.0.0.1:6382> cluster nodes
b8b0f5a32e98ef3790108a0009a2e7c8c6115114 192.168.217.149:6383@16383 master - 0 1711283738000 3 connected 10923-16383
da41e72bb921e0c1d013f82df1c481dafb89e91e 192.168.217.149:6386@16386 slave b8b0f5a32e98ef3790108a0009a2e7c8c6115114 0 1711283740817 3 connected
9829684324fd8294650429a00a6ad7dc32ca5357 192.168.217.149:6382@16382 myself,master - 0 1711283740000 2 connected 5461-10922
9cd36c05e6125a3251fe7ba937af24da95599617 192.168.217.149:6384@16384 master - 0 1711283739000 7 connected 0-5460
2359f4b4eb3d7843ce721a4032b8931f20752cf1 192.168.217.149:6381@16381 master,fail - 1711283644541 1711283639000 1 disconnected
826c4e0230f439eb8aca84e3fa6842e0740ee7e2 192.168.217.149:6385@16385 slave 9829684324fd8294650429a00a6ad7dc32ca5357 0 1711283741828 2 connected
127.0.0.1:6382> 

结论:master 宕机,slave会自动上位变成master

3.2.2 Master6381 重新启动

[root@192 ~]# docker ps
CONTAINER ID   IMAGE         COMMAND                   CREATED       STATUS       PORTS     NAMES
6618c6a22bc3   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-6
edab1b644f47   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-5
d4cd712628c4   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-4
7f09330818f1   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-3
3fab905c25d6   redis:7.2.4   "docker-entrypoint.s…"   2 hours ago   Up 2 hours             redis-node-2

[root@192 ~]# docker start redis-node-1
redis-node-1

[root@192 ~]# docker exec -it redis-node-1 /bin/bash

root@192:/data# redis-cli -p 6381 -c

127.0.0.1:6381> cluster nodes
da41e72bb921e0c1d013f82df1c481dafb89e91e 192.168.217.149:6386@16386 slave b8b0f5a32e98ef3790108a0009a2e7c8c6115114 0 1711284415980 3 connected
826c4e0230f439eb8aca84e3fa6842e0740ee7e2 192.168.217.149:6385@16385 slave 9829684324fd8294650429a00a6ad7dc32ca5357 0 1711284414000 2 connected
9829684324fd8294650429a00a6ad7dc32ca5357 192.168.217.149:6382@16382 master - 0 1711284413000 2 connected 5461-10922
2359f4b4eb3d7843ce721a4032b8931f20752cf1 192.168.217.149:6381@16381 myself,slave 9cd36c05e6125a3251fe7ba937af24da95599617 0 1711284415000 7 connected
9cd36c05e6125a3251fe7ba937af24da95599617 192.168.217.149:6384@16384 master - 0 1711284416997 7 connected 0-5460
b8b0f5a32e98ef3790108a0009a2e7c8c6115114 192.168.217.149:6383@16383 master - 0 1711284415000 3 connected 10923-16383

结论: 即使之前宕机的Master 重新启动,加入集群之后也是slave。

4. 主从扩容

4.1 新增机器 6387 6388 (run image 变成镜像)

docker run -d --name redis-node-7 --net host --privileged=true -v /mydocker/redis/share/redis-node-7:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6387

docker run -d --name redis-node-8 --net host --privileged=true -v /mydocker/redis/share/redis-node-8:/data redis:7.2.4 --cluster-enabled yes --appendonly yes --port 6388

[root@localhost ~]# docker ps
CONTAINER ID   IMAGE         COMMAND                   CREATED          STATUS          PORTS     NAMES
d55857af1d99   redis:7.2.4   "docker-entrypoint.s…"   4 seconds ago    Up 3 seconds              redis-node-8
cfa322ef90bc   redis:7.2.4   "docker-entrypoint.s…"   20 seconds ago   Up 18 seconds             redis-node-7
6618c6a22bc3   redis:7.2.4   "docker-entrypoint.s…"   23 hours ago     Up 11 minutes             redis-node-6
edab1b644f47   redis:7.2.4   "docker-entrypoint.s…"   23 hours ago     Up 11 minutes             redis-node-5
d4cd712628c4   redis:7.2.4   "docker-entrypoint.s…"   23 hours ago     Up 8 minutes              redis-node-4
7f09330818f1   redis:7.2.4   "docker-entrypoint.s…"   23 hours ago     Up 11 minutes             redis-node-3
3fab905c25d6   redis:7.2.4   "docker-entrypoint.s…"   23 hours ago     Up 11 minutes             redis-node-2
8fa8521a26d3   redis:7.2.4   "docker-entrypoint.s…"   23 hours ago     Up 11 minutes             redis-node-1

4.2 将6387节点(空槽号)作为master节点加入原集群

[root@localhost ~]# docker exec -it redis-node-7 /bin/bash
root@localhost:/data# redis-cli --cluster add-node 192.168.217.149:6387 192.168.217.149:6381

4.3 第一次检查集群情况

root@localhost:/data# redis-cli --cluster check 192.168.217.149:6381

4.4 重新分配槽号

redis-cli --cluster reshard 192.168.217.149:6381

4.5 第二次检查集群情况

root@localhost:/data# redis-cli --cluster check 192.168.217.149:6381

4.6 为6387主节点分配6388从节点

root@localhost:/data# redis-cli --cluster add-node 192.168.217.149:6388 192.168.217.149:6387 --cluster-slave --cluster-master-id c88d4e7a747ec37c1bea6563dedd87289a6fe367

redis-cli --cluster add-node ip:新slave端口 ip:新master端口 --cluster-slave --cluster-master-id slave的编号

4.7 第三次检查集群情况

redis-cli --cluster check 192.168.217.149:6381

5. 主从缩容 (6387和 6388 下线,退出集群)

5.1 删除6388 (从集群中移除6388从节点)

root@localhost:/data# redis-cli --cluster del-node 192.168.217.149:6388 7048f2115ed42bac1c2e53a6ba14ecaf30af4304

redis-cli --cluster del-node ip:从机端口 从机节点ID

5.2 将6387(Master)的槽号清空,重新分配 (平均分给其他3个master)

redis-cli --cluster reshard 192.168.217.149:6381

5.3 第一次检查集群

5.4 将6387删除

root@localhost:/data# redis-cli --cluster del-node 192.168.217.149:6387 7048f2115ed42bac1c2e53a6ba14ecaf30af4304

redis-cli --cluster del-node ip:端口 节点ID

5.5 第三次检查集群

redis-cli --cluster check 192.168.217.149:6381

相关推荐

  1. dockerredis三主三从

    2024-03-26 14:42:01       10 阅读

最近更新

  1. TCP协议是安全的吗?

    2024-03-26 14:42:01       16 阅读
  2. 阿里云服务器执行yum,一直下载docker-ce-stable失败

    2024-03-26 14:42:01       16 阅读
  3. 【Python教程】压缩PDF文件大小

    2024-03-26 14:42:01       15 阅读
  4. 通过文章id递归查询所有评论(xml)

    2024-03-26 14:42:01       18 阅读

热门阅读

  1. Qt源码分析:QMetaObject实现原理

    2024-03-26 14:42:01       18 阅读
  2. MongoDB 的索引有哪些 nestjs mongoose示例

    2024-03-26 14:42:01       15 阅读
  3. 在线数据格式工具

    2024-03-26 14:42:01       14 阅读
  4. 论文阅读--Offline RL Without Off-Policy Evaluation

    2024-03-26 14:42:01       14 阅读
  5. vue/js总结合集

    2024-03-26 14:42:01       16 阅读
  6. 面试算法-117-组合总和 III

    2024-03-26 14:42:01       13 阅读
  7. 缓存Caffine

    2024-03-26 14:42:01       19 阅读