RQ配置使用Redis Cluster
2024-05-11 11:41:09
一、基于docker-compose搭建redis集群
1.1 集群配置
- 3主+3从
- redis1-redis6
1.2 编写redis.conf
创建redis.conf，填入如下内容，将redis.conf拷贝至./conf/{redis1-redis6}.conf：
# 开启集群
cluster-enabled yes
# 集群配置文件
cluster-config-file nodes.conf
# 集群节点多少时间未响应视为该节点丢失
cluster-node-timeout 5000
# 开启 appendonly 备份模式
appendonly yes
# redis监听端口：端口范围1379-6379
port 1379
# 集群节点端口：端口范围1379-6379，总线端口范围11379-16379
cluster-announce-ip 192.168.1.2
cluster-announce-port 1379
cluster-announce-bus-port 11379
1.3 编写docker-compose文件
version: '3'
services:redis1:image: redis:6container_name: redis-1restart: alwaysenvironment:# 设置时区为上海- TZ=Asia/Shanghaiports:- "1379:1379"- "11379:11379"volumes:- ./conf/redis1.conf:/conf/redis.confcommand: [ "redis-server", "/conf/redis.conf" ]redis2:image: redis:6container_name: redis-2restart: alwaysenvironment:# 设置时区为上海- TZ=Asia/Shanghaiports:- "2379:2379"- "12379:12379"volumes:- ./conf/redis2.conf:/conf/redis.confcommand: [ "redis-server", "/conf/redis.conf" ]redis3:image: redis:6container_name: redis-3restart: alwaysenvironment:# 设置时区为上海- TZ=Asia/Shanghaiports:- "3379:3379"- "13379:13379"volumes:- ./conf/redis3.conf:/conf/redis.confcommand: [ "redis-server", "/conf/redis.conf" ]redis4:image: redis:6container_name: redis-4restart: alwaysenvironment:# 设置时区为上海- TZ=Asia/Shanghaiports:- "4379:4379"- "14379:14379"volumes:- ./conf/redis4.conf:/conf/redis.confcommand: [ "redis-server", "/conf/redis.conf" ]redis5:image: redis:6container_name: redis-5restart: alwaysenvironment:# 设置时区为上海- TZ=Asia/Shanghaiports:- "5379:5379"- "15379:15379"volumes:- ./conf/redis5.conf:/conf/redis.confcommand: [ "redis-server", "/conf/redis.conf" ]redis6:image: redis:6container_name: redis-6restart: alwaysenvironment:# 设置时区为上海- TZ=Asia/Shanghaiports:- "6379:6379"- "16379:16379"volumes:- ./conf/redis6.conf:/conf/redis.confcommand: [ "redis-server", "/conf/redis.conf" ]networks:default:external:name: redis
1.4 启动容器
最终目录结构：
.
├── conf
│ ├── redis1.conf
│ ├── redis2.conf
│ ├── redis3.conf
│ ├── redis4.conf
│ ├── redis5.conf
│ └── redis6.conf
├── docker-compose.yml
- 启动容器前需要创建网络
docker network create redis - 启动容器
docker-compose up -d
1.5 服务状态
$ docker-compose ps
Name Command State Ports
-----------------------------------------------------------------------------------------------------------------------------------------
redis-1 docker-entrypoint.sh redis ... Up 0.0.0.0:11379->16379/tcp,:::11379->16379/tcp, 0.0.0.0:1379->6379/tcp,:::1379->6379/tcp
redis-2 docker-entrypoint.sh redis ... Up 0.0.0.0:12379->16379/tcp,:::12379->16379/tcp, 0.0.0.0:2379->6379/tcp,:::2379->6379/tcp
redis-3 docker-entrypoint.sh redis ... Up 0.0.0.0:13379->16379/tcp,:::13379->16379/tcp, 0.0.0.0:3379->6379/tcp,:::3379->6379/tcp
redis-4 docker-entrypoint.sh redis ... Up 0.0.0.0:14379->16379/tcp,:::14379->16379/tcp, 0.0.0.0:4379->6379/tcp,:::4379->6379/tcp
redis-5 docker-entrypoint.sh redis ... Up 0.0.0.0:15379->16379/tcp,:::15379->16379/tcp, 0.0.0.0:5379->6379/tcp,:::5379->6379/tcp
redis-6 docker-entrypoint.sh redis ... Up 0.0.0.0:16379->16379/tcp,:::16379->16379/tcp, 0.0.0.0:6379->6379/tcp,:::6379->6379/tcp
二、创建集群
2.1 进入一个容器
docker exec -it redis-1 bash
2.2 创建集群
redis-cli --cluster create \
192.168.1.2:1379 \
192.168.1.2:2379 \
192.168.1.2:3379 \
192.168.1.2:4379 \
192.168.1.2:5379 \
192.168.1.2:6379 \
--cluster-replicas 1
输出信息如下：
root@288cf292dd98:/data# redis-cli --cluster create \
> 192.168.1.2:1379 \
> 192.168.1.2:2379 \
> 192.168.1.2:3379 \
> 192.168.1.2:4379 \
> 192.168.1.2:5379 \
> 192.168.1.2:6379 \
> --cluster-replicas 1
>>> Performing hash slots allocation on 6 nodes...
Master[0] -> Slots 0 - 5460
Master[1] -> Slots 5461 - 10922
Master[2] -> Slots 10923 - 16383
Adding replica 192.168.1.2:5379 to 192.168.1.2:1379
Adding replica 192.168.1.2:6379 to 192.168.1.2:2379
Adding replica 192.168.1.2:4379 to 192.168.1.2:3379
>>> Trying to optimize slaves allocation for anti-affinity
[WARNING] Some slaves are in the same host as their master
M: f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc 192.168.1.2:1379slots:[0-5460] (5461 slots) master
M: 7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 192.168.1.2:2379slots:[5461-10922] (5462 slots) master
M: f90ea317783606a08bf70443fdc8a0e7d5c9e483 192.168.1.2:3379slots:[10923-16383] (5461 slots) master
S: 975c47d4045e64dada1c2a377dd49435cce53ad1 192.168.1.2:4379replicates f90ea317783606a08bf70443fdc8a0e7d5c9e483
S: 24aaaf5b071f5bf089208c7525ed992fdc7a487a 192.168.1.2:5379replicates f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc
S: 096106d92a0d55279898b696d9ea9f81a8f1bbad 192.168.1.2:6379replicates 7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d
Can I set the above configuration? (type 'yes' to accept): yes
>>> Nodes configuration updated
>>> Assign a different config epoch to each node
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join
.
>>> Performing Cluster Check (using node 192.168.1.2:1379)
M: f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc 192.168.1.2:1379slots:[0-5460] (5461 slots) master1 additional replica(s)
S: 24aaaf5b071f5bf089208c7525ed992fdc7a487a 192.168.1.2:5379slots: (0 slots) slavereplicates f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc
M: f90ea317783606a08bf70443fdc8a0e7d5c9e483 192.168.1.2:3379slots:[10923-16383] (5461 slots) master1 additional replica(s)
S: 096106d92a0d55279898b696d9ea9f81a8f1bbad 192.168.1.2:6379slots: (0 slots) slavereplicates 7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d
M: 7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 192.168.1.2:2379slots:[5461-10922] (5462 slots) master1 additional replica(s)
S: 975c47d4045e64dada1c2a377dd49435cce53ad1 192.168.1.2:4379slots: (0 slots) slavereplicates f90ea317783606a08bf70443fdc8a0e7d5c9e483
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
2.3 查看集群状态
cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:2
cluster_stats_messages_ping_sent:9758
cluster_stats_messages_pong_sent:9882
cluster_stats_messages_meet_sent:1
cluster_stats_messages_sent:19641
cluster_stats_messages_ping_received:9882
cluster_stats_messages_pong_received:9759
cluster_stats_messages_received:19641
2.4 创建数据
redis-cli -c -h 192.168.1.2 -p 1379
192.168.1.2:1379> set test test
-> Redirected to slot [6918] located at 192.168.1.2:2379
OK
192.168.192.1:2379> get test
"test"
三、宕机测试
cluster nodes
7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 192.168.1.2:2379@12379 myself,master - 0 1648456090000 2 connected 5461-10922
975c47d4045e64dada1c2a377dd49435cce53ad1 192.168.1.2:4379@14379 slave f90ea317783606a08bf70443fdc8a0e7d5c9e483 0 1648456092000 3 connected
096106d92a0d55279898b696d9ea9f81a8f1bbad 192.168.1.2:6379@16379 slave 7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 0 1648456091000 2 connected
24aaaf5b071f5bf089208c7525ed992fdc7a487a 192.168.1.2:5379@15379 slave f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc 0 1648456092294 1 connected
f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc 192.168.1.2:1379@11379 master - 0 1648456091000 1 connected 0-5460
f90ea317783606a08bf70443fdc8a0e7d5c9e483 192.168.1.2:3379@13379 master - 0 1648456091000 3 connected 10923-16383
docker stop redis-1
cluster nodes
7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 192.168.1.2:2379@12379 myself,master - 0 1648456262000 2 connected 5461-10922
975c47d4045e64dada1c2a377dd49435cce53ad1 192.168.1.2:4379@14379 slave f90ea317783606a08bf70443fdc8a0e7d5c9e483 0 1648456263000 3 connected
096106d92a0d55279898b696d9ea9f81a8f1bbad 192.168.1.2:6379@16379 slave 7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 0 1648456261396 2 connected
24aaaf5b071f5bf089208c7525ed992fdc7a487a 192.168.1.2:5379@15379 master - 0 1648456262000 7 connected 0-5460
f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc 192.168.1.2:1379@11379 master,fail - 1648456214523 1648456212003 1 disconnected
f90ea317783606a08bf70443fdc8a0e7d5c9e483 192.168.1.2:3379@13379 master - 0 1648456263411 3 connected 10923-16383
可以看到redis-1(1379)宕机后redis-5(5379)升级为master
docker start redis-1
可以看到重启服务后redis-5(5379)变为redis-1(1379)的slave
7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 192.168.1.2:2379@12379 myself,master - 0 1648456453000 2 connected 5461-10922
975c47d4045e64dada1c2a377dd49435cce53ad1 192.168.1.2:4379@14379 slave f90ea317783606a08bf70443fdc8a0e7d5c9e483 0 1648456454898 3 connected
096106d92a0d55279898b696d9ea9f81a8f1bbad 192.168.1.2:6379@16379 slave 7ce6b7d37f3dc04f8b77e8d9bee37bdaf47b903d 0 1648456454596 2 connected
24aaaf5b071f5bf089208c7525ed992fdc7a487a 192.168.1.2:5379@15379 master - 0 1648456454596 7 connected 0-5460
f9f0cdd20b8e7474c82c5cc3ea4177a2a8fa4dbc 192.168.1.2:1379@11379 slave 24aaaf5b071f5bf089208c7525ed992fdc7a487a 0 1648456454596 7 connected
f90ea317783606a08bf70443fdc8a0e7d5c9e483 192.168.1.2:3379@13379 master - 0 1648456454000 3 connected 10923-16383
四、RQ连接测试
4.1 测试脚本
from redis import RedisCluster
from redis.cluster import ClusterNode
from rq import Queuenodes = [ClusterNode('192.168.1.2', 1379),ClusterNode('192.168.1.2', 2378),ClusterNode('192.168.1.2', 3378),ClusterNode('192.168.1.2', 4378),ClusterNode('192.168.1.2', 5378),ClusterNode('192.168.1.2', 6378),
]
redis_connect = RedisCluster(startup_nodes=nodes)
redis_connect.set('test', 'test')
queue = Queue(name='test', connection=redis_connect)job = queue.enqueue('test')
print(job.get_id())
4.2 测试结果
五、总结
- 使用容器部署集群需要注意
6379和16379两个端口都需要开放 cluster-announce-ip需要指定为服务器的真实IP地址- 实际集群部署将
redis.conf中的配置修改为相应的真实IP和端口即可# 开启集群 cluster-enabled yes # 集群配置文件 cluster-config-file nodes.conf # 集群节点多少时间未响应视为该节点丢失 cluster-node-timeout 5000 # 开启 appendonly 备份模式 appendonly yes # redis监听端口 port 6379 # 集群节点ip和端口 cluster-announce-ip 10.0.10.10 cluster-announce-port 6379 cluster-announce-bus-port 16379
RQ配置使用Redis Cluster相关推荐
- Redis Cluster深入与实践（续）
前文回顾 上一篇文章基于redis的分布式锁实现写了基于redis实现的分布式锁.分布式环境下,不会还使用单点的redis,做到高可用和容灾,起码也是redis主从.redis的单线程工作,一台物理机 ...
- redis cluster 安装配置
一.redis集群安装配置 1.下载redis源码包并下载 wget http://download.redis.io/releases/redis-3.0.7.tar.gz $ tar xzf re ...
- redis cluster 集群 安装 配置 详解
redis cluster 集群 安装 配置 详解 张映 发表于 2015-05-01 分类目录: nosql 标签:cluster, redis, 安装, 配置, 集群 Redis 集群是一个提供在 ...
- Redis cluster集群原理与配置
Redis cluster集群原理与配置 一.cluster集群原理 1.数据迁移 过程 2.复制以及故障转移 故障检测 故障转移 二.配置cluster集群 1.创建文件夹 2.编辑 7001.co ...
- Redis Cluster集群配置
Redis Cluster集群配置 背景:Redis Cluster 提供了一种运行 Redis 安装的方法,其中数据 在多个 Redis 节点之间自动分片. 一.下载安装 1.下载安装redis w ...
- Redis高可用集群Redis Cluster搭建
前言: Redis3.0版本之前,可以通过Redis Sentinel(哨兵)来实现高可用 ( HA ),从3.0版本之后,官方推出了Redis Cluster,它的主要用途是实现数据分片(Data ...
- Redis6安装配置集群cluster以及集群宕机注意事项
Redis6的cluster模型推荐3主3从 先准备3台服务器,每个上面部署2个redis,服务器配置2核2G: 下面在每台服务器安装redis6,每台机器只要安装一次即可,然后分别配置2个端口的co ...
- 高手过招， 为什么 Redis Cluster 是16384个槽位?
我们都知道Redis的集群有三种方案: 1.主从复制模式 2.Sentinel(哨兵)模式 3.Redis Cluster模式 当然使用随着海量数据的存储要求,单台Redis配置有限,已经满足不了我们 ...
- 不懂Redis Cluster原理，我被同事diss了！
" Redis 缓存作为使用最多的缓存工具被各大厂商争相使用.通常我们会使用单体的 Redis 应用作为缓存服务,为了保证其高可用还会使用主从模式(Master-Slave),又或者是读写分 ...
- 超详细的 Redis Cluster 官方集群搭建指南,适用于 redis 5.x, 6.x
今天从 0 开始搭建 Redis Cluster 官方集群,解决搭建过程中遇到的问题,超详细. 旧版本使用 redis-trib.rb ruby 脚本安装集群,5.0版本redis-cli 已经自带 ...
最新文章
- 2022-2028年中国汽车塑料行业市场深度分析及投资趋势预测报告
- python代码大全p-【python】10分钟教你用python一行代码搞点大新闻
- 2021-10-21 二叉堆 恋上数据结构笔记
- WCF开发的几个频骤
- Java黑皮书课后题第8章：*8.30（代数：解答线性方程）编写一个方法，解答下面的2*2线性方程组系统
- python如何输入空行_在python中，如何在接受用户输入时跳过空行？
- ConvertFrom-String 命令研究
- python读取raw图片文件_python读取raw binary图片并提取统计信息的实例
- 【Python】政府工作报告词云
- 国内首例：飞步无人卡车携手中国邮政、德邦投入日常运营
- VS2015/VS2017必须在WINDOWS10上安装
- 破圈法求最小生成树_【学科加油站】悉大COMP9007 最小生成树知识点总结！
- LeetCode_88、合并两个数组（python）
- 2019年2月10日训练日记
- 高通设备进入高通9008模式
- Facebook广告投放策略与优化Facebook广告成效的技巧方式
- 一种基于时间滑动窗口的黑产团伙挖掘算法
- 华为cor—al10_华为荣耀cor_al10是 什么型号的手机
- Excel收纳箱：如何通过VBA获A列数据的最大行数
- 15 个有趣的 JS 和 CSS 库