我有一段代码,它使用pika将消息排入代理的队列。
class Publisher:
def __init__(self, config):
self._params = ConnectionParameters(
host = config.RABBITMQ_HOST,
credentials = PlainCredentials(config.RABBITMQ_USER, config.RABBITMQ_PASSWORD))
self._conn = None
self._channel = None
self.exchange_name = config.RABBITMQ_AGENT_EXCHANGE
def connect(self):
if not self._conn or self._conn.is_closed:
self._conn = BlockingConnection(self._params)
self._channel = self._conn.channel()
self._channel.exchange_declare(exchange=self.exchange_name, exchange_type = 'topic')
def _publish(self, task):
properties = BasicProperties(expiration=task.expiration_ms)
self._channel.basic_publish(exchange= self.exchange_name,
routing_key = task.routing_key,
properties = properties if task.has_expiration else None,
body=dumps(task, cls = TaskEncoder).encode())
logging.debug('message sent: %s', task)
def publish(self, msg):
"""Publish msg, reconnecting if necessary."""
try:
self._publish(msg)
except ConnectionClosed:
logging.error('reconnecting to queue')
self.connect()
self._publish(msg)
Pika停止将长时间运行的消息与下一条消息进行连接,并且不再抛出任何错误
2021-03-14 12:25:09,981 MainThread-140100212655936 pika.heartbeat [INFO] - Connection is idle, 1 stale byte intervals
2021-03-14 12:25:09,981 MainThread-140100212655936 pika.adapters.utils.io_services_utils [INFO] - Aborting transport connection: state=1; <socket.socket fd=6, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('192.168.184.108', 41024), raddr=('10.100.176.158', 5672)>
2021-03-14 12:25:09,981 MainThread-140100212655936 pika.adapters.utils.io_services_utils [INFO] - _AsyncTransportBase._initate_abort(): Initiating abrupt asynchronous transport shutdown: state=1; error=None; <socket.socket fd=6, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('192.168.184.108', 41024), raddr=('10.100.176.158', 5672)
代码用法
publisher = Publisher(config)
publisher.connect()
while True:
publisher.publish(obj)
time.sleep(1)
我有两个问题:
如何预防呢?在这种情况下,是否可以禁用心跳?
如何使用防火墙重现/模拟此行为?我尝试在RMQ端口上添加一个丢弃数据包的规则,但没有成功。
Pika版本: 1.0.1
RMQ版本: 3.8.9
Python: 3.8.6
发布于 2021-06-28 12:57:54
有相当多的帖子建议保持回调执行非常短,所以控制应该回到pika。see more on it here
如果你有很大的事情要计算,最好将它们分散到另一个线程/进程中,或者将它们累积起来以供以后执行。这个概念帮助了我处理其他实时api。
似乎发生的事情是,兔子正在关闭通道(如果你的手不在其他地方,你可以在回调中捕捉到这一点),在我看来,心跳似乎被鼠兔停止了。
https://stackoverflow.com/questions/66689571
复制相似问题