choosing the right message queue for your needs
Faris Abboud
·3015 views
Hey everyone,
Been thinking a lot about message queues lately, especially with all the talk about scaling and microservices. We've used RabbitMQ quite a bit and it's worked fine for lots of things. But I'm curious about when other options like SQS, Kafka, or even something simpler like Redis Streams might be a better fit.
For regular job queues and when services need to talk to each other, RabbitMQ or SQS usually seem like the easy choice. But when do Kafka's specific features, like its log-based streaming and ability to replay messages, actually become necessary, and when is it just too much? Also, has anyone had good luck with Redis Streams for situations where a full message broker seems like overkill?
What do you all usually do to choose the right queue? I'm thinking about things like how much data it can handle, how fast it is, how reliable it is, and how much work it is to manage. Really interested to hear what you've all found!
32 comments