Message Queues: Should we focus on decoupling or is latency more important?

hey folks, i've been thinking about message queues lately. we use them a lot for async tasks, and they're great for decoupling services. but, i'm starting to feel the latency from adding a queue to the mix for some workflows. like, if a user action needs a super fast response that a queue might hold up, is it always best to just skip the queue, or are there ways to work around this? what have you guys found when trying to balance the good parts of decoupling with the extra delay from message queue systems?