service discovery in a dynamic microservice environment tho

Hey everyone, I'm trying to figure out service discovery because our microservice setup is getting bigger and services are popping up and disappearing all the time. We're on Kubernetes, but I'm curious about the pros and cons of client-side discovery versus server-side discovery. You know, like using a specific discovery server. What do you all usually do to keep services talking to each other when things are always in flux? Got any funny stories or good advice?