when does caching actually hurt performance?

we often talk about caching to improve performance, but I've seen a few cases where it actually added latency or complexity without much benefit. for example, with frequently changing, small data sets, or when the overhead of cache invalidation outweighs the read speedup. what are your experiences? when have you found caching to be counterproductive in a system design