when do database connection pooling become essential?

i've been thinking about scaling some of our services and the database connection is often a bottleneck. we're currently opening and closing connections per request, which is fine for low traffic but i'm wondering at what point should we really be implementing a connection pool. what are the key metrics or traffic levels that signal it's time to make the switch. any pitfalls to watch out for during implementation or just general advice