database connection pooling, overkill or essential

Hey everyone, I've been mulling over database connection pooling. For little apps, it seems like too much, but for services handling tons of requests at once, I think it's key to stop hammering the database. What do you all think? When do you decide connection pooling is absolutely necessary, and what are the usual problems you've hit when setting it up? I'm interested in how different teams handle this.