When does Infrastructure as Code (IaC) actually get in the way for smaller teams?

My team's been going back and forth on this. We're just a small startup, only about five engineers, and we're thinking about using IaC tools like Terraform or Pulumi. Sure, the good stuff is obvious, things like version control, doing things the same way every time, and making fewer mistakes by hand. But then there's the flip side: the initial setup, getting everyone up to speed, and keeping all those configurations updated could really eat into our time. So, when have you seen IaC, even with all its hype, actually slow down a small, quick-moving team instead of helping? Are there times when just doing things by hand, or using simple scripts, is actually smarter when you're just getting started, before you go all in with IaC?