Do you allow your puppy constant access to the water bowl?

Hi! I’m potty training and it seems like I take him out every hour and he pees and then we get inside and he is a pee machine about 10 minutes later. I’m wondering if he’s drinking too much water? I know they need lots but it seems like he shouldn’t be peeing this much? What am I doing wrong here?