Dogs should always have access to fresh water but you are trying to train your new poochie, so why make it harder by letting him drink at night when this will make him pee
All of my dogs are now old enough to have the water left down at night but they don't drink it and they don't pee in the house. When I was training them to pee outside the water and food was picked up at 8-9pm. They were all dry through the night within a fortnight.
Your puppy will drink enough water through the day to sustain it through the night so you are not doing anything wrong by picking it up.