Hi Darren, congratulations on your new puppy he sounds wonderful, very well behaved I would make the most of it while it lasts you may find as he settles in and gets used to you he may get a bit 'naughtier'
When your vet says he shouldn't go out he means for walks etc. if you have a garden it will quite alright for you to take him out to do his toilet, in fact the sooner you start the better. I would just put paper down for night time or when he has to be left alone, but take him out to where you want him to preform as soon as he wakes and after every feed, he will soon be asking to go by himself.
Good luck.
Mary
x