if he licks too much he can re-open the wound and will have to go back to the vets i would personally leave it on and take it off about 10 mins every 2 hours so he gets a break from it being on.
If he is really bad contact your vet as they may suggest you take it off, or give him a sedative to relax him just for today