In a pack of wolves or wild dogs everyone, even the lowest in rank, has the right to defend whatever resources they have. That is why so many dogs guard their food against other dogs and humans. Of course, it's not something that you want the dog to do, but it's always good to know why the dog does something.

The reason the dog growls is that he doesn't trust you not to steal his resources and when you distract him and then "steal" his toy or bone you only confirm that he was right not to trust you. That also makes the growling likely to happen more often in the future.

Instead of distracting him and "steal" whatever he has, teach him to come to you and trade it in for something else. It is always better that the dog come to you, than you going to the dog to take things away. For example, give him a toy and then call him. When he comes with the toy give him a real good treat, for example a small piece of meat, cheese, pancake (for some reason many dogs are crazy about pancakes) or hot dog. When you have rewarded the dog, give the toy back to him. That way he doesn't feel that his losing it, it's simply you holding it for him while he's eating.

It is advisable to start with a toy as the dog probably is less inclined to guard a toy than food or bones. But when he can come to you and trade his toy for a treat it's time to do the same thing with bones. Then especially it's important to have good treats. You could even have a second bone to reward the dog with when he comes with the first one.