If it was me, I would keep him inside permanently or cat proof the garden/yard. Maybe sit outside for 5 mins at a time with him at the most and then both go back and snuggle inside where it is safe and cosy. Just my honest opinion!