Yes

There are anecdotal stories of cats having more than one home. For instance if you shut your cat out while at work and he finds another home willing to provide food and comfort he may well spend time there.

Catscan be very unloyal. Some cats, if they find a more appealing home will take up residence permanently.

(Its rare for the divorcing, but i suspect not so rare for the two timing )