I'm sure he remembers, he's probably just frightened!

Moving around can make cats very nervous! Give him a week or so!