i'm with hayley on this one our stray in the front garden will let me pet him etc and walks right up to me at feeding times but the rest of the time he is a little standoffish and god forbid you try and lift him ha ha he would have your hand off but he doesnt cower if i raise my hand or jump he just watches what i do and then decides whether to stroll off or come and see what i am up to. your poor boy sounds like he has been on the wrong side of someone