If kitty is happy drinking the milk formula for now, thats fine. Trying weening in a week or two gradually, if you are happy with that!
It sounds like you are doing a great job, and yes wee kitty will follow you around for comfort and company because at that age kittens are usually 24/7 with mum cat. Kitty will love lying on your chest listening to your heartbeat, will remind him of his mum....