I feed them what they'll take, every 3 hours at this stage. Did he get some colostrum?
Mum will be bruised and sore, feeling a bit sorry for herself I guess. Have you tried giving him back to her? Bring them both into the hayshed, tie her up so she can't butt him, strip milk from each teat so you know they're working and then try to get him to feed - better if he's hungry at this point. As he begins to smell of her milk she is more likely to take him. So second best is to milk her and then feed him that for now.
Also, even if you're feeding him I'd see if she'll look after him, better to belong to someone once he's out in the field. Make a pen for them both and then make a corner for him, put him into a deep box or something so she can sniff him but not butt him.
Hopefully she'll take him back and they'll both feel better!