Stepfather hits son- can we withhold Mothers access if he is present?

[MsJessimica]

My partner and I have just found out the his son, 4 years old, is being hit with a shoe repeatedly by his stepfather when he is at his Mothers house....