Do you have documentation of him saying no to your requests to have the children when he is away? Unfortunetly I don't think there is much you can do. I wouldn't think there was an issue if the children actually enjoyed being around his new wife and family. It's sad if they do not enjoy being with her and family and would rather spend the time with you