Is there any point in which the courts will look at a family household income?
I am paying her, yet she lives in a nicer house, can afford more vacations and has a much higher standard of living etc.. My child obviously benefits from that as well which is great, however I would like to keep that money to spend on her while she is with me if its not needed at the other household.
You and thousands of others are in this position. I too am the net payor of offset to my ex, who has remarried and has a much higher household income (and more lavish lifestyle) than I do. However, unless you're absolutely destitute and your ex is Bill Gates, there's not much you can do about it.
Under Section 9C of the FCSG, in shared parenting situations the amount of child support is supposed to be determined by "the conditions, means, needs and other circumstances of each spouse and of any child for whom support is sought", but in practice, you would be hard put to get anything other than offset if you took your current arrangement to court, and the cost of the court battle would be pretty daunting.