Here's the hierarchy of goods in marriage, as far as I can tell:
I have a greater responsibility to my wife than to my children.
I have a greater responsibility to the children I have than to any children I might have in the future.
Marriages break down when either of those two priorities are inverted.