If you pursue the other woman, it's a losing situation and it's not good for your relationship or your marriage. If your marriage is open and you're allowed to, that's no good either. There's no way, really in the end, to be happy unless you get very lucky.
