One would think, that it is a basic question of consent.

The husband although not physically active with you personally was informed and was consenting up to a point yes?

Now she wishes to continue the relationship (despite the husband having revoked his consent) sans honor effectively cheating on him and making you an accomplice?