Most women won't hang around a guy who is two timing her ... and vice versa !
So , no , having an affair while married is not at all normal !!!
Untrue, muslim men are married to 4 women and they all live together peacefully.
Maybe re-read the OP's questions: ... with OTHER women THAN HIS WIFE.
In the scenario you describe they are all his wife.