Am I ruining my marriage?

So my husband thought about divorcing me on his precious trip to Seattle with his female mistress co worker who's married. Dosent like me to compare myself to anyone. didn't want to say I love you much. Or talk to me much. Am I ruining our marriage cause I don't trust him to be around her. She's 45 with 3 kids has some type of mafia dude husband. Yet my husband likes her brains, and butt I'm sure, yet has no real beauty but makes good money.
Am I ruining my marriage?
Post Opinion