Search Results: liking a guy with a girlfriend

Okay so there was this guy I had a strong connection with but about a few years ago when I asked him out, one of the new girls at our work had already stolen him and before I knew it he was dating her. So I just gave up on the idea of him. I couldn't bare seeing them on Facebook though when I searched him up. And I became jealous of her! Well later on it was obvious I wanted him and I gave him a longing face when his girlfriend was near him and so she became jealous.
After like a few months of jealousy I began to find me my own guy and that's when I met my husband now :). Before I married my husband I was forced to work in the same department as the past guy. And there was obviously still a liking of him because I never got closure but the past guy started flirting with me and getting to know me but it was already too late. He knew I had a boyfriend and he still had his girlfriend but once I got married I left the department to avoid temptation and now I'm quitting the job.
I'm quitting the job because I know the past guy still likes me and it's just creating awkward tension. I don't want my husband being brought into the drama and I don't want to lose my husband. I know that the past guy will lose out because he missed his chance on me but I'm leaving the job site because it's just drama, tension stirring. I don't want to be caught up in a struggle on who wants me or likes me. I've already chosen my husband. To the past guy, I'm the woman who got away... but to my husband he keeps me :)! Do you guys think I'm doing the right thing by quitting and leaving the job site?
But I'm leaving the job site because my heart is too big. I care for so many people. And I don't want to worry about what the past guy thinks because if I do that I'm putting more focus on him than my husband. So in order to strengthen and save my marriage I'm leaving the job site :)!