I pinched my boyfriend and he hit me back?

I want to start off with saying that this does NOT about "a man should not hit a woman" or a "feel sorry for me" post. I simply do not know what to feel about it, and want to hear someone objective's point of view to help me gather my thoughts and see the situation more clearly.

So here goes.
Me and my boyfriend were gaming yesterday and he was sitting beside me and we were talking each other as usual. He said something and I gave him a little pinch as a haha, which he did not like very much. He went back to his computer, but seconds later came back, lifted his hand and smacked me moderately hard across the left side of my face. When I said "come here" because I got scared, he got angry and said very clearly "No, fuck off."

I went downstairs and got a text message "Don't get so sulky when someone gets even with you."

The thing is tough. I don't see genders in this equation. I see action against action, and I feel that my pinch wasn't justified a burning slap across my face.
When I got home I got a text message saying that he was sorry, and that he didn't mean it. He also came over to say it in person, but it all comes back to the pinch. I've done this on other several occasions, but I have clearly misunderstood him, because when I said to him that you're laughing and playing back, I thought it was a game, so no I didn't understand that he didn't want me to stop.
He thinks it's justified, but I don't feel it is and I have trouble trusting him now. This also stems from having violent boyfriends who have undermined me, threatened me and hit me for reasons I cannot fathom. (i. e not looking good enough, making the food wrong, talking to much)
I tried telling him that I need some reassurance and that I am a bit scared now, but all I can get in return is that reassurance will come and that he doesn't know what to say. And I don't know how to make him understand that a pinch vs. slap is not fair.
What do you guys think? Should I put it behind me? I need help here.
I pinched my boyfriend and he hit me back?
Post Opinion