Was this my fault?

I'm gonna make this post as short as possible. I used to be involved in a friends with benefits situation with this guy. Don't judge me. I learned my lesson lol. But, he recently got mad at me and grabbed me by my shirt and pushed me. All I did was tell him to drive me back to where I was because I didn't wanna stay with him anymore. He told me no and tried to leave me stranded so I followed behind him and told me to take me home. I didn't hit him or anything. Was I wrong? was I being annoying? Wasn't that a sign of abuse? I definitely left him alone after that.

Was this my fault?
Post Opinion