Most Helpful Guy
I think you know the answer to your question by asking this. If everytime you can't and he throws your insecurities in your face, (the things he knows will hurt you the most) then he is abusive and you do not want him anyways. And he also sounds to me like he wants to use you for sex and calls whenever he's horny and for you to just come to him. Why do you always have to go?
My advice: Move on there's billions of people in this world. The man of your dreams will be in your life before you know it just give it time. And I promise you Mr. Right won't mentally abuse you and use you for sex.
Most Helpful Girl
Dump him. If he's psychologically abusive and doesn't want to respect your insecurities you need to find someone who won't do messed up shit like that. If your partner EVER does something you don't like and you don't address the problem, that person will continue, which always leads to an unhealthy relationship.