Is this a sign to end my relationship?

So I wouldn't say my boyfriend and I ever argued, he is very gentle, kind and calm, however we have had our differences especially with me having difficulty sometimes. He is quiet, kept to himself mostly that is just the way he is but sometimes he is too distant and it comes off as him not caring when I am having a serious talk so in order to get his attention I ask him questions but also because I am an over thinker and I have had trouble in the past. When I asked him if he would ever cheat on me he said no. When I told him "I feel like you're the kind of the guy that would do something if a girl were to pop her tits out you would even if you were in a relationship or not" to which he said "If that's what you think than I'll just pack my bags and leave" so is that him being upset because I asked him this and I'm being rediciulos? Or is he upset because I'm right? He hasn't had too many relationships let alone a serious one. I'm the first serious relationship and longest he has been with. We have known each other since 10(he gave me a diamond bracelet at that age) but we did have 10 years apart before talking/seeing each other again. Am I just crazy and self sabotaging my relationship? Or is this a sign I should end it? I myself am not too experienced with relationships either and we both grew up not seeing what a healthy relationship looks like.

Is this a sign to end my relationship?
Post Opinion