Most Helpful Guy
This is not immediately a "deal breaker"... You need to get to the root of the issue, soon.
Fighting is a sign of Passion, albeit, poorly expressed. Trust me, if a man was not interested in you "at all" you would be that fence in the picture, that hasn't been mended for 50 years... left alone, no attention.
This is clearly not this man. Give YOURSELF the benefit of the doubt. You two may just need to take baby steps towards each other.
I have been married forever, trust me, I have had some Barn Burners. This sounds like one of them. Be a be Girl, and ask your guy to be a real Man. You might be surprised to learn (SOME) men will respond to this.