Most Helpful Guy
The way he just dismisses your concerns about your relationship as "not good enough reasons" is definitely a bad sign. He really ought to be asking something more like why do you fell this way about such and such. If your relationship was going somewhere he would be willing to make some effort to see where you are coming from. So definitely have a talk with him about your relationship. Don't preface it by making it about breaking up from the get go, only have that as a conclusion if your talking goes bad. Try to be specific on things if you can, if he seems genuinely interested in talking and seeing what's the deal try to make it easier for him to understand you. He ought to do the same with his sentiments on your status.
If it gets to the point where you are saying we should break up and he says your reasons are not good enough, don't just give up the conversation. Instead turn it back on him. Ask him what reasons he has for staying together, and then you are at liberty to say whether or not they are good enough. If he really has nothing other than "well if we break up I can't bang you anymore", then I guess that's that.