Punching above his weight?

A few of my friends have said that my boyfriend is punching above his weight with me. A few of his male friends have said it as well.

As flattered as I am I can't help but feel slightly insulted since they're basically saying I can do better and that my boyfriend is attractive. I actually think my boyfriend is pretty hot but they don't seem to think that. They just laugh when I say it. They have said he's handsome but i think that's just to make me feel better.

I'm not sure how to feel about this or how nt to let it get to me.
Anyone been in a similar situation?
Updates
+1 y
It really is more so the fact that I feel they are insulting his looks. I shouldn't care but I do, I care about him and I hate the thought of him being insulted- especially his looks as he is quite self conscious about it!
Punching above his weight?
Post Opinion