Would you be annoyed if your girlfriend only wears underwear to bed? How should I take my boyfriend's response?

I prefer to only wear underwear to bed even if my boyfriend is staying over. Last night it was a normal night and I got in bed like usual but he looked annoyed when he saw what I looked like. I was kind of bothered by it but got in bed anyway but once I got it he said "Dammit [my name], do you ever just wear clothes to bed?" I got really embarrassed and immediately put on some sweats and a t-shirt.
Would you be annoyed if your girlfriend only wears underwear to bed? How should I take my boyfriend's response?
Post Opinion