Should it bother me that my boyfriend didn't invite me?

My boyfriend and I started out as friends and I use to hang out and party with him and all his friends and we all got along great. His friends never brought out their wives or girlfriends and would often complain about them. I use to always find it weird how all of them seemed to be with people they didn't like hanging out with. Well now two years later I feel like my boyfriend may feel the same way. We've been dating now for two years living together for over a year and when he goes out with the guys I don't normally go anymore. He says he needs "guy time" which I understand, but I guess its hard because I use to be included in this guy time and now I'm not.

The other night was our one night off together we are shift workers so often don't see a lot of each other and I was under the impression we had plans to do something together. He came home from work and said he was going to a friends place for drinks and a BBQ. He didn't invite me to come along so I asked if he cared if I came and he said it didn't matter to him. I later saw a text he had sent to a friend that was already at the BBQ asking "Is it girl friendly there? The girlfriend is bugging me to come" ... should I say something or be worried about that comment? Should I be bothered that when he hangs out with his friends now he doesn't really ever seem to want me to come out too? I feel pretty hurt by the text he sent and that he doesn't want me around when he's with his friends.
Should it bother me that my boyfriend didn't invite me?
Post Opinion