My expectations is ruining my relationship?

My expectations is making me question my relationship with my boyfriend. We been together for 4 months and we work together. We don't talk to each other at work. Only sometimes in the morning and when we leave. I just recently found out there were rumors of people thinking we were just hooking up. People he knows, knows we are together, but if there are people higher up around I feel like he doesn't acknowledge me when they are around. I don't know where he lives but he claims it's because his parents and grandparents lived on the property with him in different trailers. I don't feel like I trust my judgment and keep convincing myself to stay. I don't know if it is because he been cheated on multiple times in past relationship, but the relationship feels surface level. I plan on taking to him later today about expectations and needs that I feel I need in a relationship, but I wanted to hear other people's thoughts on this.

Updates
1 y
I just decided to end things with him.
My expectations is ruining my relationship?
Post Opinion