Is it bad to only hang out with someone when you have free time?

Whenever I hang out with this guy it’s whenever I have free time like days I’m off. I don’t like to hang out with him before work or the night before I have to get up early around 5am. He gets up upset when I only want to hang out during those days.

Is it bad to only hang out with someone when you have free time?
Post Opinion