Is his urge to be alone once in a while red flag?

9 months dating, and every now and then he goes to his apartment in his home town to be alone. Sometimes he asks me to tag along but mostly he'd want to go alone.

Makes me feel unstable with him because I wouldn't be happy having a family with a man that would occasionally leave when he needs to have alone nights unless it's going away for a good reason.

Am I right or wrong?
Is his urge to be alone once in a while red flag?
Post Opinion