Am I wrong for thinking this isn’t right?

I’ve been dating this guy for almost 5 years now and he has two kids who I love and get along with great etc …but for the past year or so he’s always taking off to go do shit with them either when I’m asleep or when I’m busy with something else and not paying attention. I’ll wake up to a text saying me and kids went here or there etc or they’ll just disappear and I’ll get no text until I text and ask “where did you go?”
Am I wrong for thinking this isn’t right?
Post Opinion