He asked was I with other men?

guy I’m seeing (we aren’t official ) and i were texting and i was telling him how i hadn’t been home for a few days but before i could tell him why he asked “damn where have you been your man’s house?🤣 “

And i said “well that’s a weird question you must not be my boo then if you’re saying that”
Then he said “i was joking but what could i say if you were 👀😂”

What does he mean by that before i respond
He asked was I with other men?
Post Opinion