Am I rude for telling our neighbor to go home?

Its 10pm and Im so sleepy and need to wake up early so I said he can go home now?
Am I rude for telling our neighbor to go home?
Post Opinion