Was I wrong for canceling plans?

I’ve been seeing this guy for a month
He told me he wanted to come over tonight i said okay
But it was 11 pm and he still hadn’t came so i texted him and said “I’m sorry but I’m about to go to bed it’s super late and i have to get up early” he responded back and said “ I’m leaving my house now I’m sorry… “

Then he texted back again and said “hello? Do you want me to come unless you don’t want to see me?”

Why did he say that
Was I wrong for canceling plans?
Post Opinion