A surprise for my boyfriend with a total let down from him?

I went to his home to wait for him as a surprise. After an hour there, I decided to call him and I told him I was here at his home. He responded with “Why?”… I told him I wanted to surprise you… then he said “it’s not a problem but don’t ever do that again please”
So, my question is should I continue to wait or should I go home now? My feelings are hurt but I don’t know how to deal with it … any advice I need some serious advice
Updates
1 y
Thanks to all of y’all for the amazing responses… I ended up staying. I apologized to him for not being respectful of his privacy. He told me it wasn’t a problem he just likes to know first. I was able to cope better with all y’all’s feedback.
A surprise for my boyfriend with a total let down from him?
Post Opinion