Am I rude for not responding?

I always jog in the morning and before I reach my home Id walk past my neighbors house so everyday I jog and he always ask "did you jog?"
I always say yes but today its raining and cold and I need to pee I just want to go home and I was walking and he asked me again if I jog today I didn't respond. In my mind I say yes I jog but I didn't respond
Updates
+1 y
I think I just smiled at him but didn't answer him.
Am I rude for not responding?
Post Opinion