Why do I get weirded out when my boyfriend does this?

So whenever we're walking in public, when there's a lot of people or something, he would put his hand behind me and kinda push me to the direction he wants me to go to? The thing is that when he does it, it doesn't feel gentle so it feels like he's being controlling even though I don't think he is. Like I am pretty short compared to him, so maybe he doesn't even notice that he's kinda showing me to a direction. And I feel like it's such a small thing but whenever he does it, it makes me feel strange, cos instead of telling me he wants us to go to a certain direction, he just kinda puts his hand behind me and kinda pushes me that direction. But also maybe I feel that way cos of our height difference making me feel like he's pushing me instead of gently directing me.

Why do I get weirded out when my boyfriend does this?
Post Opinion