Why do coworkers seem bothered when I say I don’t want to move up?

Whenever I get around to seeing a few people at work which I don't get to see every day. Some not all ask me if I am going to move up. I told one guy no today and he looked a little bothered. This isn't the first time I felt people question me. This company is huge and the more you move up the ladder the more stress you seem to get, my question is why do people care what someone chooses to do if they want to move up or not..

Why do coworkers seem bothered when I say I don’t want to move up?
Post Opinion