Why do people assume your job is your potential?

That the only reason you stay at your job is cause you're incapable of getting one that pays more.
Why do people assume your job is your potential?
Post Opinion