Why is passion seen as a negative?

Why is passion seen as a negative? When someone condescendingly says to you "I know you are super passionate, but..."... as if it's a negative.

Also... when did "passion" replace the word "annoyed & aggravated".

Why is passion seen as a negative?
Post Opinion