Fear of confrontation am I a wuss?

So I’m a very anxious person and confrontation scares me and make me want to hide away. It’s so bad that some of my ex’s would get angry at me for being so scared and not arguing back. Calling me a wuss or a cry baby.
Am I in the wrong here? Should I try toughening up as they say and not be such a doormat to others?

I honestly don’t know how to be more aggressive and assertive. It’s almost like my very nature is telling me to stay quiet and people won’t bother you.
Fear of confrontation am I a wuss?
Post Opinion