If I'm unattractive, then why do woman somewhat leave me alone but men want to challenge me?

I'm somewhat unattractive from what I've been told "homely" is what I'm called as

Most girls are somewhat neutral towards me with some "not soo nice" but males are mostly assholes towards me passively

They know I'm at the bottom so why am I provoked?

If I'm unattractive, then why do woman somewhat leave me alone but men want to challenge me?
Post Opinion