Any advice for an awkward relationship situation?

I recently shared my feelings with a guy I've known for a few months and developed feelings for. At first they said no because they're related to my recent ex and because the age gap (22 years) but last weekend they said they're interested. My ex doesn't have a close or good relationship with this person and obviously doesn't know that I'm seeing them, but said he knows this person is dating bc he heard him getting sucked in his bedroom Thursday night.

I know my ex would freak out when/if they found out I'm the one seeing them, and I feel like in the long run, it might not last. But this guy is really great guy and I like making him feel good. He makes me feel happy - like I'm actually worthwhile and appreciated and they make me laugh. I'm really not ready to have sex with him yet but when/if that happens, that's going to add a whole new level of worries.

Do I just treat this like a quick fling or is it foolish to hope it works out? My ex wasn't great to me, made fun of my height (I'm 4' 11), called me stupid multiple times a day and wouldn't let me see any of my friends and I had enough but am I just going too far?

Updates
+1 y
I’m definitely happy, and very satisfied. I feel like I made the right choice regardless of what some say. And neither of us feel weird about the age issue or some peoples apparent race issues.
Any advice for an awkward relationship situation?
Post Opinion