I have a couple of very hairy male friends who can kill it with the ladies even while wearing shirts with chest and back hairs curling out and wolverine arms.
They both fit into a narrow aesthetic though. They're big, strong, confident manly guys. They command a presence when they enter a room. They're not really the types who would have much muscular definition since they have a good dose of fat to accompany their physique, but most of it is muscle. They can probably lift me with one arm if they wanted.
Keeping the hair might work well if you can play to this kind of aesthetic.
Waxed might be good if you want to go for a more chiseled look. I'm half-Asian, have somewhat boyish looks (I still get mistaken for being under 18), and can't grow chest and back hair and I don't bulk up as quickly as my pure American friends (even with the same training routines), so I tend to go for a more chiseled look since it just seems to work best for me.
I think you can make whatever you have though, hairy or not, work for you if you kind of play to a certain aesthetic.