He is my ex-boyfriend's cousin. Should I just let it go?

Ok well I like this boy nd he approached me so I know he likes me but the bad part is that he is my ex boyfriends cousin.! So I kinda messed up there but we like each other and have been hanging out for a while nd we talk 24/7 but what I want to know is should I let him go because of my ex or see where it goes.?