I really like this guy but his brother likes ME!

I really like this guy and I met him through his brother. His brother really likes me, but I really like his brother. I finally got the nerve to tell him how I felt and he told me he liked me and I asked him if I was wasting my time and he told me no. He just broke up with his girlfriend a week ago and said he doesn't want to be with her but she can't let go. If he says I'm not wasting my time why is it like pulling teeth from him to get him to talk to me? When he does talk to me its very minimal. Help please, do I leave him alone or do I keep trying I don't know what to do?