What does it mean if a guy says he doesn't hate you, but he wants to?

I had a secret friends with benefits with a guy for 6 months, I ended up liking him and he new. Sometimes he said he liked me other times he said he was using me. I stopped the friends with benefits after realizing it wasn't going anywhere. Then his younger brother moved back to town. He made moves on me and honestly i liked him a lot and it wasn't to get back at his brother. The brother i had a friends with benefits (older bother) became very hateful towards me so i eventually told the brother i was talking to about our past. He was fine with it. He even told me that his brother was not a fan of mine and i shouldn't try to talk to him. On one occasion after the older brother was telling me he hated me, they got in a bit of an argument. Shortly after that, out of know where the one i was talking to got distant. He no longer texted me all the time, never tried to hang out with me. One night at the bar he only talked to me a few times but didn't act as if anything was wrong. He acted like he never stopped texting me, but still acted odd. The older one talked to me more that night then the one i was "talking" to. By the end of the night the one i was talking to was passed out and I left. The older brother then started texting me and asked me to back road. Stupidly i said yes, but only because i needed to know why he hated me. He didn't want a relationship, he made it clear so i finally move on after 6 months of being used i finally found someone i liked who liked me back. What right does he have to hate me? When i confronted him he said, "I dont hate you, but i want to". I dont understand what he meant?
What does it mean if a guy says he doesn't hate you, but he wants to?
Post Opinion