I didn't "give it up" to him for casuals like casual sex or hook ups. He has said multiple times that he likes a challenge and hasn't backed out from not maintaining constant contact with me.
So he sees me as a challenge? What are the odds that he's actually interested in me now or simply as a challenge?