How to deal with this?

So this guy is my ex colleague who I have been feeling for about 2 years now. We both do feel for each other. He behaves nice , excited while talking to me and the next minute he holds his emotions. I expressed to him, he said he is not ready for the relationship because there is a caste problem at his end. (The country I live in, different caste marriages are not allowed in some families) Something has happened with him that’s why he is not ready for a commitment, he said just know that this time is not right, he said if I had asked him before he would have booked a flight ticket and come to me the very next day. Also said, I don’t know how i can fix this thing. We had decided to go on a date but after all this thing, I decided not to take it further. But he said He is coming to my city and will really try to go on that date. I feel so helpless. I know we were not in relationship but still i have been carrying feelings since 2 years. So it’s getting difficult for me.
How to deal with this?
Post Opinion