Most Helpful Guy
Well first, on behalf of all men we wish more women were like you :) Most women expect to go out frequently, and of course EXPECT the man to pay for it. A lot of men get the idea that if they can't afford to take the woman out and pay they are not a man. He as had far to many of these experiences.
Just tell him you understand and you don't care about going out as much, you just want to see him hang out. Maybe you can take turns cooking for each other, or simply hanging out more as you suggested. Tell him what you told us that going out isn't THAT important to you and you want to spend time with HIM, even if you are just hanging out most of the time. Trust me he will love you for it! It is a clear sign that you love him for him and you are not a gold digger (as FAR too many women are).
If you tell him this and he is still not interested then yes, you should consider moving on.
Most Helpful Girl
Seems like he's expecting to pay for you and since he can't, he doesn't want to go on a "date". If you want, you could propose to pay for the first dinner.