Most Helpful Guy
Well then, it sounds like he's not the guy for you or for any woman with a sense of self respect and a brain.
If you've known one another for a long time and have been comfortable out in public, then I could see a scenario like that probably being okay. But, if you do not know this guy very well and you're uncomfortable with going to a relative stranger's apartment, then you have every right to say no and he has every right to go eat shit and pout to someone else.
The fact he got angry is a red flag in itself, so you should be happy you stood your ground and said no.
Most Helpful Girl
Protect yourself over trying to make sure you don't hurt that guy's feelings. That is not normal, and if he doesn't have a reasonable explanation as to why he wants that and is pissed off that you would be somewhere public on a first date then that's way too creepy. Stay away.