He asked me to his party (kind of)?

I went on 2 dates with this guy. We clicked and have become comfortable very quickly and have shared a lot about each other. He is a gentleman, seems very mature and is very respectful. He has his own place and he mentioned to me that he's having a party with friends next weekend. Seems odd, didn't see him as the type to party. When he was talking about it initially he didn't invite me. But later on our date it came up again and he said "you're welcome to come but I feel bad you wouldn't really know anyone". I said maybe and then carried on. When the date ended and I was leaving he said well maybe I'll see you at the party and I said yeah if you're lucky just joking with him. I'm confused do I go or not? I've never been to his place and I feel odd my first time being there during a party with a bunch of people I don't know... any thoughts?
He asked me to his party (kind of)?
Post Opinion