There could be MANY different reasons why he didn't try to hug or kiss you on the first date. I'm thinking he's the shy type and / or doesn't have experience with a lot of gals. Are you sure it was a "date"?
Give him some time. I usually don't kiss on a first date, but that's personal preference (it lets anticipation build and also allows us to form a connection beyond the physical before that element is introduced). Although I do try and give a hug goodbye. Your guy is almost definitely a little scared, but he'll open up if you give him the chance
any date can be emotionally tough on someone plus he's shy it's a slam dunk. he just wasn't comfortable enough to make a move yet and expecially now a days you don't wanna rub a girl the wrong way. lastly he asked you out again it's all fine just keep on doing what your doing.
He's shy and intimidated. I was too scared to do that stuff when I was young too. Then later the girl I dated told me how badly she wanted me to and I was like "wow I wish I had known I was too scared"