He pulled his hand away?

My crush is on with physical touch for the most part. He frequently sits with his leg pressed against mine, and generally has his arm on mine. He loves to give me high fives all the time too.
We were hanging out with some friends at dinner and he told me it was so cold in the room his fingers were freezing. He told me to touch them, since I thought the temp was fine. He didn't feel cold and I told him so. Then I briefly reached back cause he did feel a bit weird with cool fingertips and a hot palm. I was more concerned with if he was sick, than trying to touch his hands. He pulled his hand back and put it under the table. I told him he did feel a bit clammy and asked if he was feeling ok and wanted me to check his temp. He just told me to leave him alone, and went back to talking to the person on the other side of him. I don't see why he freaked out.
He pulled his hand away?
Post Opinion