Why would a male say no to going into his female friend's house?

I invited my close male friend/coworker (maybe, probably something more, we're both too chicken to address it and we haven't done anything intimate) into my house to look through some stuff I have that he may want. He said he doesn't want to come inside. Well, he said it a bit nicer and less blunt than that, but yeah. He's been to my house too to pick me up and drop me off, he's just never been inside. It's weird to me that even if we are platonic, why would a friend be like "Nah sorry I'm not comin over" 😂

I did not pry into why he doesn't want to. My only theory is that it's because I live with my sibling and mother whom he has not met, but I could easily have them leave the house (I did make the mistake of not telling him that I could have them leave, but I'm not sure if that would make a difference). I only have women in my life, and all of their opinions were the same; they agreed with my theory but also said that he's too scared of ~the implications~ and that it establishes a certain level of closeness. Oh, did I mention we're also coworkers?

Extra info:
-I also have not been to his house at all, if that matters. He lives 40 minutes away and drives over to see me.
-We may be coworkers but it's minimum wage, not that serious or scandalous, but we're definitely both people who are scared to break rules (even though we aren't sure if there is one).
-Both of us have crazy levels of anxiety.

Why would a male say no to going into his female friend's house?
Post Opinion