Most Helpful Girl
I don't know if apologizing works but at least it's a try. Though its gonna be very awkward. Just apologize sincerely and that you didn't mean it. That you still like him a lot and hope you two could still hang out together or something.
No need to acknowledge further that its small, he knows it, you know it, just leave it unsaid. To make any further mention of it, would be like sprinkling salt over an open wound.
Most Helpful Guy
Your one of the minority where the size matters. I think you should just let him be. If he is dumb enough to try to contact you then you can try but I don't think I would give you the time of day again.