I would probably feel a little awkward and slightly emasculated.
But in terms of what you should do is probably get the hell away from this guy. Hes probably made up so many fantasies about you that he now thinks your his girlfriend or something. Ballzy is usually good but not when its that ballzy. That would be considered sexual harassment in most books.