What did a guy who I have an open relationship with mean when he said this?

I told a man I'm close with that I appreciate my off time: He said " save all that conversation for the men you date" I'm not that man. And was it rude? What should I have said to him?
What did a guy who I have an open relationship with mean when he said this?
Post Opinion