What is meant by the phrase "If the kitten didn't want me then I don't want the cat" ?

I've seen it use before but don't understand it. Kitten = little girl? Cat= Adult female
Why would a grown man want a little girl?
What is meant by the phrase "If the kitten didn't want me then I don't want the cat" ?
Post Opinion