Doesn't matter the name really so long as it is spoken with true affection. In my opinion, it shouldn't be up to me what I like in this area. It is up to the person I'm with to decide how they view me in the special, secret, language that is just between the two of us. Whether it is being called, "Baby" or "Sweetie" or "Darling" it really doesn't matter.
As long as my girl would call me that name with a feeling of love, I would never have a bad feeling about it :D I used to know a guy who woud call everyone "Bobbie". I was used to it but in that case there was no liking or disliking involved, just accepting...
The only time I've been called a pet name is being called puppy, and that's because she says I'm very affectionate and attentive so she thinks it fits my personality in the relationship, and I call her kitten, I don't have anything against it, but wouldn't say I like it either, I'm perfectly fine with whatever my SO wants to call me. I also like calling her by her real name, just her first name, to show that what I'm going to say next is of importance, most people don't say their real names very often and I feel it puts more importance/meaning on what you say next when you say it.
Like you, it also depends who it's from. Also, it depends what it is. I had a girl friend call me "nordy" in college. She thought it was cute, and I would always go "what's a 'Nordy?" Her answer was "you just look like a Nordy." ... Dafq?👎🏾🤔