You do you, it's your life. I don't see how it makes you slutty or a whore if you don't do anything sexual. If a guy is willing to pay you just to have a normal conversation, then I don't see the harm in it. It's his money and he can spend it however he wants, and it's your time and you can do whatever you want with it.
Adults can do whatever they want if it's mutual and everyone's agreeing on whatever they want to do. Do what you wanna do, if someone wants to call someone a hoe for it they can but sugar daddies know the deal and are happy to do it.