Personally I think it depends on the allegations/ what they did.
For example I don't purposefully listen to Micheal Jackson but I wouldn't go out of my way to avoid listening to him. I would never buy JK Rowlings books or purchase the movies, but I still watch the copies of HP that I already have.
I refuse to watch anything to do with Louis CK or Bill Crosby.
I'll enjoy Marilyn Manson if it comes on but don't intentionally put it on.