Depends. If you're going to the gym I really don't care but in everyday life, neither. Wear jeans or something . It just looks so much better. It's sorta like a instant turn off for me because I link that to someone who doesn't care much about their appearance. I know that's not always the case but still. It just looks so much better to see a guy neatly dressed.
For sports? Trackpants, even though I don't even like them cause for some reason I always feel a bit dorky in them. Maybe I have the wrong ones haha. For regular lounging around? Sweatpants all the way :D. I love mine haha. So comfyyyy