No matter what I can't lose weight?

I've adjusted my diet quite a few times for several months at a time. I've cut a lot of foods out if my diet, my appetite has lessened quite a bit, and I only eat when I'm truly hungry (save for the occasional eating a snack in front of someone to please them). I take a long walk daily and play backyard sports with an extremely active toddler (so I'm always chasing after him), and it adds up to about an hour or so. It never really seems like I lose weight, but, when I do, it takes months. (It took me about five months to lose two pounds after adjusting my diet.)
No matter what I can't lose weight?
Post Opinion