Friend/ex calls me dumb?

My ex and I broke up 2 years ago because I found out he was still involved with his ex I contacted her after I found out to get more answers. While we were talking she told me that he came to her a few days before I reached out and told her all of my personal business and he told her how dumb and retarted I was. I cut things off with him but we are now on good terms and we are trying to be friends. I recently moved and he came over to help me unpack while he was helping me I told him I had someone coming to my home to pick up an old dresser I was selling. he said I was dumb for giving him my address and that just reminded me of what he said about me in the past and immediately I was pissed off at him. Now he’s saying I’m over reacting and he didn’t mean it like that he was just joking. I plan on cutting him off for this but I would like someone else’s perspective on this am I overreacting and should I just take this as a joke? Also this is not the first time he has said this since we started talking again but it’s the first time where he has sounded like he wasn’t joking
Friend/ex calls me dumb?
Post Opinion