They knew but didn't want to break up the family and were likely hoping their cheating mother or father stop.
I would get hurt but still, I can't imagine banning my own blood from my life and never speaking to them again. Even some parents of criminals still visit them in prison. I believe unconditional love is exactly that, unconditional even if they betray you... you just don't stop loving them.