Should re-election be a punishment for bad presidents only?

like if the president is doing poorly in his or her first 4 years should they have to face re-election as punishment, and if they're doing great in their first 4 years should they not have to face re-election in their first 4 years?
Should re-election be a punishment for bad presidents only?
Post Opinion