I don’t think it’s that “three fifths” is the only bad part per se, it just gets referenced a lot because it is a really indefensible example of how enslaved people were considered less than a person. So much so that here it is codified as a fraction of a person. Very in your face sort of language.