In some cases (this being a prime example) it certainly is, much like how a teacher can be wrongly accused of pedophilia but still have their career ruined.
Not sure what you can do to prevent this though - on the flip side it would seem that Bill Cosby is guilty of his charges, and the only reason those allegations went anywhere is because multiple people were saying the same thing.