It depends on the mistake, but if someone acknowledges they were wrong and genuinely shows they've changed, I don't think people should hold it over them forever. Otherwise, what's the point of trying to do better? It ultimately depends on the mistake.
Hey so when you very publicly make a mistake, you will continue paying for it.
Cool that you no longer think/feel/act that way anymore, genuinely. But part of taking accountability for your past actions is understanding that you will continue to come under fire for them.