One thing I’ve not seen anybody mention along with the rape allegations is that he was 13 when he allegedly did this. While 13 is probably old enough to know better, are we going to start holding everyone accountable for things they did as children? I think the whole world is in trouble if we start doing that. At 13 I was fist fighting my younger siblings and broke at least one of their bones. I faced no repercussions then but I have long since been extremely remorseful. Should I be cancelled for such a thing were it to come out after I became famous?
You can finetune LLMs using smaller datasets, or with RLHF (reinforcement learning from human feedback) wherein people can give ratings to responses and the model can be either “rewarded” or “penalized” based off of the ratings for a given output. This retrains the LLM to produce outputs that people prefer.