EasyEdit

> The article talks about OpenAI being unwilling to correct errors. But they just can’t. There are actually several algorithms intended to allow fact editing in LLMs: https://github.com/zjunlp/EasyEdit?tab=readme-ov-file#curren... They don't work perfectly (e.g. "Tim Cook is CEO of Apple" and "The CEO of Apple is Tim Cook" for some reason have to be edited separately) but they can deal with the most egregious cases. And, you know, maybe OpenAI can improve them further, given they're always going on about 'safety' as a reason their competitors should be regulated out of existence.

> It's not like Meta can remove these books from the training set without retraining from scratch (or at least the last checkpoint before they were used). They probably can: https://github.com/zjunlp/EasyEdit > I wonder if this is going to cause issues down the road. There are some popular Stable Diffusion models, being run in small businesses, that I am certain have CSAM in them because they have a particular 4chan model in their merging lineage. ... And yet, it hasn't blown up yet? I have no explanation, but running "illegal" weights seems more sustainable than I would expect.

A good resource on this: https://github.com/zjunlp/EasyEdit