From Avram Piltch of The Register: “Google’s AI cites web pages written by AI”. Cory Doctorow @pluralistic@mamot.fr calls this the “Habsburg AI”.

This is one of the biggest reasons I believe LLM technology has hit it’s limit: the Internet, the source of it’s knowledge, it’s training data set, is degrading. I wrote about it in one of my blog posts.

Honestly I was expecting the limit to be hit another 5 years from now, but it turns out that simply scaling up LLMs does not cause it to simulate real human thinking, especially if it causes it’s own source of training data to lose quality over time.

#tech #software #AI #LLMs #LLM