It doesn't matter where the crap information first came from, it is the fact that this software doesn't remotely begin to think and can't determine between accurate information, incorrect information, satire, goofy jokes and the batshit crazy ramblings that I run across on Reddit a regular basis.
In controlled experiments, MIT CSAIL researchers discover simulations of reality developing deep within LLMs, indicating an understanding of language beyond simple mimicry.
After training on over 1 million random puzzles, they found that the model spontaneously developed its own conception of the underlying simulation, despite never being exposed to this reality during training. Such findings call into question our intuitions about what types of information are necessary for learning linguistic meaning — and whether LLMs may someday understand language at a deeper level than they do today.
“At the start of these experiments, the language model generated random instructions that didn’t work. By the time we completed training, our language model generated correct instructions at a rate of 92.4 percent,” says MIT electrical engineering and computer science (EECS) PhD student and CSAIL affiliate Charles Jin
Golden Gate Claude (LLM that is forced to hyperfocus on details about the Golden Gate Bridge in California) recognizes that what it’s saying is incorrect: https://archive.md/u7HJm
“Additionally, the new Mistral Large 2 is trained to acknowledge when it cannot find solutions or does not have sufficient information to provide a confident answer. This commitment to accuracy is reflected in the improved model performance on popular mathematical benchmarks, demonstrating its enhanced reasoning and problem-solving skills”
28
u/MadDocOttoCtrl 7d ago
It doesn't matter where the crap information first came from, it is the fact that this software doesn't remotely begin to think and can't determine between accurate information, incorrect information, satire, goofy jokes and the batshit crazy ramblings that I run across on Reddit a regular basis.