Want a large language model that never hallucinates? Easy: just get it to always print “I don’t know”, regardless of the input.
If you find this solution is a bit unsatisfying, you’re not alone. But it hits on a crucial trade-off with learning machines and decision-making more generally.
New post:
There are two big errors we can make with information, but one often gets forgotten