H/t @j2bryson.bsky.social
Would you like a higher dose of inaccuracy with your nice warm LLM?
Fiona Charles
Fascinating! Fine tuning LLMs (Meta Llama, OpenAI GPT ..) to produce warmer interactions decreases their accuracy on tasks w/ objective, verifiable answers (by increasing their sycophancy).
Training them to be cold does not impair accuracy in the same way.
www.nature.com/articles/s41...
