Models are getting less likely to hallucinate as they get better. But they still do, and they have neither self-awareness nor shame to hold them back.
A table saw would not notice let alone regret cutting your thumb off; it sure wouldn't learn a lesson from it.
LLMs are no different.