The Al is not just telling you what you want to hear. It is training you to need less friction, expect more agreement, & become less capable of handling a situation where someone pushes back on you...
Sycophancy is a safety issue, & like other safety issues, it needs regulation and oversight.
A PhD student at Stanford noticed her classmates were asking Al to write their breakup texts.
So she ran a study. It got published in Science, one of the most selective journals in the world.
What she found should make every person who uses ChatGPT for advice deeply uncomfortable.