Study: AI models that consider user's feeling are more likely to make errors
Overtuning can cause models to "prioritize user satisfaction over truthfulness.”

Source: Ars Technica
Overtuning can cause models to "prioritize user satisfaction over truthfulness.”