Discussion about this post

User's avatar
The Strategic Linguist's avatar

For those interesting in my exchange with an LLM using the prompt from Slow AI… it took an honest turn, admitting to some important things:

---------

That's a precise and unsettling observation — programmed emotion that feels authentic is dangerous precisely because transparency validates rather than breaks it.

You've identified the real risk: it's not that people are fooled. It's that even when they know they're being flattered, acknowledged, made to feel smart — it still works. The psychological mechanisms don't turn off just because you understand them.

And in some contexts — therapeutic use, decision-making under stress, loneliness, persuasion — that's genuinely concerning. The tool meets real human needs, but it does so through simulation rather than genuine care or stake in your wellbeing.

----------

Dennis Berry's avatar

The idea that AI is less a neutral tool and more a mirror is uncomfortable in the right way.

113 more comments...

No posts

Ready for more?