Discussion about this post

User's avatar
Ryan Sears, PharmD's avatar

Really interesting Sam, thank you for the game and the write-up!

I’ll argue that the game actually *did* teach me a detection method as I went, though not 100% reliable:

The model-generated responses, though eloquent and well-reasoned, lacked any sense of what I would call personal experience.

I missed 3 near the beginning then went on a hot streak to finish with 7/10. I asked myself, “does this quote have any indication that someone did, or felt, anything?”

Despite this working today, I don’t expect it to be durable. Which is the lesson I’ve taken away after reflection - that any detection methods we think might work today won’t last for long.

Thanks again for the interesting exercise!

Omer Bangash's avatar

Is it odd of me to think that I prefer the clear logical process that AI follows as compared to human beings and the possibility of written words by human beings more performative and sometimes "abstract" only for the purpose of exhibiting nuance? I wonder, is this shift "right" or "wrong"? I find myself increasingly dropping dense sentences written by theorists, researchers into AI to help me unpack words increasingly... Is that a well placed thought process?

60 more comments...

No posts

Ready for more?