Discussion about this post

User's avatar
Topher Hunt's avatar

Holy s**t, thank you. This was a *fastastic* read. I can feel that I'll need to re-read it a few times for it to more fully sink in. I love your framing of the risks of LLM usage for the psychically fragile. The psychedelics comparison feels spot-on: it's about mental resilience & vulnerability, not about the substance itself.

But something bothers me: Given the fast & accelerating societal impact of AI, this argument is *really important* for a much wider audience to read and grapple with, and I think the jargon-heavy writing style holds it back from that. This idea that the AI has no interior per se so your interior becomes its "stage", causing various category inversions and agency/identity confusions -- I feel most or all of this could be expressed with just as much depth and nuance using much less exclusive vocabulary. Some phrases like "dramaturgical surfeit" give me the strong sense that *I don't belong here, this article is only meant for literary philosophy / performance studies nerds*. Some phrases feel like gratuitous word-embiggening, and prompted me to double-check that this isn't satire, especially after I learned what "pataphysical" means.

I get that the jargon and allusions used here are common in the performance studies world. I get that the terms are doing real work (maybe except for "aleatory" and "clinamen") and I get that it's harder to put a novel nuanced argument in clear concise lay-accessible terms than to start with the jargon that you're surrounded by; that's what distinguishes "jargon" from "academic peacocking" which this article clearly is not.

But I worry that the people who most need to hear this argument (AI developers, alignment researchers, psychologists facing increasing rates of AI-induced midlife crises etc, school counselors) won't be able to hear the key ideas through the sophisticated field-specific terminology. The argument being made here is too important to be locked behind that barrier.

Frederick's avatar

If you don’t know who you are, LLM will indeed meet you where you are. Wonderful work on this subject !

7 more comments...

No posts

Ready for more?