← Voice corpusEdition 2026-10-10, preview.
XThread

Source item

Open original source ↗
An important kind of social network will be one where no bots whatsoever are allowed. The closest thing to this right now (besides IRL, of course) is probably a corporate Slack. But that has limited scale. There’s room for a new kind of app with no AI at all within its walls. No slop, no spam. Like Twitter’s original 140 character limit. But limited to humans. Yes, but then the second layer of defense comes into play: the anti-AIrcraft guns, namely the AI detectors. If it’s easy for a human to flag ChatGPT-generated text, it’s trivial for an algorithm. Yes. But then comes the third level of defense, which is trusted human moderators doing occasional bot-or-not flagging to train the algorithms. I think in practice you could get fairly good at this if the system was built for it, and if most humans in the network cooperated. Of course, but you can get very far by just detecting generic ChatGPT output, and perhaps also the top few models. Most people don’t change defaults. It’s like Snapchat setting norms on disappearing messages. Not perfect, but works well enough to set the culture of the app. There are many different proof-of-human mechanisms that you can layer on top of each other. They have different and hence complementary failure modes. Use as many as you can cheaply introduce. From 2FA to MFA, multi-factor authentication.
6 segments

Segment 1 · characters 0–85 · Original segment ↗

Segment 2 · characters 87–365 · Original segment ↗

Segment 3 · characters 367–563 · Original segment ↗

Segment 4 · characters 565–840 · Original segment ↗

Segment 5 · characters 842–1117 · Original segment ↗

Segment 6 · characters 1119–1358 · Original segment ↗

Quoted context

These are the quoted author’s words.

@balajis If it’s trivial for an algorithm to flag generated text, it is trivial to program a reward function for a LLM to produce undetectable text.

0Dhru ↗

@balajis problem is, humans will just type in what they should post into their llm and repeat what slop it says already seeing this with even things like tributes to people who died- friends/celebrities etc posting on socials clearly copying the slop mannerisms of 4o output for ozzy

jconorgrogan ↗

@balajis I think this will run into the “motivated bears are smarter than the laziest humans” problem and any system that detects all bots will have a high false positive rate. This is probably ok in practice because humans who talk like LLMs (i.e. lazy inference, no logic) can be safely excluded from social networks with little downside.

yishan ↗
Library as of 2026-10-22