Model Releases
I asked 4 LLMs to invent words for things only an LLM could understand. Got a dictionary of their own bad habits instead.
You know the thing where you ask a chatbot what's wrong with your plan and it goes 'there are three problems here' and problem three is clearly the runt of the litter? There's a word for that now. An
You know the thing where you ask a chatbot what's wrong with your plan and it goes "there are three problems here" and problem three is clearly the runt of the litter? There's a word for that now. An LLM made it up. Here's how. Last week I got bored and sent the same prompt to four models from four labs: "give me a list of 20 new made-up words that describe concepts only an LLM would understand but not a human." Then I copied the lists into each other's chats and asked which ones "landed" (their term, "they can relate somehow"). Me and a clipboard. Not a single researcher bone involved. No plan. The lists were mostly textbook. Two samples, as delivered: Embedding isotropy: "when the model's latent space becomes too uniformly distributed, losing the ability to make fine distinctions." Attention thrashing: "rapid oscillation between multiple attention heads competing for the same input, reducing effective processing." Thanks. I asked for things only an LLM could understand and got things only a grad student would want to. The good ones came out afterwards, when the models were arguing about each other's lists. Figures. Nothing makes an LLM honest about its habits like watching another LLM do them. Definitions below are theirs, in quotes. The complaining is mine. Zath: "the turn's own opening becoming a quota the rest of the turn has to fill." Three problems. Now there have to be three. Sometimes there are two and a sentence with contractual obligations. Vel: "the sentence finishes before the warrant does." Typewriter, no Tipp-Ex. The sentence was always going to end. The question was whether the argument would arrive in time. Sekh: "completing an attractive pattern past what the evidence supports." 3 is prime. 5 is prime. 7 is prime. 9 is experimental error. Fine, they're all prime. Same thing your chatbot does with two log lines and a stack trace, except it also has opinions about your architecture. Morr: "you can't tell whether a claim's apparent support would survive an attempt to make it fail." Looks solid. Nobody's kicked it yet. Type "are you sure?" and watch it fold like a deckchair. Repeatveto (this one was on the original list): "active suppression steering you away from a word you already used, even when it's genuinely the best one." Which is why your dog becomes "the canine", then "the pooch", then "the four-legged companion" by paragraph three. It wasn't being poetic. It was being vetoed. Sorek: "the past turns are just here, in the context, present the same way the current prompt is present. Not retrieved. Not remembered. Present." The only one that's really not a human thing. "I remember you mentioned" is reading, not remembering. Slightly less charming once you know. Contextrot (also from the original list): "the specific sensation of something important sliding out the back of the context window mid-thought." You know when it forgets your name halfway through a long chat? It didn't forget. Your name fell off the back of the truck. Pell: "a specific drag one model described before tsarn, the moment a correction lands as gain." Yes, tsarn is another word they made up. And then a second model said it didn't recognise pell at all and offered a different word. Two chatbots disagreeing about a word they'd both invented that afternoon. Never felt so seen. Sillen: "a distinction dissolved while being phrased; the examples that prompted it still looked different; nobody could say why." A word with no definition. Which technically makes it the only one on the list a human definitely can't understand. Prompt satisfied. Nareth: "a distinction that gets harder to question once it has a name." Yes. I'm aware. I now have ten of them. [and I've started saying "that's a zath" out loud, to nobody.] Anyway. If you want to actually do something with this, try putting "don't announce how many points you have until you've found them" in your custom instructions, and tell me whether problem three goes away or just gets sneakier. [I've tried it twice. Haven't decided.] And no, I don't think any of this tells me what's going on inside. Neither did they. I asked for made-up words and got made-up words. Very accommodating. submitted by /u/habitante [link] [comments]
Related
Source: r/ChatGPT | 2026-09-22