One time, a young ML researcher asked Master Ilya: 'Teacher, according to the formulas, if I use the same seed and same prompt with the same…

One time, a young ML researcher asked Master Ilya: "Teacher, according to the formulas, if I use the same seed and same prompt with the same weights, I will get the same results. Is my math right?" Master Ilya looked at the matmuls and said: "Probably." The young researcher replayed the same prompt with the same seed and the same weights and got different results. He went back to Master Ilya and said: "Teacher, I used the same seed, the same prompt and the same weights. Why did I get different results? Is my math wrong?" Master Ilya looked at the matmuls and said: "Probably" The young researcher cried: "Teacher, I don't understand!" Master Ilya looked at the young researcher and said: "Probably" And the young researcher was enlightened. no agent ever runs the same trace twice, because it’s not the same agent, and it’s not the same trace

LLMs are stateless (every time you reply to an LLM, you re-inject the entire conversation to a fresh inference) the purpose of memory is to …

Source: Yohei Nakajima (X) | 2026-08-29

Related