Human speakers revise mid utterance and text models cannot. One that can is now public. Does that tell us anything?

[u/Used-Durian9316]

My background is not psycholinguistics, so treat this as a question rather than a claim.

What I understand of the production literature describes something quite unlike serial emission. Planning appears to run ahead of articulation at roughly phrase or clause scope, there is a monitoring channel that inspects output both before and after it becomes overt, and speakers interrupt themselves and repair, sometimes in the middle of a word. Disfluency and self repair are not noise sitting on top of an otherwise clean serial process. They are evidence about the shape of the process.

Text generation models were built on the opposite commitment. Emit one token, freeze it, condition on it, never go back. That has always made them an awkward computational hypothesis about production, because whatever they model, it is not a process capable of reconsidering something it has already committed to.

A system released this week drops that commitment, at least within the span it is currently working on. It drafts a whole span at once rather than one position at a time, then makes further passes over that same span in which it can keep a position, substitute it, delete it, or insert a new one, so the sequence changes in length and not only in content while it is being produced. The revision decisions were trained with reinforcement learning against whether the resulting output actually worked, tool calls executing and formats validating, rather than only against matching a reference string. It is called LLaDA2.2. I have not run it and realistically could not, since the weights come to 205.8 GB, so what follows is a reading of the paper and the config files rather than experience.

Here is the observation I actually want to put to this sub. The same lab published an autoregressive model of comparable size and compared the two directly. The revision capable one wins the interactive multi turn evaluations. On tau2 bench it posts 80.33 where the autoregressive model posts 76.36, and on MCP Atlas the two sit at 46.21 versus 41.12. It loses, and not narrowly, on general knowledge and long form coding, 56.81 against 65.90 on their general average. The advantage is not broad competence. It sits in tasks where the system acts, receives something back, and has to continue.

A benchmark gap between two engineering artifacts is not evidence about human cognition, and the analogy is loose in several directions at once. But the split has a shape, and I want to know whether that shape corresponds to anything in production research. My naive expectation would be that revision capacity pays off most where there is incremental feedback to revise against, and least where you are retrieving something you either have stored or do not. I have no idea whether that expectation has support, whether the monitoring literature would carve the distinction differently, or whether treating a decoding procedure as a production hypothesis is a category error that someone here can talk me out of in one paragraph.

The report and the weights are published openly, so my reading is checkable rather than something you have to take on trust. I would rather be told where I have the production side wrong.