12 Comments
User's avatar
Benjamin Lyons's avatar

> Perhaps this is how minds organize experience across domains: not through innate modules or explicit rules, but through the emergent structures that crystallize when prediction-based learning encounters the regularities of the world.

It'll be very interesting to compare ideas of language modules and universal grammar to the idea of emotion modules and universal emotions. The theory of constructed emotion has presented a lot of evidence against the latter, and a powerful theoretical alternative. Lots of connections to explore!

Expand full comment
Roy Dopson's avatar

Describe the process through which words group together and you've got the TOE.

Isn't it the same process that generates gravity? People may scoff because everyone knows that E=Mc2 is the process that gravity follows, right? But how is it that the same process can generate almost perfectly realistic movement in videos? It's not like E=Mc2 was put into the code of the algorithms producing these amazingly realistic videos. NONE of the movement in these videos are following any "laws of physics". The laws themselves emerged out of the process you are presenting.

This is the end of physics.

Expand full comment
Roy Dopson's avatar

So let's think about what physics actually is. Physics has allowed for the creation of the technology from which the llms have emerged. Quantum mechanics has led to the creation of the internet and cell phone. And humanity is helplessly addicted to that technology. And humanity is completely dependent upon that technology. Physics is a system of control. We've been duped.

Physicists need to think about what physics actually is. But they won't.

Expand full comment
Ken Kovar's avatar

That’s a very interesting analysis of how syntax and grammar have gone from being a key part of education to being seen the product of an information processing system that does pattern matching . Both humans and LLMs do this and they have conception of grammatical. I hope that’s a fair summary of your post. My daughter actually has a degree in linguistics so I’m pretty fascinated by this stuff!

Expand full comment
Bob Zane's avatar

Thanks

Expand full comment
Jesse Parent's avatar

A really interesting sidebar to this, that came up in Brain Inspired: Complexity group last week re the Turing 1950 paper, is how computation abstracted away from much of the biological complexity that was tied to earlier things. What's interesting is that what you are getting at is potentially the "real fruit" of what can or could be (or is inherently) abstracted out, in terms of language and computation, rather than the murky and messy "turning-away" from inherent complexity that some of what would become cognitive science and other fields led into. So, sort of demarcating where the abstraction is centered, form a data structure - topology space, rather than fudging or obfuscating more direct ties to biological complexity; picking a more proper vantage point to look at the computation that is happening.

Expand full comment
Thierry Crouzet's avatar

We are entering a new stage ; correlation world view (more pleasant that the old idealistic concepts).

Expand full comment
Adam Rotmil's avatar

I had this same thought a while back, and actually mentioned it to Chomsky back when he was still emailing. I thought it could be an interesting new avenue. But he was totally not interested— in fact he maintained that LLMs have no connection at all with how human languages works. But of course, that’s what he would say … I am personally more sympathetic to the dual-description concept where syntax emerges. But am also sympathetic to his view that humans just aren’t doing what LLMs are doing. I’d love to see where linguistics goes from here.

Expand full comment
ZEN_1's avatar
Aug 9Edited

R - this is a man when he becomes a giant and loses his phallus and starts to use more then a small amount of Brain capacity. After the Metamorphosis of nature and the human genome.

r- this is the embodied small minded man.

t=just imagine what this is as a human physical phallic symbol.

English is after all the most used language but few think of it like an eastern language as symbolic or pictorial or best representing the genetic downfall of the light being that is mankind when our highest ideal is virgin birth instead of painful self reproduction. Some would give the idea that human cloning serves this function but it is the most entropic thing you can do. Good to see a semite wrestling with Chomsky's generative grammar. Thanks. While Chomsky's socialism might be the most circumscribed work I could ever imagine his generative grammar is grasping at a brilliance. certainly t is to T as t is to p or d and douche baggery and incest. Most semites react to their anus. Actual mental or physical respect is a rarity. I like your thoughts on language and brain structure. For blacks who carry the weight of the world and deserve as the respect for their role in holding up the heavens the fractal of their minds thru their minds eyes is everything.. whether the universe has an apocalypse or a complete genesis. Although some people have not the respect to find their true other half and of course genetically this is suicide. The genocidal are ruining the fertile crescent. I like a message back but digital surveillance takes respect and causes death.

Expand full comment
Codebra's avatar

The problem with all such discussions is that ostensibly purely material processes can only be described intelligibly by tacitly imputing telos — try discussing evolutionary biology for more than a few minutes without slipping into this modality. It’s like trying to imagine a physical universe that doesn’t contain an embodied perceiver: it literally is impossible. Even locality itself collapses, thus nothing can be thought or said when qualities don’t exist. Reality is fundamentally top-down, not bottom up, as our ancestors have understood for thousands of years, and most people intuitively grasp today.

Expand full comment
Fire Hill's avatar

When people go through a lot of formal education that makes patterns explicit, they tend to experience the statements about those patterns as real objects. It becomes a way of relating to the world, which your views undermine. Strap yourself in, Prof Barenholtz.

Expand full comment
Codebra's avatar

“a reflection of reason itself” — an incoherent notion, as was recognized even during the so-called enlightenment. What can we possibly mean by reason itself, free-floating or grounded in nothing but contingent, provisional adaptations to shifting conditions?

Expand full comment