Discussion about this post

User's avatar
Rabbi Natanel Cliffstein's avatar

The implications of this are significant. It is as though Chomsky was right about innate language. Just not about spoken language. Meaning, your argument is that "language" is a manifestation of an inherently biological process. Not "culture" but brain structure. Which ought to mean that it is universal. It also suggests that we ought to be looking for the "unifying theory of language". What is true of what you might call tokenized thought. It is like the "natural" flow of experience is quantum-ized into thought tokens. Which incidentally might explain either language or our experience of it. Flow broken into discreet thought events. Brilliant!

Expand full comment
Tina Lee Forsee's avatar

Do some people have constant inner narration, like a never-ending episode of the Wonder Years? That would drive me insane. I am so glad my inner voiceover only kicks in once in a while.

I agree that language is not just a tool for communicating pre-existing thoughts. It's like the form and content conundrum where it doesn't make much sense thinking of the two as originating separately, even if they are conceptually separable once language has taken off. Thinking about the origin of language is hair-rippingly mind boggling for this reason. But even so, I would say given language, there are times when thought corrects language and vice versa. Sometimes we say things we don't mean—just a thoughtless slip up, like saying "Tuesday" instead of "Monday" for instance. I'm not seeing how structure alone can solve the problem of deciding which day of the week was really meant. And other such instances.

I agree about representation if representation amounts to pointing at particulars in the world (that much is clear from the relational nature of definitions, which I believe might be better thought of as "representing" Platonic Forms) but if natural language is nothing but structure, what causes it to change over time? What breathes life into this structure to make it move? What can it predict if it is not driven by desire, motivated by its search for new meaning?

Another way of putting it, if it were possible to leave a Shakespeare-era LLM (such as they are today) alone to do its own thing over time without our corrections, interactions, and interventions, what would it be like today? The same as when it started? Or evolved in some way? If the latter, would we still understand it? Curious to hear your thoughts.

Expand full comment
7 more comments...

No posts