文字是意识的副产品。对大语言模型而言,则恰恰相反。
Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

原始链接: https://ranpara.net/posts/words-are-a-byproduct-of-consciousness/

人类与大语言模型(LLM)的根本区别在于思维的方向:人类源于意识,以语言为“外壳”来表达内在思想;而大语言模型则以语言为源头,意义仅是其产生的副产品。 我们正处于一个堪比印刷术或互联网发明的重要转折点。随着大语言模型的效率不断提升,执行的门槛已然消失;在这个人人皆可创造的时代,“好点子”的价值正在减弱。成功不再属于最聪明的人,而属于在人工智能生成内容所带来的喧嚣中,依然能保持定力与持续产出的人。 尽管编程和信息搜集正逐渐成为商品化技能,但像工程师一样思考的能力仍是人类独有的优势。尽管有人担忧人工智能生成的数据会降低未来模型的质量,但这种转变也提供了前所未有的创造潜力。我们正迈向一个人类贡献的定义从“写作”转向“思考”的未来。与其恐惧这种演变,我们更应拥抱大语言模型所赋能的全新解决问题与创造的方式。

这段 Hacker News 讨论探讨了人类意识与大语言模型(LLM)之间的哲学差异。Devarsh Ranpara 提出的核心观点认为,对于人类而言,意识先于语言:我们先产生内在的想法或愿望,然后再将其“包裹”在语言中作为次要的表达界面。 参与者将此与大语言模型进行了对比,指出大语言模型是在没有生活经验或意图作为基础的情况下,通过统计学方式生成词汇。一位用户引用圣奥古斯丁的话指出,人类学习语言具有投机性,植根于社会交往以及交流已有愿望的需求。其他评论者则提出了更细致的观点,认为虽然人类的部分言论是意识思维的表达,但我们有时本身就像是“随机鹦鹉”。 这场讨论最终触及了一个令人不安的可能性:曾经被视为神圣的人类认知,或许可以被还原为生物性的模式匹配。归根结底,这场争论的焦点在于,语言究竟是意识思维的深刻产物,还是仅仅作为一种功能性的、甚至是自动化的工具,用于应对现实。
相关文章

原文

Stop for one second and ask yourself a simple question. Where do your words come from?

When you speak, what comes first, the idea or the word? Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it? I think we all do. The word is never the start. The word is just the skin. The idea, the consciousness, is the thing sitting under it.

Now ask the same question about an LLM. For an LLM, it is exactly the opposite. And I think this one small difference explains almost everything about where we are heading. (Remember this, it will come in handy later.)

We are standing at an inflection point right now. History is full of these points, and every single one pushed the human race forward.

Long back, Homo sapiens learned to speak and think. The real magic was not the sound itself. It was that we could hold abstract ideas in our head, things like law, justice, and philosophy. That is what made us stand out from every other animal. Different groups of humans made different sounds for the same ideas, and we call these sounds languages.

Then we learned to write. Then came ink, paper, and the printing press. Suddenly proximity was not a problem anymore. Something written by a person in India could be read by a person in Europe, and that knowledge travelled without the human travelling. Felt like magic, no?

But we still had real world problems, like logistics. Moving a thing from point A to point B was hard. Still, newspapers, books, and art kept feeding the human brain, and ideas kept coming. In that era, ideas were the gold. Execution was extremely difficult, but a good idea at least gave you a direction to move in.

Then came the computer, a machine that could do maths, and again it felt like magic. But it was slow, noisy, sitting inside an air conditioned room, eating millions of dollars and giving back very little. Does this ring a bell? Hold that thought.

Then people connected computers to share information, and we got the internet. Now information could move almost instantly. The WWW arrived, then social media. At some point someone asked a simple question: why should only big businesses enjoy all of this? Why not normal people like us? And we got the personal computer. (Thank you, Steve Jobs.)

After that came phones with cameras, so now we could talk, listen, and see. Voice, image, video, all together. And quietly, in the background, we were building a giant mountain of data, while computers were getting more and more power efficient.

Fast forward to 2017. A team at Google built something called the Transformer, and it changed the world. We got LLMs.

So what is an LLM, really? At its core, it is a big pile of words that predicts the next word, using some maths the computers figured out.

Now come back to my first question. An LLM predicts the next word based on all the words before it. That is the whole story. There is no idea sitting underneath. The words are everything. For an LLM, words are the source, and any meaning is just a byproduct that falls out by accident.

But your brain works the other way around. First there is a concept, a feeling, an image, and then the words come out to describe it. (At least, this is how I feel my own brain working.) For us, words are the byproduct of consciousness. For the LLM, it is completely backwards. And this is the part I keep coming back to. I do not think that direction can be replicated.

People say LLMs are too expensive and too hungry for power. True. But remember the early computers? They were exactly the same, and within roughly three quarters of a century they became small enough to sit in your pocket. LLMs will also become efficient. The difference is, this time it will not take seventy five years. All of human knowledge is now sitting inside a small chat box. We just need a few smart humans who can imagine.

And here is the big shift. With LLMs, everyone is a builder now. Honestly, is there any idea left that does not already have an app? Earlier, ideas were powerful because they showed the path, and execution was the hard wall. Today everyone has the information, and everyone can execute too. So what is actually left? It comes down to two things: consistency, and noise. Yes, noise.

The internet today is completely flooded. Finding something good, or doing real marketing, is almost impossible. So I believe the people who win from here are the ones who are creative in their marketing and, more importantly, consistent. Not the smartest one. The most consistent one.

This also makes me think about jobs. Are software engineers safe? I think yes. (Developers, I am honestly not so sure.) Because engineering is thinking, and coding is only writing. Now that LLMs are everywhere, anyone can code anything. But not everyone can think like an engineer. And let us be honest, coding was never the hard part anyway. Just think about the algorithm behind Google Maps. It gives you directions from New York to San Francisco with almost 100 percent accuracy, in a few seconds, while calculating billions of intersections and live traffic at the same time! The code is the easy part. That kind of thinking is the real thing.

But one thing scares me a little. What if LLMs slowly become worse? Think about it. Everything written before 2017 was made by humans. After 2017, LLMs started filling the open web with their own content. And now that same content is being fed back to train the next LLMs. An LLM can give you perfect grammar and a rich vocabulary, but it can quietly lose the real context. Right now the share of AI content is small. But what happens when it keeps growing?

Still, I am not pessimistic. AI is opening a completely new way of thinking, and with it, new opportunities that I cannot even predict yet. I feel lucky, actually. I have seen Windows 98, the Nokia 3315, the iPhone, the internet, M series MacBooks, and now ChatGPT, all in one lifetime.

So I am excited. I really want to see how humans will think in the coming years.

Are you?

联系我们 contact @ memedata.com