this post was submitted on 12 Sep 2023
146 points (100.0% liked)

Technology

37353 readers
239 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 9 months ago (1 children)

LLMs already do quite a few things they were not designed to do.

No; they do exactly what they were designed to do, which is convert words to vectors, do math with them, and convert it back again. That we've find more utility in this use does not change their design.

What if “the internet” developed some form of self-awareness - would we know?

Uh what? Like how would it? This is just technomystical garbage. Enough data in one place and enough CPU in one place doesn't magically make that place sentient. I love it as a book idea, but this is real life.

What about feedback and ability to self-modify?

This would be a significant design divergence from what LLMs are, so I'd call those things something different.

But in any event that still would not actually give LLMs anything approaching: thoughts, feelings, or rationality. Or even the capability to understand what they were operating on. Again, they have none of those things and they aren't close to them. They are word completion algorithms.

Humans are not word completion algorithms. We have an internal existence and thought process that LLMs do not have and will never have.

Perhaps at some point we will have true artificial intelligence. But LLMs are not that, and they are not close.

[–] [email protected] 2 points 9 months ago (1 children)

No; they do exactly what they were designed to do

Are we arguing semantics here?

https://www.jasonwei.net/blog/emergence https://arxiv.org/pdf/2206.07682.pdf https://arxiv.org/pdf/2304.15004.pdf

I could be wrong, obviously, but I don't think this is as straightforward or settled as you are suggesting.

[–] [email protected] 1 points 9 months ago

Lol... come on. Your second source disagrees with your assertion:

Via all three analyses, we provide evidence that alleged emergent abilities evaporate with different metrics or with better statistics, and may not be a fundamental property of scaling AI models.

You are wrong and it is quite settled. Read more, including the very sources you're trying to recommend others read.