Wednesday, August 28

Geek

Daily News Stuff 28 August 2024

Stawbey Edition

Top Story

  • Why AI can't spell "strawberry".  (Tech Crunch)

    I've said before that currently popular AI models - which is to say, Large Language Models or LLMs - don't understand anything at all except language.  They're language models.  That's what they do, and it's all they do.

    Except that's not quite true, because they don't understand language in any real way either.
    The failure of large language models to understand the concepts of letters and syllables is indicative of a larger truth that we often forget: These things don’t have brains. They do not think like we do. They are not human, nor even particularly humanlike.

    Most LLMs are built on transformers, a kind of deep learning architecture. Transformer models break text into tokens, which can be full words, syllables, or letters, depending on the model.

    "LLMs are based on this transformer architecture, which notably is not actually reading text. What happens when you input a prompt is that it’s translated into an encoding," Matthew Guzdial, an AI researcher and assistant professor at the University of Alberta, told TechCrunch. "When it sees the word 'the,' it has this one encoding of what 'the' means, but it does not know about 'T,' 'H,' 'E.'"

    Typeahead with delusions of grandeur.



Tech News



Disclaimer: Or maybe crumpet.

Posted by: Pixy Misa at 06:23 PM | Comments (3) | Add Comment | Trackbacks (Suck)
Post contains 363 words, total size 4 kb.

1 Given how simple it is to thoroughly sterilize something like ink (heat to 190 degrees for 5 minutes), are we allowed to assume that this is deliberate?

Posted by: normal at Wednesday, August 28 2024 07:27 PM (bg2DR)

2 I mean, completely unlike the cadmium paint being applied to toys from a few years ago . . . who doesn't have barrels of cadmium paint sitting around in their basement these days?

Posted by: normal at Wednesday, August 28 2024 07:29 PM (bg2DR)

3 "Typeahead with delusions of grandeur."
Moderately better Markov chains.

Posted by: Rick C at Wednesday, August 28 2024 10:35 PM (MItL9)

Hide Comments | Add Comment




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




51kb generated in CPU 0.0133, elapsed 0.1021 seconds.
58 queries taking 0.093 seconds, 348 records returned.
Powered by Minx 1.1.6c-pink.