Monday, November 11

Geek

Daily News Stuff 11 November 2024

State Of The Thing Edition

Top Story

  • Generative AI doesn't have a coherent understanding of the world. (MIT)

    No fucking shit. Thanks to the big brains at MIT for bringing us this world-shattering news.
    The researchers found that a popular type of generative AI model can provide turn-by-turn driving directions in New York City with near-perfect accuracy — without having formed an accurate internal map of the city.
    Despite the model's uncanny ability to navigate effectively, when the researchers closed some streets and added detours, its performance plummeted.
    When they dug deeper, the researchers found that the New York maps the model implicitly generated had many nonexistent streets curving between the grid and connecting far away intersections.
    It's a stochastic parrot. We know.
    This could have serious implications for generative AI models deployed in the real world, since a model that seems to be performing well in one context might break down if the task or environment slightly changes.
    Again, anyone who has used AI for more than a couple of minutes is fully aware of this.
    "We needed test beds where we know what the world model is. Now, we can rigorously think about what it means to recover that world model," Vafa explains.
    It doesn't have one.
    The researchers demonstrated the implications of this by adding detours to the map of New York City, which caused all the navigation models to fail.
    Yep.

    Years ago, engineers tried using genetic algorithms to optimise a particular electronic circuit to use fewer transistors. They got a result that worked, but nobody could explain how.

    Turned out it worked by the coincidental passive properties of the circuit, and not due to the transistors. The moment you made the slightest change to the operating conditions, it failed entirely.


Disclaimer: Unless I have to work late. If I have to work late, which I usually do...

Posted by: Pixy Misa at 06:52 PM | Comments (4) | Add Comment | Trackbacks (Suck)
Post contains 310 words, total size 2 kb.

1 Pixy, looks like the page formatting's gone wonky.  I'm seeing the right column pushed too far to the left (I assume this isn't a political thing), and posts on the main page under the newest one displaying much larger fonts than normal.

Posted by: Rick C at Tuesday, November 12 2024 01:11 AM (pnaK4)

2 Oops.

Posted by: Pixy Misa at Tuesday, November 12 2024 07:53 AM (PiXy!)

3 Looking good again!

Posted by: Rick C at Tuesday, November 12 2024 09:13 AM (pnaK4)

4 if university folks, generally, find themselves doing business in a wildly different environment from the last time their habits had pushback by and oversight from outsiders, they may double down on stupid appeals to 'authority', and trash any residual trust even faster. (This is not me particularly salty at AI boondoggles, I just kinda really hate aspects of modern universities.)

Posted by: PatBuckman at Tuesday, November 12 2024 09:58 AM (rcPLc)

Hide Comments | Add Comment




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




50kb generated in CPU 0.0304, elapsed 0.1122 seconds.
58 queries taking 0.1039 seconds, 351 records returned.
Powered by Minx 1.1.6c-pink.