Saturday, December 28

Geek

Daily News Stuff 28 December 2024

Topological Maps Edition

Top Story

  • A new Chinese AI called DeepSeek V3 outperforms ChatGPT on standard tests while costing a small fraction of the price to train because - apparently - the developers stole the ChatGPT training data.  (Tech Crunch)

    The evidence for this is that the model is convinced it is ChatGPT.
    "Obviously, the model is seeing raw responses from ChatGPT at some point, but it’s not clear where that is," Mike Cook, a research fellow at King's College London specializing in AI, told TechCrunch. "It could be 'accidental'… but unfortunately, we have seen instances of people directly training their models on the outputs of other models to try and piggyback off their knowledge."

    Cook noted that the practice of training models on outputs from rival AI systems can be "very bad" for model quality, because it can lead to hallucinations and misleading answers like the above. "Like taking a photocopy of a photocopy, we lose more and more information and connection to reality," Cook said.

    Training AIs on AI-generated data leads to insanity in as little as three generations.  It can improve results on specific standard tests because it biases the AI very, very heavily towards those tests, throwing everything else out the window.  After setting it on fire.



Tech News



Disclaimer: I have a cold.  It is the worst thing to ever happen to anyone.

Posted by: Pixy Misa at 05:15 PM | Comments (9) | Add Comment | Trackbacks (Suck)
Post contains 424 words, total size 4 kb.

1 Minecraft on COBOL - just because you can do something doesn't mean you should.  Deepseek - has anyone thrown Mr. Mayer's name at it to see what happens?

Posted by: Frank at Saturday, December 28 2024 10:26 PM (+i6Xr)

2 "A 9th US phone company"
Well, how many could possibly be left?  And!  Why wouldn't I just go ahead an assume they all have at this point, & we're just not being told (yet)?

Posted by: normal at Saturday, December 28 2024 10:38 PM (bg2DR)

3 Frank, probably someone wanted to play it on the obsolete government mainframe they're required to maintain in case any actual work comes in.

Posted by: Mauser at Sunday, December 29 2024 02:36 AM (QE7eq)

4 MNT:  I have a Radxa Rock 5B, which uses the RK3588, running Linux, and it's performance is not too bad.

Posted by: Rick C at Sunday, December 29 2024 02:40 AM (NEIix)

5 How?
A German defense firm is researching adding AI to explosive kamikazi drones in hopes of getting Ukraine contracts.
With not a thought of how bad this idea is.

Posted by: Kristophr at Sunday, December 29 2024 06:48 AM (iYdVP)

6 The MNT Reform looks interesting.  If it had a larger screen, I would be very interested.

Posted by: cxt217 at Sunday, December 29 2024 08:39 AM (ZLF73)

7 I can answer the question of how. Magic. The academics arriving at that conclusion have already admitted magic in their models as a possible explanation, give at least lip service to the idea that symbol magic fixes real world problems, and their model of human extinction contains a great deal of magical thinking.

Posted by: PatBuckman at Sunday, December 29 2024 08:40 AM (rcPLc)

8 Back in my undergrad days, my weekend job was customizing reports for a school accounting system running on an NCR mini with a COBOL interpreter. At the same time, I was enrolled in a group-project class where we were writing the usual machine-code simulator, assembler, linker/loader, etc.

I got bored one night and wrote the entire project on my own. When I met up with my (lazy-ass jerkwad) group, they complained that they were having trouble getting the code to work, and asked if they could use mine. "No," I gleefully answered, "mine's in COBOL." (and, seriously, the textbook practically handed you the silly thing, so no excuse)

(I was also taking an actual COBOL class that semester, and the TA and I kept butting heads on coding style; mine was learned from a working Production system written to be maintained, his was "academic best practice")

-j

Posted by: J Greely at Sunday, December 29 2024 09:15 AM (oJgNG)

9 Took a summer class that involved using COBOL to manipulate ISAM files.  We wrote one new(fairly small and straightforward) program a week.  To buff my resume a couple of years later I audited the same class during a full semester.  There were only three programs to write, and the instructor handed out a shell for each that already had about two-thirds of the coding.  Me: brain vacation time.  Rest of class: this is TOO hard!!!

Posted by: Frank at Sunday, December 29 2024 05:12 PM (+i6Xr)

Hide Comments | Add Comment




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




55kb generated in CPU 0.0489, elapsed 0.1321 seconds.
58 queries taking 0.1238 seconds, 356 records returned.
Powered by Minx 1.1.6c-pink.