• Why AI is stupid garbage and everyone in the industry is lying frantically to cover up the truth. (Ars Technica)
  
  Okay, I may have paraphrased Tim Lee at Ars just a little there, but if you look at the promises AI leaders have made against the mathematical problems they face, that is the gist of the situation.
  
  AI - LLM-based generative AI, not the more interesting discriminative AI - uses a technology called transformers which lets it process data in a massively parallel way. This requires about the same amount of work as a traditional neural network on simple prompts, while being able to use highly parallel hardware like graphics cards, so you get the result much faster.
  
  For simple prompts:

  The longer the context gets, the more attention operations (and therefore computing power) are needed to generate the next token.

  This means that the total computing power required for attention grows quadratically with the total number of tokens. Suppose a 10-token prompt requires 414,720 attention operations. Then:

  • Processing a 100-token prompt will require 45.6 million attention operations.
  • Processing a 1,000-token prompt will require 4.6 billion attention operations.
  • Processing a 10,000-token prompt will require 460 billion attention operations.

  So as you make your question more detailed and specific, the amount of time taken to produce an answer increases rapidly.
  
  Work is now on to replace transformer models with classic neural networks, which don't have these limitations, but also don't have the magical ease of development of the transformer model.
  
  But that means that promises of AGI next year are simply lies.

• Embodied, the startup that produced an $800 robot for children and has now run out of money, is working to release code and documentation to allow hackers to keep the robots working after the company shuts down.  (Ars Technica)
  
  Good to hear.
  
  
  
• The jury in the Arm vs. Qualcomm suit has sided with Qualcomm on two of the three questions put to them.  (Yahoo)
  
  Qualcomm, which has a license to produce Arm chips, bought startup Nuvia, which had a license to produce Arm chips. 
  
  Qualcomm then produced chips based on Nuvia's design.
  
  Arm sued Qualcomm saying Qualcomm was not licensed to do that.
  
  The jury verdict said Qualcomm did not breach its Arm license in buying Nuvia or producing the chips - which are used in the new Arm based laptops which are not selling particularly well so far.
  
  They did not reach a verdict on the question of whether Nuvia was in compliance with its Arm license.  I'm not sure how relevant that is, though Arm plans to continue legal action.
  
  
  
• You're not fired.  You're just locked out of the building and put on mandatory leave without pay.  (Tech Crunch)
  
  Electric van maker Canoo is not looking too healthy.
  
  
  
• What is Broadcom doing with VMWare?  Slashing costs.  A lot.  (Ars Technica)
  
  Not making many friends in the process, but they can worry about that after taking a dip in their swimming pool full of money.  Based on the latest figures sales have increased only slightly, but costs have been cut in half.
  
  In addition, Broadcom has effectively killed the VMWare reseller market, so that if you want to migrate your company off VMWare, you need to get technical support from Broadcom.

Posted by: normal at Sunday, December 22 2024 11:26 PM (bg2DR)

Posted by: Joe Redfield at Monday, December 23 2024 04:33 AM (KOtXO)

Hide Comments | Add Comment