Sunday, December 17

Geek

Daily News Stuff 17 December 2023

Holly Jolly Whatever Edition

Top Story

  • Small is the new Large: Microsoft has announced Phi-2, which it terms a "small language model".  (VentureBeat)

    With 2.7 billion parameters it generally outperforms Llama-2 and Mistral with 7 billion parameters, while being small enough to run happily on graphics cards with just 4GB of RAM.

    It's comparable to Mistral on language tests, but significantly better on mathematics and programming.

    If that's too big for you, Microsoft recently released Phi-1 and Phi-1.5 which will run on any reasonably specced potato.

    I'm happy to see this progress in making improvements to small models you can run yourself, that have potential to do some limited set of things well.  The push to ever larger models at astronomical expense is going to fail unless fundamental changes are made to the designs - and  to the culture of the companies building them.


  • Mistral also announced what they call Mixtral last week.  (Mistral)

    This a similar idea.  Rather than building one huge model that tries to handle everything, Mixtral uses eight small (7 billion term) models, each able to fit on a commodity graphics card, and each tuned to a specific kind of task.

    It outperforms the largest version of Llama-2 (70 billion terms) while being 30% smaller overall (for all eight models combined) and working on hardware at one twentieth the price.


Tech News


VTuber News

  • Congratulations to Fishman and all the Sad Girls at Sad Girls, Inc for winning the rising star category at the 2023 VTuber awards.  (Twitter)

    It's amusing to see people complaining that Sad Girls should be competing with the titans like Hololive and Nijisanji.  The entire reason they won this award is because they've grown so much this year that people compare them to the titans.


  • And congratulations too to Vedal and Neuro-sama on the Best Tech VTuber award.

    Neuro-sama is a home-made AI VTuber who loves nothing more than roasting her poor creator.  As the creation of a single person - even building off open-source tools - she's truly impressive.

Secure Your Damn Basements, People Videos of the Day


First it was Hololive.



And now Phase Connect.




Who knows what Nijisanji or VShojo could have chained up down there?



Disclaimer: Well, probably Pomu and Kson respectively, but they're not talking.  I mean they're talking a lot, but not about this.  Yet.  Actually, they're mostly talking about frogs.  I don't know why.

Posted by: Pixy Misa at 04:12 PM | No Comments | Add Comment | Trackbacks (Suck)
Post contains 817 words, total size 8 kb.




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




54kb generated in CPU 0.0139, elapsed 0.1138 seconds.
56 queries taking 0.105 seconds, 344 records returned.
Powered by Minx 1.1.6c-pink.