It was a bad day. A lot of bad stuff happened. And I'd love to forget it all. But I don't. Not ever. Because this is what I do. Every time, every day, every second, this: On five, we're bringing down the government.

Monday, December 23

Geek

Daily News Stuff 23 December 2024

Again Dangerous Frisbees Edition

Top Story

  • OpenAI's next generation model, GPT-5, is ahead of schedule and coming in under budget. (WSJ / MSN)

    Sorry, just kidding. GPT-5 is not working, may never work as planned, and each training run takes six months and costs half a billion dollars.
    OpenAI has conducted at least two large training runs, each of which entails months of crunching huge amounts of data, with the goal of making Orion smarter. Each time, new problems arose and the software fell short of the results researchers were hoping for, people close to the project say.
    Also there's the tiny problem that with GPT-4, OpenAI already looted the entire public internet. GPT-5 needs a lot more data for its training, and there isn't more data.
    OpenAI’s solution was to create data from scratch.

    It is hiring people to write fresh software code or solve math problems for Orion to learn from. The workers, some of whom are software engineers and mathematicians, also share explanations for their work with Orion.

    But, you say, the internet contains all human knowledge. Won't trying to expand that significantly take a long time? Won't it cost a huge amount of money?

    Yes.
    The process is painfully slow. GPT-4 was trained on an estimated 13 trillion tokens. A thousand people writing 5,000 words a day would take months to produce a billion tokens.
    What about using AI to train your new AI?
    OpenAI also started developing what is called synthetic data, or data created by AI, to help train Orion. The feedback loop of AI creating data for AI can often cause malfunctions or result in nonsensical answers, research has shown.


    Scientists at OpenAI think they can avoid those problems by using data generated by another of its AI models, called o1, people familiar with the matter said.
    Scientists at OpenAI are paid to think that. They are paid a lot to think that.

    In short, your job is safe for now.

Tech News



Disclaimer: Mostly dead is still partly alive.

Posted by: Pixy Misa at 06:00 PM | Comments (4) | Add Comment | Trackbacks (Suck)
Post contains 547 words, total size 4 kb.

Sunday, December 22

Geek

Daily News Stuff 22 December 2024

Game Of Rat And Dragon Edition

Top Story

  • Why AI is stupid garbage and everyone in the industry is lying frantically to cover up the truth. (Ars Technica)

    Okay, I may have paraphrased Tim Lee at Ars just a little there, but if you look at the promises AI leaders have made against the mathematical problems they face, that is the gist of the situation.

    AI - LLM-based generative AI, not the more interesting discriminative AI - uses a technology called transformers which lets it process data in a massively parallel way. This requires about the same amount of work as a traditional neural network on simple prompts, while being able to use highly parallel hardware like graphics cards, so you get the result much faster.

    For simple prompts:
    The longer the context gets, the more attention operations (and therefore computing power) are needed to generate the next token.

    This means that the total computing power required for attention grows quadratically with the total number of tokens. Suppose a 10-token prompt requires 414,720 attention operations. Then:

    • Processing a 100-token prompt will require 45.6 million attention operations.
    • Processing a 1,000-token prompt will require 4.6 billion attention operations.
    • Processing a 10,000-token prompt will require 460 billion attention operations.
    So as you make your question more detailed and specific, the amount of time taken to produce an answer increases rapidly.

    Work is now on to replace transformer models with classic neural networks, which don't have these limitations, but also don't have the magical ease of development of the transformer model.

    But that means that promises of AGI next year are simply lies.


Tech News



Happy Birthday Everyone Video of the Day



Disclaimer: You need to read the comments for once.

Posted by: Pixy Misa at 03:00 PM | Comments (2) | Add Comment | Trackbacks (Suck)
Post contains 574 words, total size 5 kb.

Saturday, December 21

Geek

Daily News Stuff 21 December 2021

Heat Displacement Edition

Top Story



Tech News

Disclaimer: There may be pizza.

Posted by: Pixy Misa at 06:03 PM | Comments (3) | Add Comment | Trackbacks (Suck)
Post contains 193 words, total size 2 kb.

Friday, December 20

Geek

Daily News Stuff 20 December 2024

Gleep Gloop Edition

Top Story

  • Oh yeah, don't use SMS for two-factor authentication either.  (Gizmodo)

    It was never ideal since your phone number could get SIM-swapped without you knowing, but now that the entire phone network has been hacked it's not very useful at all.


  • Microsoft promises meanwhile to keep nagging you to use passkeys rather than passwords online.  (The Register)

    A passkey lets you log in to a website without the tedious logging in part, so long as you have already logged in to your device.  This is actually fairly secure because the passkey consists of two parts - you have one part and the website has the other - and nobody can steal your password from the website and hack your account because effectively they only have half the password.

    But if they hack your laptop, you're hosed.  Though that is true regardless.


Tech News

Disclaimer: Bonk / oif.

Posted by: Pixy Misa at 06:30 PM | Comments (2) | Add Comment | Trackbacks (Suck)
Post contains 344 words, total size 4 kb.

Thursday, December 19

Geek

Daily News Stuff 19 December 2024

Second Last Thursdayism Edition

Top Story



Tech News

  • Interpol wants to rename "pig butchering" to "romance baiting".  (Bleeping Computer)

    Which is actually not a terrible idea.  Every time I hear the term "pig butchering" I have to stop for a moment and realise that no, the one I'm thinking of is salami slicing and pig butchering is something different.

    Romance baiting is more evocative on what the scam involves.


  • Bluesky invited a million sociopaths in through the front door.  They were not ready.  (Tedium)

    It's not a technical issue, it's a people issue.  Well, commies aren't people, but not everyone on Bluesky is a communist.


  • Not even slightly ready.  (The Free Press)

    Jesse Singal writes on Bluesky's Jesse Singal problem.

    He still doesn't get it, of course:
    Bluesky happens to be left-wing, but I don’t think the lesson here is that left-wingers are particularly violent. Rather, the lesson is simply that humans are human, and online, their behavior is shaped by both the prevailing norms in their community, and whether rules constraining that behavior exist and are enforced.
    So what he is saying is that left-wingers are particularly violent.


  • The Radxa Orion O6 is an Arm motherboard that is a little more powerful than a Raspberry Pi.  (CNX Software)

    It has twelve Arm cores - eight A720 and four A520, so fairly powerful, coupled with up to 64GB of soldered RAM, an M.2 slot for storage, dual 5Gb Ethernet ports, HDMI, DisplayPort, USB-C with DisplayPort support, and a full-length PCIe x16 slot.

    It's mini-ITX form factor, with the board starting at $199 with 8GB of RAM and a case going for $39.


  • Australia wants to ban common encryption methods by 2030 because quantum.  (The Register)

    In theory quantum computers can break many existing encryption methods.  But existing encryption methods exist, and everyone everywhere uses them all the time.


Disclaimer: Stupid!

Posted by: Pixy Misa at 05:44 PM | Comments (3) | Add Comment | Trackbacks (Suck)
Post contains 424 words, total size 4 kb.

Wednesday, December 18

Geek

Daily News Stuff 18 December 2024

Orders Of Magnitude Edition

Top Story

  • What happened to ChatGPT the other day?  It wasn't DNS, but it wasn't not DNS either.  (Try Parity)

    OpenAI deployed a new system that had been running happily on their test servers for some time.  About twenty minutes in, things started going horribly wrong, with the monitoring system that reports on all things production taking over and then taking out the production servers, because it had a hidden scaling problem that never showed up on the smaller test environment.

    And with the monitoring process eating up all the bandwidth on the control network, the simple changes they needed to make to fix the problem couldn't be done because OpenAI's internal DNS was down.

    Lesson of the day: Hard code all your IP addresses in your software.*


Tech News



Disclaimer: * Do not actually do this.

Posted by: Pixy Misa at 06:08 PM | Comments (4) | Add Comment | Trackbacks (Suck)
Post contains 347 words, total size 3 kb.

Tuesday, December 17

Geek

Daily News Stuff 17 December 2024

Incompetence Abounds Edition

Top Story

  • Zotac has leaked Nvidia's new RTX 5000 series graphics cards.  (VideoCardz)

    The lineup includes the RTX 5090, which you can't afford and probably won't be able to buy anyway, the 5090D which is a China-only edition for communists, the 5080 which will probably be overpriced and you won't want, the 5070 Ti which will probably be decent but expensive, and the 5070 which has 12GB of VRAM like the Intel B580 but which will definitely not cost $250 like the Intel B580.

    The new cards all reportedly use GDDR7, so memory bandwidth is likely to be significantly better than 4000 series cards.  GDDR7 memory uses trinary rather than binary signals - a technique known as PAM-3 - so it can move data 50% faster at the same clock speed.

    Thunderbolt 5 also uses PAM-3 encoding but right now it's kind of useless so we should hope that's not a sign of things to come.

Tech News

Disclaimer: Frankly my dear, I don't give a hill of beans.

Posted by: Pixy Misa at 06:40 PM | Comments (1) | Add Comment | Trackbacks (Suck)
Post contains 440 words, total size 4 kb.

Monday, December 16

Geek

Daily News Stuff 16 December 2024

Corinthian Edition

Top Story

  • A major laptop manufacturer is expected to show off an ion drive at CES.  (Tom's Hardware)

    The Frore Airjet uses a piezoelectric element to silently produce an airstream to cool whatever it is attached to.  The problem is that it is not particularly power efficient - only about one fifth as effective as laptop fans, which are not themselves paragons of efficiency.

    The Ventiva ICE is an ionic engine.  Also silent, it ionises the air molecules to attract them to a metal grate, where they are deionised but keep right on moving, creating an airflow which cools your laptop.

    This isn't the first time that someone has come up with this idea, though, so we're going to have to see whether they can make it work.  Previous efforts have been very sensitive to dust buildup, which is enough of a problem with fans but renders ion blasters useless.


Tech News



Disclaimer: Don't read the comments.

Posted by: Pixy Misa at 06:43 PM | Comments (2) | Add Comment | Trackbacks (Suck)
Post contains 339 words, total size 3 kb.

Sunday, December 15

Geek

Daily News Stuff 15 December 2024

Poptop Edition

Top Story

  • TSMC has announced performance specs for its upcoming 2nm node.  (Tom's Hardware)

    Compared with the current leading-edge 3nm process, it uses 24% less power for low-power mobile chips, and 35% less power for desktop chips.  Or if you keep power the same, it runs about 15% faster.

    Compared to 5nm, it uses around 48% to 55% less power, and compared to 7nm (which I'm running right now), the reduction is as much as 70%.

    Chips will be coming off the production line in 2026.


Tech News


Disclaimer: That was sarcasm.

Posted by: Pixy Misa at 05:59 PM | Comments (3) | Add Comment | Trackbacks (Suck)
Post contains 193 words, total size 2 kb.

Saturday, December 14

Geek

Daily News Stuff 14 December 2024

Lying Suits Edition

Top Story


Tech News

  • If Tesla won't launch an AI-piloted taxi service, we will, says Zoox. (Tech Crunch)

    What is a Zoox?


  • A Waymo robotaxi got stuck in a roundabout. (Tech Crunch)

    Yes, it was doing exactly what you think it was doing.


  • Bluesky has found out what happens if you take millions of the most demented users from a much larger platform and make them your own problem: They become your own problem. (Tech Crunch)

    Jesse Singal, who is generally an intelligent and affable idiot, has written extensively on the insanity of the chemical sterilisation and surgical mutilation of children. To be completely clear, despite his otherwise mainstream left-wing views, he is vehemently against this, and his writing and research in this area is solid.

    He created a Bluesky account because, being left-wing, he is unhappy with Twitter.

    Bluesky went insane. The one thing you are absolutely forbidden to do is to question the orthodoxy.
    He is now the most blocked user on the social network, and user outrage over his participation on the platform is growing. People are demanding that Bluesky take a stand: It’s either a place that promises it won’t host bad actors, or it’s a place that promises not to inflate the reach of bad actors thanks to its various moderation tools.
    It cannot be both.
    Freedom of speech and freedom of conscience simply don't exist for these people. Anyone daring to offer a different opinion must be revoked.

    And if you read Bluesky, they mean that in the Brontitall sense.
    But many Bluesky users don’t want to just moderate and ignore Singal, they want him gone. It’s become a dealbreaker.

    By keeping him, Bluesky risks harming the community, depleting its goodwill, and losing users, while also sending a signal to others that bad actors and harassers are welcome there.
    To be clear again, Singal is not a bad actor, and has not harassed anyone. This is just crazy people being crazy.
    But by banning Singal, Bluesky could come under attack from the next head of the FCC, Brendan Carr, who is ready to come after social networks he believes are suppressing conservative views. Whatever Bluesky does here will attract attention, for better or for worse.
    Start banning the crazy people. They are the problem. Nobody wants them.

    If they represent the majority of your active users, your platform will die.


  • The Minisforum MS-A1 is a big small PC. (Liliputing)

    Measure about 8"x8"x2" it's a lot bigger than a small PC but a lot smaller than a big PC. And it supports desktop CPUs and laptop RAM, so it's easy to expand.

    It's now available with a sixteen core 9950X if you need a very fast and quite small system. The only problem is that it doesn't have room for a graphics card, and the onboard graphics on the 9950X are... Meh.

    A better option for most people is probably to install the Ryzen 8700G. It's only half as fast on the CPU side of things which makes sense as it only has eight cores, but it has twelve graphics cores against just two on all the 9000-series CPUs.

    The 8700G is a laptop CPU adapted for desktop sockets. It doesn't look like we'll see a 9700G or anything similar, because the current Ryzen 370 laptop CPUs don't appear to have any support for socketed memory. (Though it's possible to work around this with CAMM2 modules.)


  • AMD's 4124P is designed for low-end embedded servers, but it uses the standard desktop AM5 socket. So how does a four-core CPU stand up in gaming in 2024? (Tom's Hardware)

    Actually, pretty well. You're not going to want to pair it with a 4090 (if you can even find one), but for $149 it does everything you would expect.


  • Luon is an implementation of Oberon+ - a successor to Pascal developed by Niklaus Wirth - that targets the LuaJIT backend. (GitHub)

    Which is a lot less crazy than it might sound, because Oberon+ is a clean and effective programming language, and LuaJIT runs anywhere and is extremely fast and efficient because Mike Pall is a robot from the future.


  • Apple broke the ability to back up the operating system on MacOS. (ShirtPocket)

    You can't write a program to do this; you have to use the operating system itself.

    The operating system itself is broken.

    Apple is turning Macs, step by step, into iPhones that don't work.


  • Cognitive load is what matters. (GitHub)

    A system that does everything perfectly that nobody understands is infinitely fragile.

    A system that is simple but broken can be fixed.


Disclaimer: In time, all systems become rococo, and then rubble.

Posted by: Pixy Misa at 04:58 PM | Comments (5) | Add Comment | Trackbacks (Suck)
Post contains 894 words, total size 7 kb.

<< Page 1 of 671 >>
[f#^_^sfleeb#f.stats]
Using https / https://ai.mee.nu / 391