Monday, January 26

Geek

Daily News Stuff 26 January 2026

National Anthem Edition

Top Story

  • Replication crisis as a service.  (Columbia)

    You may have heard about the replication crisis science, and if you haven't, you should.  Half of all published medical research, for example, cannot be replicated, and for preclinical trials the rate increases to four fifths.

    An interesting point from that Wikipedia article is that 70% of scientists have tried and failed to replicate another researcher's work, but only 20% have been contacted by another scientist trying to replicate their work.

    Which is perhaps by design:
    This paper in Management Science has been cited more than 6,000 times.  Wall Street executives, top government officials, and even a former U.S. Vice President have all referenced it.  It’s fatally flawed, and the scholarly community refuses to do anything about it.
    Management science, huh?  Bad as things are in medical research, at least they admit to baseline reality.

    When someone tried to correct the record on this particular paper, his efforts were not well received:
    The authors ignored me, the journal refused to act, and the scholarly community looked the other way.  Two universities disregarded evidence of research misconduct - even after the authors admitted publishing a misleading report.

    The article remains largely uncorrected - misleading thousands of people each year.

    I believe our systems for curating trustworthy science are broken and need reformation.
    A latter-day dissolution of the monasteries?
    Having received no response from the authors, I contacted Management Science. After getting advice, I submitted a comment.

    It was rejected.

    The reviewers did not address the substance of my comment; they objected to my "tone".
    As the article says, ah, the tone police.
    The authors did admit to the editor that they had misreported a key finding - labeling it as statistically significant when it was not.  The authors claimed the error was a "typo."  They intended to type "not significant" but omitted the word "not".
    That's one hell of a typo.

    The story gets worse from there.  And that's just a single paper out of millions.


Tech News

Musical Interlude

Ladies and gentlemen, please rise for the national anthems.




Disclaimer: Okay, you can sit down now.

Posted by: Pixy Misa at 03:36 PM | No Comments | Add Comment | Trackbacks (Suck)
Post contains 602 words, total size 6 kb.




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




53kb generated in CPU 0.0158, elapsed 0.1302 seconds.
56 queries taking 0.1181 seconds, 359 records returned.
Powered by Minx 1.1.6c-pink.