Statistically crossvalidation folds are not independent. The number of papers treating them as if they were is off the charts.
Is it true that Robin is the first multi-agent system capable of fully automating both hypothesis generation and data analysis for experimental biology? If you take out "multi-agent" I believe the old Tenenbaum work qualifies?
My new @thetransmitter.bsky.social piece.
Does Claude AI have emotions? *No*.
Does Claude have nontrivial emotion-equivalents? *Yes*. Like your "memory" vs your laptop's; similar but not the same.
Here, I unpack why that's interesting.
www.thetransmitter.org/emotion/what...
Here's bonus slides on cross-validation tests, separate from our preprint. Covering:
1. paired (sign-flip) permutation test
2. label-swap permutation test
3. sample-level vs fold-averaged stats
4. a common misapplication of the corrected t-test
5. three bootstrap variants 1/N
Psychologists doing clustering be like:
#statsmeme
š¢ FREE Webinar: Doing Good Science When Resources are Limited
June 11 @ 12 pm ET - š RSVP here: bit.ly/4vj8tAB
We'll will examine how sound methodology, careful inference, and clear reporting operate when tradeoffs are unavoidable.
Konrad Kording
Konrad Kording
www.thetransmitter.org
Exploring why Anthropicās AI, Claude, displays something like emotion could ultimately help us better understand the function that emotions serve in humans.
šØ The actual paper is now out on @cp-trendscognsci.bsky.social:
www.sciencedirect.com/science/arti...
In this opinion piece, @duncanastle.bsky.social and I explore the human brain through the lens of optimality and Pareto-optimality theory.
Nicole Rust
Check out our latest profile! Dr. Megan Peters (@meganakpeters.bsky.social) studies how the brain represents & uses uncertainty and she also co-founded the online summer school, Neuromatch Academy. Learn more at the link below! #WomenInNeuroscience #StoriesOfWiN
www.storiesofwin.org/profiles/202...
In a meta-analysis of 210 biomedical AI studies that statistically compared models under cross-validation, 97% used invalid statistical tests.
Here's our new preprint doi.org/10.64898/202... led by @tianchu.bsky.social @hetuli.bsky.social @shaoshiz.bsky.social @nichols.bsky.social 1/N
In a meta-analysis of 210 biomedical AI studies that statistically compared models under cross-validation, 97% used invalid statistical tests.
Here's our new preprint doi.org/10.64898/202... led by @tianchu.bsky.social @hetuli.bsky.social @shaoshiz.bsky.social @nichols.bsky.social 1/N
Human brain architecture is guiding brain-inspired artificial intelligence (AI) and has been treated as an optimal template, whose deviations could maā¦
Join us on Thursday, June 11, at 12 PM ET for an online conversation about conducting rigorous science under real-life constraints.
RSVP @ bit.ly/4vj8tAB
Particularly relevant for grad students analyzing data, writing manuscripts, or approaching thesisālevel decisions, though everyone is welcome!
āAll hypotheses, experimental directions, data analyses, and data figures in the main text of this report were produced by Robin ... the first AI system to autonomously discover and validate novel therapeutic candidates within an iterative lab-in-the-loop frameworkā
š¶
www.nature.com/articles/s41...
Mattan S. Ben-Shachar
Community for Rigor
studies how the brain represents and uses uncertainty and she also co-founded the online summer school, Neuromatch Academy
For all the esteemed scholars out there who prefer gaining knowledge the correct way, hereās a summary of our upcoming opinion piece, delivered to you by Jesus himself.
But seriously, science communication is about to get a lot worse and better at the same time.
