This worries me most about AI in science. It's what happened with the advent of Stata and SPSS. They enabled incredibly rapid advances in the sciences and also set the stage for the replication crisis. Sadly, so many scientists simply don't understand the stats they are using.
Kevin Zollman
"The real threat is a slow, comfortable drift toward not understanding what you're doing. Not a dramatic collapse. Not Skynet. Just a generation of researchers who can produce results but can't produce understanding."
Katie Mack
Hey, I wrote a thing about AI in astrophysics
ergosphere.blog/posts/the-ma...
ergosphere.blog
On AI agents, grunt work, and the part of science that isn't replaceable.
