Reminds me of this paragraph from @michaelnielsen.bsky.social about human willingness to delegate to world-ending authority automated systems (whether because oversight is impossible or just inconvenient)
michaelnotebook.com/xriskbrief/i...
Grace
Wrote it down? I'm not sure. IIRC I learned it from Manny Knill in 1996, but my memory is very fuzzy