Is a Microsoft Word document conscious? Why don't we treat Deepmind AlphaFold or IBM Watson as conscious beings? As Ted Chiang writes, "it’s simply the fact that LLMs emit grammatical sentences and we are accustomed to reading intention into sentences." Do not get taken by deepfake anthropomorphism.
Taken to its logical conclusion, this line of thinking is absurd—and damning.
