This keeps popping up and I have to chime in and say that yes, AI bots are reshaping how we are able to access websites for crawling; these changes block a lot of the Internet Archive’s attempts to automatically harvest the whole web (which I have many thoughts about), and no, Wayback =/= “history”
Emily Higgs Kopin
AI has started blocking the Wayback Machine from chronicling the web. Considering that nearly 40% of websites disappear after 10 years, this will enforce a giant loss in collective memory.
The Internet Archive is a vital resource that has helped the search for truth in more than one global event, writes Anthony Cuthbertson, but it is in danger of becoming the latest collateral damage of...
