people are so clever. (or did an LLM tell them to do that?)
Steve Randy Waldman
NEW: malware developers added nuclear & biological weapons text to to their spyware.
Goal? To trigger LLM safety refusals... so that their spyware wouldn't be analyzed by an AI security scanner.
Cleanest practical example I can think of for why over-indexing on first order "safety" is risky. 1/
