New work on LLM safety in medicine 💊! Drug names have fixed morphological structure, so is that exploited by LLMs? Kaijie's paper reveals over-generalization that may pose safety risks if not handled carefully 👇
Jessy Li
“Dimicillin” isn’t real. We made it up. Yet many LLMs still call it an antibiotic.
Across 9 models and 653 drugs, we find that drug-name affixes alone can drive pharmacological reasoning. Models often rely on morphology over facts.
We trace this shortcut from behavior to mechanism. 🧵
