Deoxygenated blood is rust red. Thus rust is an insult to their very being. Blood of dwarves on sundered steel, proof that no proper dwarf has been here in ages - and of how non-dwarven craft is liable to fail you.
Carrying rusty effigies against the dwarves in war is viewed as a bit of a joke.