The trick is, when among mathematicians, to say you are a physicist so that they forgive you for not knowing very much math. Then, when among physicists, say you are a mathematician so that they forgive you for not knowing very much physics. In especially dire cases I might say I am a philosopher.