When I had such experiences (very rare) I continued the interview, then I left and never came back. Life is too short for something else.

Oh, and I told all my friends to avoid those companies. It was a nice gesture for my friends, not a "cancel X" move.