As already said: if you're worried about safety, flip the breaker off. Sounds like a bad switch to me, but I'm not sure how common that is.