Let's say you are in a lower level of a performing stage, and the guy you are currently speaking with, which happens to be on the same stage with you, is in a bit far and higher area from you. Then, you ask him,
"why are you down there?"
The question is, why is it still valid to say "down" when it should have been "up" in the first place?