I've struggled to get my head around this myself. When I was playing in a band that used guitars tuned to E then I was told to get a harmonica tuned to C, which I did, but then the harmonica part of our set became a sort of running joke whereby I would play really badly and end up using the harmonica as a slide on my bass.
So in summary if you're playing with yourself then you'll be in a different key.