Can you not be that way? How do you go about developing a sense of direction or is it like talent? You either have it or you don't but it cannot be taught or learned.
It is not only frustrating and it is also frightening. Approaching someplace you know from a different direction makes it seem so strange and disorienting.