When you are a passenger are you an uneasy rider?

I always feel more secure when I'm the one in control, but there are drivers with whom I feel very safe when I'm a passenger.

that depends on where im going

Not normally.

One guy I travelled with occasionally had to make eye contact when he spoke to anybody so he would turn to face me as he was driving, look back at the road, see something that may have been a problem, and slam on the brakes even though there was no immediate danger. He had something like six or seven accidents where people rear-ended him, fortunately not while I was in the car.