There should never be a problem. The ideal driver shouldn't look like a big, bouncer, looking goon. You want to be the least likely to piss off the client should a problem arise. The client only feels threatened when there someone that looks like what I described and like dogs, clients bite if scared or threatened. It's better to negotiate.