Unless you're spec ops, Google knowing where you are isn't exactly life-ending information. For almost everyone, they're at home during non-work hours and at work during work hours. If the government wants to come get you, they already know how. I'm fully on board the Nuke Google Express, but them knowing where I am at any given time is such a non-issue that it doesn't even enter my consciousness.
Just get a low end smartphone and jam an ice pick into the microphone if you're worried about being listened to. Or get a really old one and just take the back off and disconnect it. I miss being able to take the back off my phone.
And just to add some legitimacy to my post, I owned a Palm device ages ago. It sucked. It's slow, hard to use, and not very useful. It was early adopter tech and was only useful if you were a businessman back then. It would be like buying an IBM PC Jr. today. Yes, you could technically use it, but you might as well be using an abacus and parchment.