Hello!
I have experienced this, also.
For a little background, Google may have any number of address listings for a given place. Google has a number of factors to consider when an API call is made, and the place listing is not necessarily the same as what you see through the maps.google.com application. In fact it is definitely different, even if the address info is the same.
So, all that being said, address can be made totally optional and you can simply correct the pin location or the address itself, once you have things in the right general area. That’s the ‘fix’ as it were. The GD plugins won’t go and automatically re-geocode your data.
All that being said, we are happy to work with you to improve the accuracy for your particular area.
Are you using region on your addresses?