You can set the address on the map, and then change the street input before saving. In my tests that keeps the location on the map, and keep the desired input in the address field. This will not work for users of course.
So a +1 from me.
I would also like the address field to be optional, for those businesses that have not a physical presence; that would enable them to just add the city, but not the street address. See also https://wpgeodirectory.com/support/topic/wishlist-suggestions/#post-1953