How do I hide empty category links in locations where the listings do not exist?

I am using the Multi-Location extension and I noticed that in some areas where there is no listings for a particular category, it still shows the category link. Since the listings are actually in another area, it shows (0) with the link, but if a customer isn’t paying attention to that, and clicks on the link, they get the error message “No listings found which match your selection.”. That can be confusing for a client, especially when the directory is young and has few listings.

How can I hide the categories links that have no listings in the current location?

Thanks,
Mike