Not out of the box. In GeoDirectory, custom fields and search filters belong to a post type, not to a category, so every category within Places shares the same set of filters.

How search filters are set up

With the Advanced Search add-on you choose the filter fields for each post type in Places > Settings > Search, and every other post type has the same tab. The fields you add there appear whenever that post type is searched, whichever category the visitor picks. See Settings Overview for CPT > Settings > Search and Advanced Search setup guide.

Your options if you need different filters

• Split the listings into separate post types. With the Custom Post Types add-on, each post type has its own custom fields, search filters and templates, so wedding venues and conference venues could each have filters that suit them. A listing belongs to one post type, so a venue offering both would need a listing in each.
• Limit a search to one category. A search bar on a specific page can be set to search a single category, as shown in Set Specific Category in Search Bar on a Specific Page. The filters are still those of the post type, but results come only from that category.
• Showing or hiding filter fields per category needs custom code. Hiding fields with CSS only hides them from view, so it is not a reliable substitute.

For how the search itself works, see How does the GeoDirectory Search work.