Supporting 10 million listings, 1000+ Categories? DB Design?

This topic contains 4 replies, has 3 voices, and was last updated by  Anthony Accetturo 7 years, 11 months ago.

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket
  • Author
    Posts
  • June 5, 2016 at 8:53 am #203596

    Anthony Accetturo
    Buyer
    Post count: 76

    Can GeoDirectory handle a project of this scale, database wise stock and if so, what changes would be required? 10 Million Listings, Entire SIC business category system(1000+), GeoCoding. I have a new project I would like to test with your solution. I am not even sure wordpress can handle that many posts but with the custom table structure I was hoping so. All listings will have full, descriptions, several categories. Would it be better to create a different post type for each top level category DB design wise?

    Server will be sufficient, with 32 Cores 2.8GHz, DDR4 256GB RAM, SSD 2 TB RAID 10 BT Bckup, some other goodies. NGINX reverse proxying apache, PHP7 + FPM.

    Search will likely be a issue, so building a custom Solr or ElasticSearch isnt out of the question.

    June 5, 2016 at 10:12 am #203598

    Guust
    Moderator
    Post count: 29970

    I asked the developers to look at your question after the weekend.

    June 5, 2016 at 8:36 pm #203866

    Anthony Accetturo
    Buyer
    Post count: 76

    Thanks Guusy

    June 6, 2016 at 12:15 pm #204072

    Stiofan O’Connor
    Site Admin
    Post count: 22956

    Hi Anthony,

    Our aim is to be able to handle this yes, the problems i see would be with the 1000’s of categories, we build an array of locations and category counts, we were looping through this on each change but if you have many categories and many locations it becomes a problem, we have changed this (to be released in the next version) so it only updates a single posts locations and categories and there is a tool to ajax build the array if you do a large import.

    DB design wise i would suggest splitting the categories into as many CPT as you can but you have to be aware of some limitations at this time like searching between multiple CPT is not possible, so i would recommend making CPT based on the industry if you can.

    In the end if you run into any compilations we will try our best to resolve them and/or modify the system to handle them.

    If you have any more questions just let me know.

    Thanks,

    Stiofan

    June 6, 2016 at 2:00 pm #204126

    Anthony Accetturo
    Buyer
    Post count: 76

    I am going to do a test and see how much I can cut down categories

  • Author
    Posts
Viewing 5 posts - 1 through 5 (of 5 total)

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket