Uploading large database of listings

This topic contains 11 replies, has 4 voices, and was last updated by  Kiran 8 years ago.

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket
  • Author
    Posts
  • September 4, 2017 at 8:51 pm #394269

    Pete
    Free User
    Post count: 6

    Hi GD Team
    I’m having issues uploading my listings when the CSV seems to over about 500 listings. It is saying “The uploaded file is not a valid csv file. Please try again.” It would seem as though the CSV’s format may be wrong, however I have tried to with a CSV file of dummy data that works when the file is small, but produces this area when I duplicate the data over a large number of listings.

    My database is around 2 million listings (but even a few hundred uploaded could be enough for my business purposes).

    Any suggestions on how to upload so many would be appreciated! e.g. directly inserting the listings into the wp_geodir_gd_place_detail table in SQL? I tried this also however the listings didn’t seem to be indexed in the searches then.

    Thanks

    September 5, 2017 at 3:13 pm #394373

    Kor
    Moderator
    Post count: 16516

    Hi Pete,

    This could be related to your server limited resources. Please check your server requirements and make sure you’ve met it https://wpgeodirectory.com/docs/server-requirements/

    Thanks!

    September 5, 2017 at 4:05 pm #394379

    Paolo
    Site Admin
    Post count: 31211

    Hi,

    Importing via SQL is a lot more complex. Listings are not only entered in that table.

    If you use the right resources, it should import hundreds of listings per minute.

    If you provide a copy of the CSV that is creating problems, we’ll have a look at it. Make sure to zip it before uploading it.

    Thanks

    September 6, 2017 at 10:36 am #394467

    Pete
    Free User
    Post count: 6

    Hi guys, thanks for your help 🙂

    @Kor – I’m using an Amazon AWS EC2 server, so thought that should be OK?

    @paolo – I’ll zip up the CSV and send it privately

    Appreciated, Pete

    September 6, 2017 at 10:39 am #394468

    Pete
    Free User
    Post count: 6
    This reply has been marked as private.
    September 6, 2017 at 10:41 am #394469

    Pete
    Free User
    Post count: 6
    This reply has been marked as private.
    September 7, 2017 at 7:23 am #394577

    Kiran
    Moderator
    Post count: 7069

    Hi Pete,

    I have tested CSV file that you provided in my test site and it worked fine for me. 117 listings could not import as they have blank address.

    Let us provide your site admin credentials, FTP credentials so we can look into there.

    Thanks,
    Kiran

    September 7, 2017 at 10:57 am #394593

    Pete
    Free User
    Post count: 6
    This reply has been marked as private.
    September 7, 2017 at 10:58 am #394595

    Pete
    Free User
    Post count: 6

    @kiranprajapati thanks – replied privately with login details

    September 7, 2017 at 12:20 pm #394608

    Kiran
    Moderator
    Post count: 7069

    Thanks Pete for providing details. We need FTP credentials as well to do some debugging.

    September 7, 2017 at 9:16 pm #394684

    Pete
    Free User
    Post count: 6

    Hi @kiranprajapati

    I use a WordPress plugin in my admin section called ‘WP File Manager’ which is effectively an FTP system. Please login with the details I send and let me know if this is suitable, otherwise I’ll track down my FTP details.

    Thanks, Pete

    September 8, 2017 at 10:28 am #394760

    Kiran
    Moderator
    Post count: 7069

    In WP File Manager some files are not editable (Ex: wp-config.php). So FTP credentials will be much better.

    Kiran

  • Author
    Posts
Viewing 12 posts - 1 through 12 (of 12 total)

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket
20% Discount Offer
Hurry! Get your 20% discount before it expires. Get 20% Discount