Import speed getting slower – Urgent

This topic contains 30 replies, has 3 voices, and was last updated by  Benjamin Schmitz 7 years, 5 months ago.

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket

Tagged: 

  • Author
    Posts
  • December 8, 2016 at 3:56 pm #321432

    Benjamin Schmitz
    Expired Member
    Post count: 59

    Hello Stiofan, are there any updates on import speed? I’ve started uploading from start and I’m again at the point where upload of 2500 listings takes 2.30hrs.

    Is there any quick fix/improvement I could apply?

    It doesn’t feel like a normal flow.. Unlike SELECT, INSERT and UPDATE queries should be fast regardless of the table size. Right? I’ve imported large CSVs before directly into MySQL tables which is the fastest way possible. I can’t imagine uploading 1 million listings at this upload rate through importer..

    Do you think you guys can work something out? Thank you

    December 9, 2016 at 12:03 pm #321995

    Stiofan O’Connor
    Site Admin
    Post count: 22956

    I made one small change that might improve it a bit in the latest release but we still need to work on it properly. We have a few other things we need to finish first though.

    Stiofan

    December 9, 2016 at 12:51 pm #322032

    Benjamin Schmitz
    Expired Member
    Post count: 59

    Hi Stiofan,

    Yeah, I’ve just looked at the changelog! Well, one step at a time. I’m just about to start importing again and see if there’s any improvements.

    Thanks for your efforts.

    December 9, 2016 at 1:00 pm #322036

    Benjamin Schmitz
    Expired Member
    Post count: 59
    This reply has been marked as private.
    December 9, 2016 at 1:21 pm #322053

    Stiofan O’Connor
    Site Admin
    Post count: 22956

    If you used two different files and your server could handle it then it might work, you would just have to check if it slows them both down or if they both run as fast.

    Stiofan

    December 9, 2016 at 5:31 pm #322120

    Stiofan O’Connor
    Site Admin
    Post count: 22956

    Hi Ben,

    When trying to check your server specs i see that your domain returns
    1,029 other sites hosted on this server…

    This does not seem like a dedicated server… Can you clarify?

    Thanks,

    Stiofan

    December 9, 2016 at 10:03 pm #322352

    Benjamin Schmitz
    Expired Member
    Post count: 59
    This reply has been marked as private.
    December 9, 2016 at 10:15 pm #322354

    Paolo
    Site Admin
    Post count: 31206
    This reply has been marked as private.
    December 9, 2016 at 10:23 pm #322356

    Benjamin Schmitz
    Expired Member
    Post count: 59
    This reply has been marked as private.
    December 10, 2016 at 12:15 pm #322425

    Stiofan O’Connor
    Site Admin
    Post count: 22956

    These guys pricing is very good but they do not manage the server for you, you either need to know how to do that or you also need to pay someone to manage your server https://www.nocix.net/dedicated/

    Thanks,

    Stiofan

    December 10, 2016 at 4:16 pm #322508

    Benjamin Schmitz
    Expired Member
    Post count: 59
    This reply has been marked as private.
    December 10, 2016 at 4:50 pm #322511

    Stiofan O’Connor
    Site Admin
    Post count: 22956

    You have to understand that comes with no sort of server manager or support, you need to hire another company to do that also.

    Stiofan

    December 10, 2016 at 11:55 pm #322839

    Benjamin Schmitz
    Expired Member
    Post count: 59

    Yes, but I went for InMotion hosting dedicated option. Think it will be fine there.

    I’ll share the update on upload speed after it’s all set up. Hopefuly tomorrow

    December 16, 2016 at 10:24 am #325576

    Benjamin Schmitz
    Expired Member
    Post count: 59
    This reply has been marked as private.
    December 16, 2016 at 11:41 am #325591

    Stiofan O’Connor
    Site Admin
    Post count: 22956
    This reply has been marked as private.
  • Author
    Posts
Viewing 15 posts - 16 through 30 (of 31 total)

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket