CSV Import Problems

This topic contains 57 replies, has 2 voices, and was last updated by  Alistair Williamson 7 years ago.

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket
  • Author
    Posts
  • #373319

    Alistair Williamson
    Full Member
    Post count: 415
    This reply has been marked as private.
    #373338

    Alistair Williamson
    Full Member
    Post count: 415
    This reply has been marked as private.
    #373579

    Alistair Williamson
    Full Member
    Post count: 415
    This reply has been marked as private.
    #373589

    Stiofan O’Connor
    Site Admin
    Post count: 22956

    I deleted the word doc already…

    I added ur DB to a test site on my server and imported your test file after removing the images column and it imported 1014 listings in 4 minutes and 33 seconds, my server also has about 50 other sites running off it.

    Thanks,

    Stiofan

    #373591

    Alistair Williamson
    Full Member
    Post count: 415

    Hi Stiofan,

    Thank you.

    Wow! That is impressive.

    My VPS server is taking 15 minutes to do the same thing – so your’s is 3 times faster!

    I think I will change over.

    Bests

    Al

    #373865

    Alistair Williamson
    Full Member
    Post count: 415

    Hi Stiofan,

    I spoke to soon.

    Now nothing will import.

    The import routine spins for about 20 minutes and then stops?

    Sorry

    Al

    #373867

    Alistair Williamson
    Full Member
    Post count: 415

    Seems like something has hung?

    No response.

    #373868

    Alistair Williamson
    Full Member
    Post count: 415

    Running again.

    Phew!

    Bests

    Al

    #374036

    Alistair Williamson
    Full Member
    Post count: 415
    This reply has been marked as private.
    #374065

    Alistair Williamson
    Full Member
    Post count: 415
    This reply has been marked as private.
    #374081

    Alistair Williamson
    Full Member
    Post count: 415

    VLAD says…..
    ======================
    Hello,

    MySQL is using 100% CPU and that’s why your server is slow. You need to get more CPU power for it to make it quicker.

    Regards,
    Vlad | L3 Support Representative
    ==================================================

    I guess I havce arrived at the point where I need a dedicated server…..

    Bests

    Al

    #375915

    Alistair Williamson
    Full Member
    Post count: 415
    This reply has been marked as private.
    #376973

    Alistair Williamson
    Full Member
    Post count: 415

    Hi Stiofan,

    I have finished the import……but now have even more problems….

    I started out with c. 75,000 listings and I now have 86,000 listings.

    Even the new dedicated server setup will not handle a 75,000 listing import in one go.

    But after 2 months of painful importing I finished the import a couple of days ago.

    86,000 listings signals dupes 🙁

    I have exported them all today as 5,000 listing CSV’s more seems unreliable.

    Pasted them back together in Excel = OpenOffice doesn’t handle this number of rows at all well.

    Imported the Excel into Access and checked against my own unique ID and I have c. 25,000 dupes!

    We can blame ‘pilot error’ but this way of working – having to split files is fraught with risk. Equally there is no way of preventing or identifying dupes on import. I had so many problems with inadequate server spec – not clear from your documentation – so many crashes I can only assume that dupes crept in.

    I think the only way forward is to start the import again. I can’t think of any way to dedupe and then find the ones I didn’t import?

    Is there a quick way to delete all of the listings under one CPT please?

    Going to bed.

    Bests

    Al

Viewing 13 posts - 46 through 58 (of 58 total)

We have moved to a support ticketing system and our forums are now closed.

Open Support Ticket