Alistair Williamson
Forum Replies Created
-
Posts
-
Hi Stiofan
One more isea on Import – please see No. 7.
Bests
Al
Thanks.
Here is my own personal brainstorm thoughts for you on import/expor.
Hope it helps.
Bests
Al
Correction 1,000 record 30 mins.
I tried to upload 6,500 records with a file zize of 3.8Mb and it hung after c. 1,000 imported records with a message saying, ‘Not a valid CSV file.
Batches of 1,000 records with a file size of 0.5Mb – takes 1 hour to complete import.
Bearing in mind I have 74,000 records – 74 hours – not including data prep in LibreOffice.
Bests
Al
Didn’t know that.
How do I do that
Al
Hi Stiofan,
🙂 Agreed 🙂
I changed an image on all records, so changed the URL in one column.
I added another custom field and introduced text data akin to the post_title
Cheers
Al
This reply has been marked as private.This reply has been marked as private.This reply has been marked as private.Incidentally, I test any import with a handful of listings before attempting a larger import – 1,000 listings max. 2Mb limit from my server writing to JaguarPc – and have the waited up to 1 hour for the import to complete before finding there was an unforseen/unclear import problem.
Hi Stiofan,
1. I will speak to the server guys
2. I was commenting on the message received when an import is completed. If there is a record the system rejects, a message is received, ‘999 records imported successfully and 1 could not be added due to : blank/invalid address(city, region, country, latitude, longitude).
The problem is:
– you have to wait for the import to complete to find out what worked
– you don’t know which 1 out of the 1,000 records was wrong – not specific enough. record 789 didnt import would be better…
– the message – blank/invalid address(city, region, country, latitude, longitude) isn’t specific enoughI have exported 10,000 records in one hit without a problem then made some minor changes and had to break the file into smaller sizes and then eventually get the messages:
Total 1000 item(s) found.
1000 / 1000 item(s) could not be added due to blank/invalid address(city, region, country, latitude, longitude).
1000 / 1000 item(s) could not be added due to blank title/invalid post type/invalid characters used in data.At this point I have no idea what is wrong and have no choice but to revisit/recreate my import file.
Again only feedback but very time consuming and frustrating.
If I had millions of listings this would be impossible. How many of your customers are trying to manage really large databases? How are they doing it? Simply saying it all works in OpenOffice – I have read this response in the Forum a lot – isn’t really true I am afraid.
Any thoughts or improvements now or for the future very much appreciated.
Bests
Al 🙂
Hi,
1. Even though I changed the import file size in GD>General>Import file size. I am getting this error?
Array( [error] => The uploaded file exceeds the upload_max_filesize directive in php.ini.)x
2. Also is there anyway a non-imported listing can be identified apart from reexporting the data and checking on Openoffice or libreoffice?
Bests
Al
Thanks again 🙂
Hi Stiofan,
It crashes when I am not logged in but when I am logged in (as an admin) it doesn’t crash.
Is this a GD problem or BP problem?
Bests
Al
4. I had to rebuild the whole data set 🙁
6. Does this mean I can leave the chrome tab with the import running, open another tab and still work in GD backend?
7.2 unfortunately no. I have to edit 2 fields. I think I will just export batches, fix and reimport.
8. Would it be possible to add a post_id range as well as date range? In that way you can identify small batches imported on the same date?
Thanks
Al
