Import errors occurred in contact data

[david00]

Hi Sugar forums,

We have just set up Sugar CE 5.2.0d on a Linux server. I am trying to import a large CSV of contact data using Contacts > Import. I have several issues:

1. The whole CSV won't import - Sugar just redirects to the home page when I try to advance to step 2. I suspect this might be because it's too large (17M), so I split it up into 6 pieces. This brings me to the next problem...

2. Piece 1 contains about 1000 contacts. I am mapping the Primary Address, Alternative Address, Phone, Fax, Description and Name fields. According to the tooltip, I should be able to save these mappings and then select them in Step 1 during another import attempt. But this doesn't happen - after an import, there's no selection box for saved mappings displayed in step 1.

3. When actually attempting to import the CSV, I see a progress bar briefly, then Sugar displays a blank dialog box with the title 'Import Errors Occurred'. If I now go back to the contacts view, I see only 200 contacts were imported. It doesn't tell me what the errors were, or which contacts weren't imported.

How can I fix this and import the whole database of contacts? The ones that imported correctly seem to be okay.

I tried setting the log level to 'debug', but the log is all SQL queries, without any errors.

Thanks,
David

[shamimwilson]

hi you can easily import large data as i have successfully imported 9000 records at one attempt.
just try to map the fields properly.
once you get the error download it and see what mistake you are making and try to short out those mistake and again import it.
you can undo import if all the datas are not being able to import

[david00]

Hi shamimwilson,

Thanks for your reply. When I try to import the whole CSV, I don't get the chance to map the data - I am instantly redirected to the home page after step 1.
Sugar does not offer me to download the list of errors, so I don't know where my mappings are going wrong.
Also, I don't get the option to undo an import.
It sounds like something is very different in your install.

My details: Ubuntu Linux (Hardy), using MySQL database, Apache web server.

Thanks.

[david00]

Bump - can anyone help with this?

[andopes]

Hi David

Rename the sugarcrm.log to another name;
Try again importing one of the files;
Check the sugarcrm.log for any error message regarding the importing process.

Let us know it.

Regards

[david00]

The only way to get any log output at all is to set log level to 'Info' - all higher levels give no output.
When this level is, set, all the output is SQL queries. No errors are shown.

I have pasted the last 100 lines of the logfile here: http://pastebin.com/m35cf0848

Not sure how useful that is, though.

[david00]

Having increased the memory_limit to 128M, the first CSV is now importing correctly, and saved mappings are working correctly as well.

[SergeiLo]

Hi David,

Bump - can anyone help with this?

Did you try to use any ETL tool to import your records to SugarCRM? You may try to use Apatar Open Source data migration and integration tool. You may import your records directly from the source (no need to export to CSV first) or from CSV file to SugarCRM. You will need to use connector for textFile and the connector for SugarCRM and transform operation. In Transform you will need to map the fields you would like to import. It will llok like:

textfile connector (with your CSV file) --> Transform operation (with mapped field to import) --> SugarCRM connector

And all your records will be in SugarCRM.

Regards,
Sergei