CSV format problems. How to make SugarCRM happy?

[Sugar-Daddy]

I have a csv with over 1,000 products listed. s the csv was the result of a mysql dump, there are carriage returns in the content, as well as quotes, etc.

I have done many test/example imports, and the mapping, etc. is fine. The problem is that I need to easily condition, or prepare, the csv file for input. Sugar will just ignore confusing lines, and every CRLF creates another record.

So what tools are there out there, or even Perl scripts, that can prepare a fairly 'dirty' csv file that came from MySQL for import? The fact that the one I'm doing is products should not matter.

Thanks for your thoughts!

[Angel]

Are you able to access the MySQL database from which the CSV file was generated?

If so, you could use something like Talend Open Studio to read the data directly from the MySQL database and then input it into Sugar, eliminating the need for the CSV.

[Sugar-Daddy]

Angel,

I've read your posts for years, and you are very knowledgeable & helpful.

I can't make file queries, as I have no local/shell access. I do, however, access with MySQL Workbench. I can't seem to find an option for using the options like FIELDS TERMINATED BY, and many others, without exporting to a file, as in:

SELECT a,b,c FROM my_table INTO OUTFILE '/ca.csv' FIELDS TERMINATED BY ';' LINES TERMINATED BY '\n';

I understand that this is a borderline MySQL question, so please forgive me. If any of you use a tool to grab data and put it into Sugar like this, I'd really like to hear from you!

TIA!

[Angel]

If you can access the database via Workbench, it means you have a MySQL user/pass you can use to connect to the MySQL server.

You could use that within Talend to extract the data and pump it into Sugar, completely circumventing the need for the CSV file, per my previous message.

[Sugar-Daddy]

Angel,

Once again thanks, but Talend doesn't appear to allow Product manipulation:



I'll keep looking to see if someone figured thsi out, or if it is a pay option for Talend.

Thanks for the tip!

[Angel]

It seems it only lists the modules that correspond with CE. Try using the "Custom Module" selection in the list and see if that works. Personally, I've had mixed results using it, but haven't spent a great deal of time tinkering with that option.

BTW, thanks for the compliment in your previous message. Happy to help.