Importing 274K records for contacts (another CRM) - help!

[sugarhoney]

I'm trying to import a CSV contact file from another CRM - it doesn't have an account at this moment.

The CRM I'm using has a table that's almost identical to the "contacts" table in

sugarcrm. I am able to use SQL to query the top 100 rows, export those result to a CSV file, and then import the contacts using Sugarcrm with the mapping feature just fine - as doing also

creates one-to-one matching account for that contact.

However, only 57 contacts are imported. I'm guessing it's because some of them have a blank account name or contact/firstname/lastname?

Anyways, when I export 274,000 rows from my old CRM to a CSV and then to import using

sugarcrm, I get a timeout error. I believe the file was too big. What's the import file to change so I can add a "set_time_limit(0); // No time limit for this script"?

SO, I figure, why not import 20,000 rows at a time? This would require having 14 seperate CSV files to be imported.

Another thought was to connect to my old CRM on SQL Server 2000 using a PHP script. This PHP script would open a connection to Goldmine on SQL Server and also a MySQL connection to connect to sugarcrm. Then it would query the "contact" table in Goldmine SQL Server to copy the data to the "contacts" table in sugarcrm. Thus far, I know the "contacts", "accounts", and "accounts_contacts" tables are should be affected. In that case, what files do I need to look up? I know the "id" field is given a unique id in "contacts", so I'll like to know how that ID is generated? What import files should I go and edit in sugarcrm?

[Angel]

That's a pretty good size GM database.

To answer your question, the ID is generated by the function create_guid() in <sugar root>/include/utils.php

[kuske]

You can use the mysql standard function uuid() to create unique Sugar Ids.
You can even take any unique string of maximal 36 chars

[urosslak]

I had the same problem importing big cvs files.
I solved it by increasing php memory size and time to execute parameters in php.ini.:
max_execution_time = 3000 ; Maximum execution time of each script, in second
s
max_input_time = 6000 ; Maximum amount of time each script may spend parsing r
equest data
memory_limit = 768M ; Maximum amount of memory a script may consume

I hope it helps

Uros