I'm pretty sure I know the issue is the unreliable data import capabilities in Sugar, but thought I would throw this out and see if there is any solution.

I have a custom module which has a N:1 relationship with Contacts. As I am importing records, I keep encountering errors which seem to just pop up after x rows. There is no pattern. I can import thousands of records, but then it just decides to crap out. I've found that batches of 2,000 rows seems to be the most reliable. The bother is that I have 76,000 rows of data.

Code:
Example error: WARNING: [2] fopen(cache/modules/Teams/Teamvardefs.php) [function.fopen]: failed to open stream: Invalid argument on line 95 in file C:\wamp\www\sugarcrm_gw2\include\utils\sugar_file_utils.php
The other include error I see is looking for cache/modules/Contacts/Contactvardefs.php which is, of course present.

I am importing via Sugar so it will link to Contacts. However, I am thinking that I could write a PHP script that could do the job of setting up the relationships - far more reliably. I'm already able to do an initial data population via Talend. I feel like I'm wasting my time importing via Sugar.

Comments?

Jay

Windows Server 2008 R2
Sugar Pro 5.5.2
PHP 5.2.11
MySQL 5.1.36
Apache 2.2.11

128MB max memory
600 sec execution time

-- it never fails due to timeout, always the sugar errors