Import Errors Occured - Out of Memory

[Pravo]

php.ini

resrouces set to:

;;;;;;;;;;;;;;;;;;;
; Resource Limits ;
;;;;;;;;;;;;;;;;;;;

max_execution_time = 6000
max_input_time = 600
memory_limit = 64M

Hostgator.com is the hosting company and they say 64M is the maximum allowed.

Trying to update records and am currently not able to import/update a 47k file.

Here is the error received:

Fatal error: Out of memory (allocated 32505856) (tried to allocate 73 bytes) in /home/account/public_html/SugarDirectory/include/utils/db_utils.php on line 209

If I try the import again I receive:

Fatal error: Out of memory (allocated 32768000) (tried to allocate 47 bytes) in /home/account/public_html/SugarDirectory/include/database/MysqliManager.php on line 243

I've seen other people posting with similar errors but the suggestions always point back to the php.ini file. I don't know what else to do and I can't update 9,000 records 4 records at a time which is what I'm able to do currently.

Please help.

[crmsiva]

Make sure your memory_limit = 64M . Because, 32505856 ~ 31 MB and it is trying to allocate just 73 bytes. Put a phpinfo file and check whether the memory limit is set to 64M.

[Pravo]

It is set for 64M. I ran the phpinfo with the hosting provider and verified it. It appears that the script is taking a huge amount of memory to run a small import. Why would it need to allocate 20+Meg to import a 100k file? It doesn't allow me to export very much data either. Basically I have 9,000 records I can't update or export.

[crmsiva]

The minimum memory requirement for sugar is 40M or higher. Please check this

Since you have 9000 records, i think increasing memory limit is the only choice. IMO, find a better hosting provider.

[JVWay]

This is probably not a memory limit problem. I've had and seen this occur in cases of bad data. Review your data and look for apostrophes. Sugar, and a lot of import tools, have problems with apostrophes as they are often interpreted as delimiters.

You can also try to import in multiple small batches. This is an effective way of determining which is the bad set of data.

Also, which data set are you trying to import?

[ajsmith]

64mb memory for importing 9000 records is not enough. Try using the next .htaccess entries :

php_value max_execution_time 60000
php_value memory_limit "512M"

And please check your config.php file

'import_max_execution_time' => 36000,
'import_max_records_per_file' => '60000',

[jmertic]

Another option you have is to alter the record theshold. Since Sugar 5.1, the import process will split the import file into smaller chunks to help alevate the out of memory errors. This theshold is set by default to 1000 records, but can be changed by setting the 'import_max_records_per_file' to a different number of records in the config.php file.

[Pravo]

I'm not working with all 9,000 accounts at a time. They are broken down into projects. Each project has approximately 500 to 700 records.

My hosting company increased the PHP memory to 200 and it still provided the memory errors. The script is driving up the memory.

Could there be a field limit in the import / export? I have added a lot of custom fields in the data. For example I can export out now about 700 records from one project but if I try to export out 500 records from a second project it gives the memory error. The second project has had more sales activity recorded in it.

At the same time it still wont let me update any records if the file is more than 40k. It seems like the problem with the import export started to occur when I added a data field. In the db_utils.php file error it does reference the section that seems to deal with the date.