Sugar loads slow in the Contacts/Accounts section

[sugarhoney]

Thanks for all the help thus far.

I'm trying to import 274K contacts from my old CRM to the sugarcrm. Now, the first 20K takes about 15 seconds to load when viewing the Contacts section. However, when I finally imported all 274K, the Contact page taes 17 minutes to load! I had to set the max execution time to 3600 seconds (1 hour). Does anyone know of a way reduce the load time? It seems when viewing the Accounts or Contacts page, Sugarcrm query all the rows in the table - so it becomes slow if there are more than 50K records.

[sugarhoney]

Well, how much data was sugar designed to hold? I imagine it can hold at least 1 million rows of contacts, right? Why does it load so slow for 100K+ records?

[dprah]

Hi, yes I have this problem as well. Could anyone help please, thank you.

[ptemplin7]

Hi,

There have been some other discussion about this int he forums before. Sugar works best importing smaller chucks.

Also, I assume you are using mysql.

One of the issue with mysql and other small and freebe DB's is they tend to get quite clutter after a while and need to be repacked. Importing a smaller amount at a time allow the mysql engine to process the data more efficiently. My guess is the machine you are on is shared and not a beefed up server. Thus the first part loads fast. I.e the buffer starts filling with data to process and you see the slowness once the computer has to wait for the processing and the buffer to clear a bit before loading the next set of info.

It can help to load contacts first then accounts as well (or visa versa). The more you try to load at the same time the more processing that is required, Any way to load simply the key fields first and then process all the misc. fields later?

Make sure mysql and your OS have lots of virtual memory and buffer space to play with. (See settings etc...)

Good luck importing,
Paris

[DragonflyMaster]

If you use MySQL,
think about which tables best fit your needs: InnoDB or MyISAM?

[datasponge]

I would try querying all account and contact info locally on the server and seeing what time the server reports.

I just did a quick query on my biggest table (not sugarcrm), which has over 700,000 records and it reported the query took just over 7 seconds.

Several days ago I did a query joining sugarcrm accounts and contacts and email_addresses to see how long it would take to dump all contact info for all accounts and contacts and it took 3.03 seconds for just over 20,000 records.

I'm using MySQL 5.0 with InnoDB on Mandriva 5 on an ordinary PC.

Once you know how long the server takes to look up the data, you will know better where to focus your efforts.

Phil