No support for international characters

[george_bbch]

I've tried this on several instances of 4.2.0d and 4.2.1a, using both PHP 4.4.2 and 5, IIS and Apache, and MySQL 5, but the result is always the same: when I try to create and save an account that has international characters in a field (German umlauts, French accents, Spanish ñ, etc) it returns MySQL error 1406: Data too long for column [column_name] at row 1
Has anybody a hint for me on this? It's pretty important and urgent.

Thanks,
George

P.S.: The MySQL is configured for InnoDB tables, utf8 as default character set and utf8_general_ci as collation

[malcolmh]

Hallo George,

You say you are running Sugar in an UTF-8 environment, what did you change in Sugar to enable UTF-8? What did you change in your LAMP environment?

We have a customer environment (4.2.0d) running UTF-8 for 6 different languages, with no problems in the area you describe.

[george_bbch]

Hallo George,

You say you are running Sugar in an UTF-8 environment, what did you change in Sugar to enable UTF-8? What did you change in your LAMP environment?

We have a customer environment (4.2.0d) running UTF-8 for 6 different languages, with no problems in the area you describe.

Hallo Malcolm,

I experience the problem on the systems below:

- a test machine running W2K Server, MySQL 5, PHP 5.0.4, Apache 2
- the live server running W2K Server, MySQL 5, PHP 4.4.2, IIS 5

On each machine there's a 4.2.0d and a 4.2.1a installation (no add-ons, no customizations).

Actually, on the live machine the behaviour is a bit different: the MySQL error doesn't appear, but the text after the special character is deleted (e.g. instead of Zürcherstr. I get Z)

Thanks,
George

[malcolmh]

George,

What did you change in Sugar to work with the UTF-8 support?

With 4.2.0d we made changes in he following places:

File: \install\PerformSetup.php
Old: $query = 'create database `' . $setup_db_database_name . '`';
New: $query = 'create database `' . $setup_db_database_name . '` DEFAULT CHARACTER SET utf8 COLLATE utf8_unicode_ci';

File: \include\language\en_us.php
Old: 'LBL_CHARSET' => 'ISO-8859-1',
New: 'LBL_CHARSET' => 'UTF-8',

File: config.php
Old: 'default_charset' => 'ISO-8859-1',
New: 'default_charset' => 'UTF-8',

File: \include\database\PearDatabase.php
Old: $this->database =@mysql_pconnect($this->dbHostName,$this->userName,$this->userPassword);
Added: @mysql_query("SET NAMES 'utf8'", $this->database);


From what I read the last change will not work in 4.2.1 due to development work for other DB systems. Did you find a resolution for this.

Malcolm

[george_bbch]

George,

What did you change in Sugar to work with the UTF-8 support?

Nothing that I'm aware of. It was an out-of-the-box installation.

Are you suggesting that SugarCRM actually doesn't support UTF-8?

George

[malcolmh]

Are you suggesting that SugarCRM actually doesn't support UTF-8?

George

Officially utf-8 will be supported as of Version 4.5.

With the modifications in my previous post, utf-8 is supported with Sugar for the current 4.2.0x version, there are though some issues with the interfaces to external systems, i.e. Outlook Plug-In, Word Plug-in; vCards, exporting data to Excel, printing to PDF. All of the issues apart from the last mentioned have been resolved in the latest 4.5 CP version AFAIA.

[george_bbch]

Officially utf-8 will be supported as of Version 4.5.

With the modifications in my previous post, utf-8 is supported with Sugar for the current 4.2.0x version, there are though some issues with the interfaces to external systems, i.e. Outlook Plug-In, Word Plug-in; vCards, exporting data to Excel, printing to PDF. All of the issues apart from the last mentioned have been resolved in the latest 4.5 CP version AFAIA.

Malcolm,

Thanks for the precious information. Is there another way to handle international characters that works with the current out-of-the-box versions?

George

[malcolmh]

Malcolm,

Thanks for the precious information. Is there another way to handle international characters that works with the current out-of-the-box versions?

George

Provided you don't need Eastern European or Asia language support, it would probably work with the standard Latin environment and not the UTF-8 you are currently trying

[george_bbch]

Provided you don't need Eastern European or Asia language support, it would probably work with the standard Latin environment and not the UTF-8 you are currently trying

Right, thanks again. If I install and configure 4.2.x with standard latin environment and then upgrade to 4.5, will the system a) keep the latin settings, b) migrate automatically and trouble-free to utf-8, c) help me decide what's best and do the job for me, d) tell me about the imminence of a change, but no further assistance, etc?

[malcolmh]

Right, thanks again. If I install and configure 4.2.x with standard latin environment and then upgrade to 4.5, will the system a) keep the latin settings, b) migrate automatically and trouble-free to utf-8, c) help me decide what's best and do the job for me, d) tell me about the imminence of a change, but no further assistance, etc?

AFAIK a) as of 4.5 standard installation UTF-8 b) the system will be automatically migrated to UTF-8 c) no options as I am aware d) ??