Translations & encoding problems (.ts files)

Next topic

Author	Message
Ludovic André	Thursday 08 February 2007 12:10:06 am Hi all, I'm currently having a problem with the translation system. I'm generating the XML translation file on a server A, and I noticed that special characters (like é, è, ...) are converted to the HEX HTML code (é, ...). So far, this is still working on my server A, sentences containing those special characters are still found by the CMS, and the translation is correctly displayed. Now, I moved my translation.ts files to a server B, and there the special characters are not found anymore, the CMS can't find the 'source' sentence in the translation.ts file, and all those messages containing the special characters are not translated anymore... (but the others are!) Which differences between server A & B could lead to that problem? (Please note that I opened the template file & translation file on server B to see if there was any problems after uploading the files, and there are no changes with server A, the content is the same - the eZ setup of the site itself is also the same). Thanks for your help! Ludovic André
Ludovic André	Thursday 08 February 2007 12:52:26 am Some more details about my problem: After some tests inside the eZ code, I found out this difference between server A & B, when ez is looking for the translations: server A, running fine: eztranslatormanager Object ( [Handlers] => Array ( [0] => eztstranslator Object ( [IsKeyBased] => 1 [Messages] => Array ( [3bf24ce0ec94cd82720184848a1d31f6] => Array ( [context] => bcee/dpp [source] => Demande de prêt personnel [comment] => [translation] => Personal loan request [key] => 3bf24ce0ec94cd82720184848a1d31f6 ) server B, same scripts, eztranslatormanager Object ( [Handlers] => Array ( [0] => eztstranslator Object ( [IsKeyBased] => 1 [Messages] => Array ( [f9f26a43b59903480b4f9c7e5e8cc5ed] => Array ( [context] => bcee/dpp [source] => Demande de prêt personnel [comment] => [translation] => Personal loan request [key] => f9f26a43b59903480b4f9c7e5e8cc5ed ) So on server B, it's not converting back the ê into " ê ", and then the md5 key is not correct anymore... If that can help you (to help me ;) ) Thanks! Ludovic André
Ludovic André	Thursday 08 February 2007 5:01:52 am Ok, quick update :) I'm answering my own questions ;) So, what I did right now, is a quick php script to convert those hex html entities to the real character behind, and then use iconv to encode the file into utf8. As from now, everything is now running fine, my translations are correctly taken into account... But, it would be really great If I could skip this step of converting the file... why does not ezlupdate generate directly the file into utf8 ? (like the translations.ts which come with the original distribution?) Ludovic André

Author

Message

Thursday 08 February 2007 12:10:06 am

Hi all,

I'm currently having a problem with the translation system. I'm generating the XML translation file on a server A, and I noticed that special characters (like é, è, ...) are converted to the HEX HTML code (é, ...). So far, this is still working on my server A, sentences containing those special characters are still found by the CMS, and the translation is correctly displayed. Now, I moved my translation.ts files to a server B, and there the special characters are not found anymore, the CMS can't find the 'source' sentence in the translation.ts file, and all those messages containing the special characters are not translated anymore... (but the others are!)

Which differences between server A & B could lead to that problem?
(Please note that I opened the template file & translation file on server B to see if there was any problems after uploading the files, and there are no changes with server A, the content is the same - the eZ setup of the site itself is also the same).

Thanks for your help!

Ludovic André

Thursday 08 February 2007 12:52:26 am

Some more details about my problem:

After some tests inside the eZ code, I found out this difference between server A & B, when ez is looking for the translations:

server A, running fine:

eztranslatormanager Object
(
    [Handlers] => Array
        (
            [0] => eztstranslator Object
                (
                    [IsKeyBased] => 1
                    [Messages] => Array
                        (
                            [3bf24ce0ec94cd82720184848a1d31f6] => Array
                                (
                                    [context] => bcee/dpp
                                    [source] => Demande de prêt personnel
                                    [comment] => 
                                    [translation] => Personal loan request
                                    [key] => 3bf24ce0ec94cd82720184848a1d31f6
                                )

server B, same scripts,

eztranslatormanager Object
(
    [Handlers] => Array
        (
            [0] => eztstranslator Object
                (
                    [IsKeyBased] => 1
                    [Messages] => Array
                        (
                            [f9f26a43b59903480b4f9c7e5e8cc5ed] => Array
                                (
                                    [context] => bcee/dpp
                                    [source] => Demande de pr&#xea;t personnel
                                    [comment] => 
                                    [translation] => Personal loan request
                                    [key] => f9f26a43b59903480b4f9c7e5e8cc5ed
                                )

So on server B, it's not converting back the ê into " ê ", and then the md5 key is not correct anymore...

If that can help you (to help me ;) )

Thanks!

Ludovic André

Thursday 08 February 2007 5:01:52 am

Ok, quick update :) I'm answering my own questions ;)

So, what I did right now, is a quick php script to convert those hex html entities to the real character behind, and then use iconv to encode the file into utf8.

As from now, everything is now running fine, my translations are correctly taken into account...

But, it would be really great If I could skip this step of converting the file... why does not ezlupdate generate directly the file into utf8 ? (like the translations.ts which come with the original distribution?)

Ludovic André

eZ debug

Timing:	Jan 18 2025 22:13:05
Script start
Timing:	Jan 18 2025 22:13:05
Module start 'layout'
Timing:	Jan 18 2025 22:13:05
Module start 'content'
Timing:	Jan 18 2025 22:13:05
Module end 'content'
Timing:	Jan 18 2025 22:13:05
Script end

Main resources:

Total runtime	0.7182 sec
Peak memory usage	4,096.0000 KB
Database Queries	55

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0050	588.0391	152.6406
Module start 'layout'	0.0050	0.0024	740.6797	39.4609
Module start 'content'	0.0075	0.7093	780.1406	473.3281
Module end 'content'	0.7168	0.0014	1,253.4688	12.1406
Script end	0.7182		1,265.6094

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0029	0.4077	16	0.0002
Check MTime	0.0013	0.1793	16	0.0001
Mysql Total
Database connection	0.0010	0.1370	1	0.0010
Mysqli_queries	0.6738	93.8151	55	0.0123
Looping result	0.0005	0.0762	53	0.0000
Template Total	0.6894	96.0	2	0.3447
Template load	0.0018	0.2576	2	0.0009
Template processing	0.6876	95.7361	2	0.3438
Template load and register function	0.0002	0.0279	1	0.0002
states
state_id_array	0.0013	0.1820	1	0.0013
state_identifier_array	0.0008	0.1048	2	0.0004
Override
Cache load	0.0015	0.2149	23	0.0001
Sytem overhead
Fetch class attribute can translate value	0.0006	0.0815	1	0.0006
Fetch class attribute name	0.0011	0.1476	3	0.0004
XML
Image XML parsing	0.0001	0.0191	1	0.0001
class_abstraction
Instantiating content class attribute	0.0000	0.0012	3	0.0000
General
dbfile	0.0011	0.1492	10	0.0001
String conversion	0.0000	0.0008	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
3	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
6	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
1	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
2	content/datatype/view/ezxmltags/literal.tpl	<No override>	extension/community/design/standard/templates/content/datatype/view/ezxmltags/literal.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 14 Number of unique templates used: 6

Time used to render debug report: 0.0001 secs