Forums / Install & configuration / multi-language (chinese, english, german) installation with mysql: how?

multi-language (chinese, english, german) installation with mysql: how?

« 
Previous topic
|
Install & configuration
|
Next topic
 »
Author Message

Kai Duebbert

Thursday 27 March 2003 9:53:56 pm

Hi,

How can I do a multi-language installation with MySQL? Which codepage should I use?

eZ publish 3.0 is unusable with PostgreSQL 7.3.x so I can't go the unicode way. ;-(

Any suggestions?

Kai

Jan Borsodi

Friday 28 March 2003 1:57:52 am

Generally you can't do multi-language installations on MySQL unless the languages use the same characters and are a western language. There's supposed to come a new version with Unicode support but I don't if it's here yet.

Regarding codepages you could have used cp932 for this.

The other problem is that multi-byte charsets are not 100% supported yet, the reason for this is that PHP and all it's string handling functions are built around single-byte characters. For instance regular expressions will fail. This is something that we will continue to improve with future releases.

--
Amos

Documentation: http://ez.no/ez_publish/documentation
FAQ: http://ez.no/ez_publish/documentation/faq

Tony Wood

Friday 28 March 2003 4:21:08 am

How stable is eZ3 under PostgreSQL? it would appear that this is a better database platform for eZ if you require multiple languages, do you agree?

Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development

Power to the Editor!

Free eZ Training : http://www.VisionWT.com/training
eZ Future Podcast : http://www.VisionWT.com/eZ-Future

Sergiy Pushchin

Friday 28 March 2003 4:47:22 am

eZ publish 3 is stable on postgrsql 7.2.x but not on 7.3.x.
But there are still some problems with unicode and eZ publish.
We will make support for 7.3.x asap and improve multi-language (unicode ) support.

Kai Duebbert

Saturday 29 March 2003 6:15:53 pm

Ok, I will probably wait for postgresql 7.3.x support. Any (rough!) guess when the fix will be released or in svn?

Kai

Fady Chakik

Monday 31 March 2003 11:57:48 pm

Hello,

Read This about Internationalization under MySQL...

http://www.mysql.com/doc/en/Nutshell_4.1_features.html

-Fadi

Tony Wood

Wednesday 02 April 2003 1:20:41 am

I was reading this Fadi,

Have you used 4.1? i know 4.0 has achieved production status, but is 4.1 in any fit state?

Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development

Power to the Editor!

Free eZ Training : http://www.VisionWT.com/training
eZ Future Podcast : http://www.VisionWT.com/eZ-Future

David Heath

Thursday 10 April 2003 4:22:29 am

HI Sergey,

can you reveal any more about the current status of utf8 support in ezpublish 3. It is a major issue for us at OneWorld. I presume ezpublish 3 supports postgres 7.2.x OK, surely this would support utf8 with no problem?

Best regards

David Heath

David Heath

Thursday 10 April 2003 4:25:28 am

Sorry, have just read back the thread, so I see you have confirmed support for PG 7.2.x.

I would be interested to know exactly what you mean when you say there are "still some problems" with unicode support? Are these show-stoppers, or can they be lived with/worked around?

Thanks

Dave

Jan Borsodi

Thursday 10 April 2003 8:30:27 am

How well eZ publish will work with Unicode really depends on what parts of eZ publish is used.

The major problem with Unicode (or other multibyte encodings) is that PHP was designed for singlebyte encodings (default is latin1) and thus many of the string handling functions has problems with such strings.
With the mb_string extension compiled in it's possible to get more support for Unicode however there are still lots of string functions with support for it.

Currently some of the datatypes (which uses regular expressions for validation) and the search engine (due to upper/lower case handling) will have problem with Unicode.

We will continue to improve the support for Unicode with the next 3.x releases, for instance the 3.1 release will solve some of the issues with cases and searching.

--
Amos

Documentation: http://ez.no/ez_publish/documentation
FAQ: http://ez.no/ez_publish/documentation/faq

David Heath

Thursday 10 April 2003 9:00:40 am

Hi Jan,

thanks for your response. I understand the issues with PHP support for multibyte character encodings and have been researching them myself.

Re: regexp support for UTF8, there are two areas:

1. ereg

2. preg_match (the PCRE libraries)

For 1, the solution is simple, which is to use mb_ereg, or even enable the mbstring override mode which replaces standard ereg with mb_ereg etc. I would hope that this is being done throught eZ3 code.

For 2, I have made further enquiries. Please see the following post which I made to the php.i18n group:

http://news.php.net/article.php?group=php.i18n&article=530

And the response from Wez Furlong, the PCRE maintainer:

http://news.php.net/article.php?group=php.i18n&article=531

In other words, it sounds like PCRE should support UTF8 fine from php 4.3 onwards.

Are there other specific problems with unicode support which you are aware of?

Obviously case handling is a difficult one as it requires locale awareness which I'm not sure if there is any support for in any libraries (possibly ICU? http://oss.software.ibm.com/icu/).

We are currently investigating the possibility of supporting UTF8 in ez 2.x.

Thanks for your help.

Dave

Jan Borsodi

Friday 11 April 2003 4:01:29 am

I'll look into the PCRE in PHP 4.3 and the ICU project when I start on the i18n improvements. Case and priority tables will probably solve most of the problems.

The only other problem with Unicode as I see it is the database support (sorting and string operations), using PostgreSQL, Oracle and the latest MySQL version will probably fix this problem.
Also using Unicode will slow down the site, especially without the mb_string extension.

--
Amos

Documentation: http://ez.no/ez_publish/documentation
FAQ: http://ez.no/ez_publish/documentation/faq

eZ debug

Timing: Jan 18 2025 10:55:52
Script start
Timing: Jan 18 2025 10:55:52
Module start 'content'
Timing: Jan 18 2025 10:55:53
Module end 'content'
Timing: Jan 18 2025 10:55:53
Script end

Main resources:

Total runtime1.5580 sec
Peak memory usage4,096.0000 KB
Database Queries229

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0067 588.0859180.7891
Module start 'content' 0.00671.3812 768.8750798.0547
Module end 'content' 1.38790.1700 1,566.9297353.2813
Script end 1.5579  1,920.2109 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00400.2555210.0002
Check MTime0.00140.0912210.0001
Mysql Total
Database connection0.00090.056510.0009
Mysqli_queries1.436792.20992290.0063
Looping result0.00320.20732270.0000
Template Total1.526398.020.7631
Template load0.00200.129120.0010
Template processing1.524297.831120.7621
Template load and register function0.00020.014210.0002
states
state_id_array0.00110.067710.0011
state_identifier_array0.00090.057220.0004
Override
Cache load0.00190.1211720.0000
Sytem overhead
Fetch class attribute can translate value0.00120.077270.0002
Fetch class attribute name0.00250.1579150.0002
XML
Image XML parsing0.00340.216470.0005
class_abstraction
Instantiating content class attribute0.00000.0027180.0000
General
dbfile0.00980.6258400.0002
String conversion0.00000.000530.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
12content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
14content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
6content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
3content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 37
 Number of unique templates used: 6

Time used to render debug report: 0.0002 secs