Forums / Developer / How to convert data from KOI-8 to UTF-8

How to convert data from KOI-8 to UTF-8

Author Message

Vytautas Germanavičius

Tuesday 19 October 2004 4:29:29 am

I made site with EZ 3.3.3. Site is in russian. Instaler set encoding to KOI-8. So all data in site are entered using that encoding.
Now i would like to add data in lithuanian (encoding iso8859-13 or UTF-8).
But how to convert all data from old database to new?

{set-block scope=root variable=cache_ttl}0{/set-block}

Björn Dieding@xrow.de

Wednesday 20 October 2004 2:30:12 am

My guess:
I think if you are using mysql you can do this by upgrading to Mysql 4.1.X.

There are comando line scripts shipped with mysql to convert dbs into other charset.

Check the mysql docs.

Looking for a new job? http://www.xrow.com/xrow-GmbH/Jobs
Looking for hosting? http://hostingezpublish.com
-----------------------------------------------------------------------------
GMT +01:00 Hannover, Germany
Web: http://www.xrow.com/

Mikhail Chekanov

Wednesday 20 October 2004 3:25:50 am

For Mysql:
1. Dump the database to file and convert it to UTF with iconv.
2. Replace all occurrences of "KOI-8" in this file with "UTF-8"
3. reCreate db from dump :)
But: latest beta of MySQL 4.1 has a bug - http://www.ez.no/community/bug_reports/mysql_error_1071_with_utf8_db_on_kernel_injection
so you should use iso8859-13
Does it support cyrillic charcters?

--
mike
#6595551

Vytautas Germanavičius

Wednesday 20 October 2004 6:42:01 am

I think, this was reason, why site with converted data did not work fo me.
Does EZ 3.4.1 use different from 3.3.3 db structure ?

iso-8859-13 is contains latin and baltic character sets.
only UTF-8 encoding has both character sets lithuanian and russian

Another question, is any way to export from 3.3.3 and import to 3.4.1 only MY entered data without EZ system data?

{set-block scope=root variable=cache_ttl}0{/set-block}

Mikhail Chekanov

Thursday 21 October 2004 3:22:08 am

>Does EZ 3.4.1 use different from 3.3.3 db structure ?
Yes. Not entirely different, though not exactly the same.

Another question, is any way to export from 3.3.3 and import to 3.4.1 only MY entered data without EZ system data?
Yes. Look for upgrade scripts in /update/database/mysql/

--
mike
#6595551

eZ debug

Timing: Jan 19 2025 15:21:28
Script start
Timing: Jan 19 2025 15:21:28
Module start 'content'
Timing: Jan 19 2025 15:21:29
Module end 'content'
Timing: Jan 19 2025 15:21:29
Script end

Main resources:

Total runtime0.6600 sec
Peak memory usage4,096.0000 KB
Database Queries202

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0054 589.0703180.8281
Module start 'content' 0.00540.5548 769.8984605.1875
Module end 'content' 0.56030.0997 1,375.0859337.3828
Script end 0.6600  1,712.4688 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00370.5580210.0002
Check MTime0.00140.2078210.0001
Mysql Total
Database connection0.00060.088510.0006
Mysqli_queries0.598690.68832020.0030
Looping result0.00160.24202000.0000
Template Total0.638696.820.3193
Template load0.00180.276120.0009
Template processing0.636896.483920.3184
Template load and register function0.00010.011410.0001
states
state_id_array0.00070.108810.0007
state_identifier_array0.00050.077320.0003
Override
Cache load0.00160.2374330.0000
Sytem overhead
Fetch class attribute can translate value0.00100.149740.0002
Fetch class attribute name0.00080.116870.0001
XML
Image XML parsing0.00110.166540.0003
class_abstraction
Instantiating content class attribute0.00000.001880.0000
General
dbfile0.00250.3732330.0001
String conversion0.00000.000930.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
3content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
5content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
7content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
7content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 24
 Number of unique templates used: 6

Time used to render debug report: 0.0002 secs