Charset problems in script

Next topic

Author	Message
Jo Henrik Endrerud	Friday 23 February 2007 5:08:45 am I'm making an import-script on an eZp 3.8.6 installation and I'm having some problems with international characters (i.e. ÆØÅ). Creating objects /editing in the admin interface works perfectly, and if the CLI script writes output to the screen this also works like it should. It's only when the script writes to the database, the output looks wrong in the web-interface (Norwegian characters are translated to question marks). The question marks are also stored in the database. I am running the $script->initialize(); near the top of my script so character settings are read from the INI files as it should. Anyone knows which setting to alter to make PHP CLI write to the database in the same way as Apache PHP does? -Jo Henrik Jo Henrik Endrerud \| System Developer @ Seeds Consulting \| http://www.seeds.no
Kristian Hole	Friday 23 February 2007 9:43:08 am Hi Jo Henrik, I will recommend you to implement it as a cronjob-script. Then all the settings are set up in the same way as in the modues without you having to do anything :-) You typically need an extension with a structure like this: extension/myimport \|-- cronjobs \| `-- import.php `-- settings `-- cronjob.ini.append.php Where cronjob.ini is like this; [CronjobPart-import] Scripts[] Scripts[]=import.php [CronjobSettings] ExtensionDirectories[]=myimport and you run it like $ php runcronjobs.php import Otherwise, look at the textcodec updates in soap.php in the root folder. Kristian http://ez.no/ez_publish/documenta...tricks/show_which_templates_are_used http://ez.no/doc/ez_publish/techn...te_operators/miscellaneous/attribute
Arno Bouwens	Monday 08 September 2008 7:49:05 am I had exactly the same problem as described above. The solution that worked for me was to use the php-function utf8_encode(). e.g.: $contentObjectAttribute->setAttribute( 'data_text', utf8_encode($firstname)); instead of simply: $contentObjectAttribute->setAttribute( 'data_text', $firstname);

Author

Message

Friday 23 February 2007 5:08:45 am

I'm making an import-script on an eZp 3.8.6 installation and I'm having some problems with international characters (i.e. ÆØÅ).

Creating objects /editing in the admin interface works perfectly, and if the CLI script writes output to the screen this also works like it should. It's only when the script writes to the database, the output looks wrong in the web-interface (Norwegian characters are translated to question marks). The question marks are also stored in the database.

I am running the $script->initialize(); near the top of my script so character settings are read from the INI files as it should.

Anyone knows which setting to alter to make PHP CLI write to the database in the same way as Apache PHP does?

-Jo Henrik

Jo Henrik Endrerud | System Developer @ Seeds Consulting | http://www.seeds.no

Kristian Hole

Friday 23 February 2007 9:43:08 am

Hi Jo Henrik,

I will recommend you to implement it as a cronjob-script. Then all the settings are set up in the same way as in the modues without you having to do anything :-)

You typically need an extension with a structure like this:

extension/myimport
|-- cronjobs
|   `-- import.php
`-- settings
    `-- cronjob.ini.append.php

Where cronjob.ini is like this;

[CronjobPart-import]
Scripts[]
Scripts[]=import.php

[CronjobSettings]
ExtensionDirectories[]=myimport

and you run it like
$ php runcronjobs.php import

Otherwise, look at the textcodec updates in soap.php in the root folder.

Kristian

http://ez.no/ez_publish/documenta...tricks/show_which_templates_are_used
http://ez.no/doc/ez_publish/techn...te_operators/miscellaneous/attribute

Arno Bouwens

Monday 08 September 2008 7:49:05 am

I had exactly the same problem as described above. The solution that worked for me was to use the php-function utf8_encode().
e.g.:

$contentObjectAttribute->setAttribute( 'data_text', utf8_encode($firstname));

instead of simply:

$contentObjectAttribute->setAttribute( 'data_text', $firstname);

eZ debug

Timing:	Jan 18 2025 11:23:12
Script start
Timing:	Jan 18 2025 11:23:12
Module start 'layout'
Timing:	Jan 18 2025 11:23:12
Module start 'content'
Timing:	Jan 18 2025 11:23:13
Module end 'content'
Timing:	Jan 18 2025 11:23:13
Script end

Main resources:

Total runtime	0.8179 sec
Peak memory usage	4,096.0000 KB
Database Queries	59

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0054	587.9141	152.6250
Module start 'layout'	0.0054	0.0030	740.5391	39.4453
Module start 'content'	0.0084	0.8078	779.9844	568.8359
Module end 'content'	0.8162	0.0017	1,348.8203	12.1641
Script end	0.8179		1,360.9844

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0030	0.3689	16	0.0002
Check MTime	0.0013	0.1617	16	0.0001
Mysql Total
Database connection	0.0006	0.0704	1	0.0006
Mysqli_queries	0.7678	93.8758	59	0.0130
Looping result	0.0006	0.0707	57	0.0000
Template Total	0.7862	96.1	2	0.3931
Template load	0.0020	0.2393	2	0.0010
Template processing	0.7843	95.8888	2	0.3921
Template load and register function	0.0002	0.0238	1	0.0002
states
state_id_array	0.0009	0.1098	1	0.0009
state_identifier_array	0.0010	0.1251	2	0.0005
Override
Cache load	0.0016	0.1996	25	0.0001
Sytem overhead
Fetch class attribute can translate value	0.0006	0.0706	3	0.0002
Fetch class attribute name	0.0010	0.1277	4	0.0003
XML
Image XML parsing	0.0008	0.1029	3	0.0003
class_abstraction
Instantiating content class attribute	0.0000	0.0013	4	0.0000
General
dbfile	0.0008	0.0966	16	0.0000
String conversion	0.0000	0.0009	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
3	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
6	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
1	content/datatype/view/ezimage.tpl	<No override>	extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tpl
4	content/datatype/view/ezxmltags/literal.tpl	<No override>	extension/community/design/standard/templates/content/datatype/view/ezxmltags/literal.tpl
2	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 18 Number of unique templates used: 7

Time used to render debug report: 0.0002 secs