Search and UTF-8 doesn't work

Next topic

Author	Message
andreas spahr	Monday 17 November 2003 10:33:27 am I'm using ez 3.2.1 with mysql 4.1 and the unicode support works fine. But one problems remains: if I enter an english search word, the search result is ok. if I enter a cyrillic word, the search result shows all objects. Both search words are in the same class attributes. And it makes no difference, if one is a text line and the other is a xml text field. can someone give me a hint? regards
andreas spahr	Tuesday 18 November 2003 6:18:14 am Hi, maybe there is a problem with indexing the utf-8 characters. the table ezsearch_word contains only latin characters. I suppose, that the search with utf-8 works, because there is a well known site, www.fast.no, where the search seems to work with japanes language. but i have still no idea what the reason could be.
andreas spahr	Tuesday 18 November 2003 8:33:59 am -- ok, now it works: I don't know really why, one reason could be to start this again: myisamchk -r -q --set-character-set=utf-8 /var/lib/mysql/ezdatabase/ezsearch_*.MYI

Author

Message

Monday 17 November 2003 10:33:27 am

I'm using ez 3.2.1 with mysql 4.1 and the unicode support works fine.
But one problems remains:
if I enter an english search word, the search result is ok. if I enter a cyrillic word, the search result shows all objects.

Both search words are in the same class attributes. And it makes no difference, if one is a text line and the other is a xml text field.

can someone give me a hint?

regards

andreas spahr

Tuesday 18 November 2003 6:18:14 am

Hi,
maybe there is a problem with indexing the utf-8 characters. the table ezsearch_word contains only latin characters.

I suppose, that the search with utf-8 works, because there is a well known site, www.fast.no, where the search seems to work with japanes language.
but i have still no idea what the reason could be.

andreas spahr

Tuesday 18 November 2003 8:33:59 am

-- ok, now it works: I don't know really why, one reason could be to start this again:
myisamchk -r -q --set-character-set=utf-8 /var/lib/mysql/ezdatabase/ezsearch_*.MYI

eZ debug

Timing:	Jan 19 2025 04:20:54
Script start
Timing:	Jan 19 2025 04:20:54
Module start 'layout'
Timing:	Jan 19 2025 04:20:54
Module start 'content'
Timing:	Jan 19 2025 04:20:55
Module end 'content'
Timing:	Jan 19 2025 04:20:55
Script end

Main resources:

Total runtime	0.6475 sec
Peak memory usage	4,096.0000 KB
Database Queries	55

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0070	589.1563	152.6250
Module start 'layout'	0.0070	0.0036	741.7813	39.4453
Module start 'content'	0.0106	0.6355	781.2266	435.0547
Module end 'content'	0.6461	0.0013	1,216.2813	8.1641
Script end	0.6475		1,224.4453

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0033	0.5055	16	0.0002
Check MTime	0.0013	0.2023	16	0.0001
Mysql Total
Database connection	0.0011	0.1648	1	0.0011
Mysqli_queries	0.6069	93.7356	55	0.0110
Looping result	0.0005	0.0713	53	0.0000
Template Total	0.5909	91.3	2	0.2955
Template load	0.0020	0.3046	2	0.0010
Template processing	0.5889	90.9549	2	0.2945
Template load and register function	0.0001	0.0181	1	0.0001
states
state_id_array	0.0011	0.1637	1	0.0011
state_identifier_array	0.0015	0.2370	2	0.0008
Override
Cache load	0.0016	0.2492	17	0.0001
Sytem overhead
Fetch class attribute can translate value	0.0004	0.0692	1	0.0004
Fetch class attribute name	0.0011	0.1759	3	0.0004
XML
Image XML parsing	0.0001	0.0155	1	0.0001
class_abstraction
Instantiating content class attribute	0.0000	0.0010	3	0.0000
General
dbfile	0.0009	0.1398	10	0.0001
String conversion	0.0000	0.0012	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
3	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
4	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
4	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 13 Number of unique templates used: 5

Time used to render debug report: 0.0001 secs