Norwegian characters problem with eZ Standard Search

Author Message

Anders Berre

Thursday 16 September 2010 5:13:24 am

Hi guys (and girls)

I am having some problems with the search. The problem is I wan`t to search after a object called "La deg inspirere". I know its in eZ Publish. But it will not show. After debugging I found the reason. The search for phrase is splitted up to find the words in a order. And this causes some problems. Because in the sql-tables there is a word "La" but also a word "Lå". This results in that the string match must be "La Lå deg inspirere".

Anyone had the same problem, and could provide me with a solution?

I have tried to truncate the ezsearch_object_word_link table and run the bin/php/updatesearchindex.php --clean -s nor but that gave me no luck.

Looking forward to get some replies from you hard core eZ Publish people :-)

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

Gaetano Giunta

Thursday 16 September 2010 10:08:25 am

might be overkill, but switching to ezfind should solve yuor problem: it has much better support for ut8 and non-latin8 charsets

Principal Consultant International Business
Member of the Community Project Board

Anders Berre

Thursday 16 September 2010 11:56:02 pm

Hi Gaetano,

And thanks for your reply. Yes It will in this case be overkill. So I need to find an soloution that will work on standard search.

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

André R.

Friday 17 September 2010 2:37:55 am

Hi Anders.

Did you isolate where in ezsearch this is happening?

eZ Online Editor 5: http://projects.ez.no/ezoe || eZJSCore (Ajax): http://projects.ez.no/ezjscore || eZ Publish EE http://ez.no/eZPublish/eZ-Publish-Enterprise-Subscription
@: http://twitter.com/andrerom

Anders Berre

Friday 17 September 2010 3:46:44 am

Ah, at last. The forum told me to login, but I was logged in. But every time I loaded this page the page thought I was not logged in...

Anyway. The problem is isolated to the sql-queries. So if its eZ Publish that fails or its the sql-database, I really don`t know. But I guess its the database. I tried to run SELECT * FROM .. where I putted the word='La'. This result in two rows. In with La and one with Lå.

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

André R.

Friday 17 September 2010 8:54:08 am

what kind is the MySQL (& connection) collation set to?

should be utf8_danish_ci for instance.

eZ Online Editor 5: http://projects.ez.no/ezoe || eZJSCore (Ajax): http://projects.ez.no/ezjscore || eZ Publish EE http://ez.no/eZPublish/eZ-Publish-Enterprise-Subscription
@: http://twitter.com/andrerom

Anders Berre

Monday 20 September 2010 12:12:37 am

Hi André,

Thanks for your reply. Collation is set to utf8_general_ci.

What do you mean by (& connection)?

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

Powered by eZ Publish™ CMS Open Source Web Content Management. Copyright © 1999-2014 eZ Systems AS (except where otherwise noted). All rights reserved.

eZ debug

Timing: Jan 29 2025 23:49:49
Script start
Timing: Jan 29 2025 23:49:49
Module start 'layout'
Timing: Jan 29 2025 23:49:49
Module start 'content'
Timing: Jan 29 2025 23:49:49
Module end 'content'
Timing: Jan 29 2025 23:49:49
Script end

Main resources:

Total runtime0.0116 sec
Peak memory usage2,048.0000 KB
Database Queries3

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0042 588.2813151.2266
Module start 'layout' 0.00420.0018 739.507836.6797
Module start 'content' 0.00610.0045 776.187598.0938
Module end 'content' 0.01050.0011 874.281341.9922
Script end 0.0116  916.2734 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.001916.6903140.0001
Check MTime0.00098.0854140.0001
Mysql Total
Database connection0.00065.416310.0006
Mysqli_queries0.001916.222230.0006
Looping result0.00000.069810.0000
Template Total0.00086.910.0008
Template load0.00065.313610.0006
Template processing0.00021.523510.0002
Override
Cache load0.00043.779910.0004
General
dbfile0.00119.728080.0001
String conversion0.00000.053440.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1print_pagelayout.tpl<No override>extension/community/design/community/templates/print_pagelayout.tplEdit templateOverride template
 Number of times templates used: 1
 Number of unique templates used: 1

Time used to render debug report: 0.0001 secs