Forums / Developer / Norwegian characters problem with eZ Standard Search

Norwegian characters problem with eZ Standard Search

Author Message

Anders Berre

Thursday 16 September 2010 5:13:24 am

Hi guys (and girls)

I am having some problems with the search. The problem is I wan`t to search after a object called "La deg inspirere". I know its in eZ Publish. But it will not show. After debugging I found the reason. The search for phrase is splitted up to find the words in a order. And this causes some problems. Because in the sql-tables there is a word "La" but also a word "Lå". This results in that the string match must be "La Lå deg inspirere".

Anyone had the same problem, and could provide me with a solution?

I have tried to truncate the ezsearch_object_word_link table and run the bin/php/updatesearchindex.php --clean -s nor but that gave me no luck.

Looking forward to get some replies from you hard core eZ Publish people :-)

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

Gaetano Giunta

Thursday 16 September 2010 10:08:25 am

might be overkill, but switching to ezfind should solve yuor problem: it has much better support for ut8 and non-latin8 charsets

Principal Consultant International Business
Member of the Community Project Board

Anders Berre

Thursday 16 September 2010 11:56:02 pm

Hi Gaetano,

And thanks for your reply. Yes It will in this case be overkill. So I need to find an soloution that will work on standard search.

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

André R.

Friday 17 September 2010 2:37:55 am

Hi Anders.

Did you isolate where in ezsearch this is happening?

eZ Online Editor 5: http://projects.ez.no/ezoe || eZJSCore (Ajax): http://projects.ez.no/ezjscore || eZ Publish EE http://ez.no/eZPublish/eZ-Publish-Enterprise-Subscription
@: http://twitter.com/andrerom

Anders Berre

Friday 17 September 2010 3:46:44 am

Ah, at last. The forum told me to login, but I was logged in. But every time I loaded this page the page thought I was not logged in...

Anyway. The problem is isolated to the sql-queries. So if its eZ Publish that fails or its the sql-database, I really don`t know. But I guess its the database. I tried to run SELECT * FROM .. where I putted the word='La'. This result in two rows. In with La and one with Lå.

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

André R.

Friday 17 September 2010 8:54:08 am

what kind is the MySQL (& connection) collation set to?

should be utf8_danish_ci for instance.

eZ Online Editor 5: http://projects.ez.no/ezoe || eZJSCore (Ajax): http://projects.ez.no/ezjscore || eZ Publish EE http://ez.no/eZPublish/eZ-Publish-Enterprise-Subscription
@: http://twitter.com/andrerom

Anders Berre

Monday 20 September 2010 12:12:37 am

Hi André,

Thanks for your reply. Collation is set to utf8_general_ci.

What do you mean by (& connection)?

Sincerely,

Anders Sandvik Berre
http://www.netmaking.no/

eZ debug

Timing: Jan 17 2025 23:55:52
Script start
Timing: Jan 17 2025 23:55:52
Module start 'content'
Timing: Jan 17 2025 23:55:54
Module end 'content'
Timing: Jan 17 2025 23:55:54
Script end

Main resources:

Total runtime1.2320 sec
Peak memory usage4,096.0000 KB
Database Queries208

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0062 588.9766180.8125
Module start 'content' 0.00621.0933 769.7891633.5781
Module end 'content' 1.09950.1325 1,403.3672341.0547
Script end 1.2320  1,744.4219 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00400.3225210.0002
Check MTime0.00150.1214210.0001
Mysql Total
Database connection0.00070.057610.0007
Mysqli_queries1.143392.79502080.0055
Looping result0.00240.19612060.0000
Template Total1.202297.620.6011
Template load0.00220.177420.0011
Template processing1.200097.398820.6000
Template load and register function0.00020.016910.0002
states
state_id_array0.00100.080810.0010
state_identifier_array0.00080.065120.0004
Override
Cache load0.00190.1554330.0001
Sytem overhead
Fetch class attribute can translate value0.00160.132140.0004
Fetch class attribute name0.00120.1009100.0001
XML
Image XML parsing0.00360.291340.0009
class_abstraction
Instantiating content class attribute0.00000.0025140.0000
General
dbfile0.00690.5631400.0002
String conversion0.00000.000630.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
7content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
7content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
7content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 23
 Number of unique templates used: 5

Time used to render debug report: 0.0001 secs