Poor search performance

Next topic

Author	Message
Roberto Moreda Álvarez	Thursday 12 June 2003 7:39:16 pm Hi. I'm trying ezpublish 3.1.0-2 with mysql-4.0.12, php-4.2.3 and apache 1.3.27. If I use the search facility (from admin design, by exmaple) looking for "the thing" (including the quotation marks) the mysql-server gets a very high load for a long time... Any obvious optimization hints?
Bård Farstad	Thursday 12 June 2003 11:26:20 pm How big is your database? Normally the search should be very fast. --bård Documentation: http://ez.no/doc
Roberto Moreda Álvarez	Friday 13 June 2003 2:56:05 am Need more testing... The problem is narrowed to searchs where one word have latin1 characters like "ñ" (it works with other like "áéíóú"). In case of a single word with "ñ" the search result is always 0, and in case of "the thingñ" the mysql thread simply hangs using 100% of cpu.
Bård Farstad	Friday 13 June 2003 3:28:14 am Please let us know what you find. I know there are some problems with those characters, but I haven't seen a performance impact because of it. --bård Documentation: http://ez.no/doc
Roberto Moreda Álvarez	Saturday 14 June 2003 4:04:31 pm Hi! Two findings about my problems with search: - The performance problem it's related to a incorrect join planification in mysql under certain circunstances. In ezsearchengine.php, the SELECT JOINs, when we populate the temporary table, are executed in a suboptimal order. To overcome this I have rewrited the SQL sentences using "LEFT JOIN" constructs to force a join order execution. This solved the problem. Now the searches are fast as expected. - The problem related with the search of words with latin1 characters are due to the mysql treatment of string comparison. This leads to situations where "españa" is equal to "espana" for mysql :-(. This is a problem with words that have different meaning depending on a "ñ" or "n" character... The solution is to declare the phrase and word fields as "BINARY" in mysql creation tables. I have a patch for both cases. If it can be useful I'll send it to some email address. Regards. Rober
Jerry Jalava	Wednesday 18 June 2003 2:16:20 am Hola Roberto! Could you send this patch to Contributions area? I need it for this portal that is coming up... It's Finnish/Spanish/Swedish, so I need the special characters to work in search... Regards, Jerry

eZ debug

Timing:	Jan 18 2025 10:59:22
Script start
Timing:	Jan 18 2025 10:59:22
Module start 'layout'
Timing:	Jan 18 2025 10:59:22
Module start 'content'
Timing:	Jan 18 2025 10:59:23
Module end 'content'
Timing:	Jan 18 2025 10:59:23
Script end

Main resources:

Total runtime	1.0826 sec
Peak memory usage	4,096.0000 KB
Database Queries	68

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0049	589.0391	152.6250
Module start 'layout'	0.0049	0.0025	741.6641	39.4453
Module start 'content'	0.0074	1.0736	781.1094	601.8750
Module end 'content'	1.0810	0.0015	1,382.9844	16.1719
Script end	1.0825		1,399.1563

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0031	0.2885	16	0.0002
Check MTime	0.0012	0.1119	16	0.0001
Mysql Total
Database connection	0.0008	0.0758	1	0.0008
Mysqli_queries	1.0246	94.6473	68	0.0151
Looping result	0.0006	0.0596	66	0.0000
Template Total	1.0550	97.5	2	0.5275
Template load	0.0021	0.1977	2	0.0011
Template processing	1.0529	97.2592	2	0.5264
Template load and register function	0.0002	0.0185	1	0.0002
states
state_id_array	0.0007	0.0623	1	0.0007
state_identifier_array	0.0008	0.0774	2	0.0004
Override
Cache load	0.0018	0.1672	32	0.0001
Sytem overhead
Fetch class attribute can translate value	0.0005	0.0469	3	0.0002
Fetch class attribute name	0.0011	0.1028	7	0.0002
XML
Image XML parsing	0.0007	0.0680	3	0.0002
class_abstraction
Instantiating content class attribute	0.0000	0.0017	8	0.0000
General
dbfile	0.0008	0.0733	17	0.0000
String conversion	0.0000	0.0006	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
6	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
9	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
2	content/datatype/view/ezimage.tpl	<No override>	extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tpl
5	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 24 Number of unique templates used: 6

Time used to render debug report: 0.0001 secs