eZFind2 index script fetch only objects not in IndexExclude

Next topic

Author	Message
Denitsa M.	Tuesday 12 May 2009 8:34:17 am Hi, I had wondered for some time why does index script do subtree call with no regard for classes that are excluded in settings (ezfind.ini) and then in solr scripts simply skip to index the current iteration object if it is of one of those listed classes ... Isn't in more efficient to iterate only through objects that will be indexed indeed? For a database of 150-200 000 objects, if 50000 objects should not be indexed, this means that I will have memory and CPU power engaged pointlessly into fetching, caching and looping through 50000 objects that should be "skipped" ... This is not problem for small databases at the scale of below 60000-80000 objects, but larger? Thanks, Denitsa. Iguana IT - http://www.iguanait.com
Nicolas Pastorino	Tuesday 12 May 2009 11:25:40 pm Hi Denitsa, Good catch indeed. Would you mind filing a bug report on http://issues.ez.no/ezfind ? Thanks in advance, Best Regards, -- Nicolas Pastorino Director Community - eZ Member of the Community Project Board eZ Publish Community on twitter: http://twitter.com/ezcommunity t : http://twitter.com/jeanvoye G+ : http://plus.tl/jeanvoye
Denitsa M.	Wednesday 13 May 2009 2:59:49 am Hi, Nic, thanks for suggestion, I followed your advice and reported here http://issues.ez.no/IssueView.php?Id=14903&activeItem=1 :) Deni Iguana IT - http://www.iguanait.com

Author

Message

Tuesday 12 May 2009 8:34:17 am

Hi,

I had wondered for some time why does index script do subtree call with no regard for classes that are excluded in settings (ezfind.ini) and then in solr scripts simply skip to index the current iteration object if it is of one of those listed classes ... Isn't in more efficient to iterate only through objects that will be indexed indeed? For a database of 150-200 000 objects, if 50000 objects should not be indexed, this means that I will have memory and CPU power engaged pointlessly into fetching, caching and looping through 50000 objects that should be "skipped" ... This is not problem for small databases at the scale of below 60000-80000 objects, but larger?

Thanks,
Denitsa.

Iguana IT - http://www.iguanait.com

Nicolas Pastorino

Tuesday 12 May 2009 11:25:40 pm

Hi Denitsa,

Good catch indeed. Would you mind filing a bug report on http://issues.ez.no/ezfind ?

Thanks in advance,
Best Regards,

--
Nicolas Pastorino
Director Community - eZ
Member of the Community Project Board

eZ Publish Community on twitter: http://twitter.com/ezcommunity

t : http://twitter.com/jeanvoye
G+ : http://plus.tl/jeanvoye

Denitsa M.

Wednesday 13 May 2009 2:59:49 am

Hi, Nic,

thanks for suggestion, I followed your advice and reported here http://issues.ez.no/IssueView.php?Id=14903&activeItem=1 :)

Deni

Iguana IT - http://www.iguanait.com

eZ debug

Timing:	Jan 18 2025 04:31:04
Script start
Timing:	Jan 18 2025 04:31:04
Module start 'layout'
Timing:	Jan 18 2025 04:31:04
Module start 'content'
Timing:	Jan 18 2025 04:31:04
Module end 'content'
Timing:	Jan 18 2025 04:31:04
Script end

Main resources:

Total runtime	0.0234 sec
Peak memory usage	2,048.0000 KB
Database Queries	3

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0090	589.3047	152.6563
Module start 'layout'	0.0090	0.0042	741.9609	39.5078
Module start 'content'	0.0132	0.0078	781.4688	89.3984
Module end 'content'	0.0210	0.0023	870.8672	34.3047
Script end	0.0233		905.1719

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0043	18.2292	14	0.0003
Check MTime	0.0013	5.4015	14	0.0001
Mysql Total
Database connection	0.0011	4.7678	1	0.0011
Mysqli_queries	0.0044	18.8374	3	0.0015
Looping result	0.0000	0.0776	1	0.0000
Template Total	0.0019	8.1	1	0.0019
Template load	0.0012	5.2393	1	0.0012
Template processing	0.0007	2.8207	1	0.0007
Override
Cache load	0.0009	4.0453	1	0.0009
General
dbfile	0.0002	1.0134	8	0.0000
String conversion	0.0000	0.0469	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded	Edit	Override
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 1 Number of unique templates used: 1

Time used to render debug report: 0.0001 secs