Forums / Suggestions / eZFind2 index script fetch only objects not in IndexExclude

eZFind2 index script fetch only objects not in IndexExclude

Author Message

Denitsa M.

Tuesday 12 May 2009 8:34:17 am

Hi,

I had wondered for some time why does index script do subtree call with no regard for classes that are excluded in settings (ezfind.ini) and then in solr scripts simply skip to index the current iteration object if it is of one of those listed classes ... Isn't in more efficient to iterate only through objects that will be indexed indeed? For a database of 150-200 000 objects, if 50000 objects should not be indexed, this means that I will have memory and CPU power engaged pointlessly into fetching, caching and looping through 50000 objects that should be "skipped" ... This is not problem for small databases at the scale of below 60000-80000 objects, but larger?

Thanks,
Denitsa.

Iguana IT - http://www.iguanait.com

Nicolas Pastorino

Tuesday 12 May 2009 11:25:40 pm

Hi Denitsa,

Good catch indeed. Would you mind filing a bug report on http://issues.ez.no/ezfind ?

Thanks in advance,
Best Regards,

--
Nicolas Pastorino
Director Community - eZ
Member of the Community Project Board

eZ Publish Community on twitter: http://twitter.com/ezcommunity

t : http://twitter.com/jeanvoye
G+ : http://plus.tl/jeanvoye

Denitsa M.

Wednesday 13 May 2009 2:59:49 am

Hi, Nic,

thanks for suggestion, I followed your advice and reported here http://issues.ez.no/IssueView.php?Id=14903&activeItem=1 :)

Deni

Iguana IT - http://www.iguanait.com

eZ debug

Timing: Jan 18 2025 01:04:33
Script start
Timing: Jan 18 2025 01:04:33
Module start 'content'
Timing: Jan 18 2025 01:04:33
Module end 'content'
Timing: Jan 18 2025 01:04:33
Script end

Main resources:

Total runtime0.5181 sec
Peak memory usage4,096.0000 KB
Database Queries194

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0061 589.0859180.7969
Module start 'content' 0.00610.4055 769.8828539.1641
Module end 'content' 0.41150.1065 1,309.0469334.5156
Script end 0.5181  1,643.5625 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00390.7525210.0002
Check MTime0.00140.2736210.0001
Mysql Total
Database connection0.00090.164810.0009
Mysqli_queries0.456388.05711940.0024
Looping result0.00170.32191920.0000
Template Total0.493295.220.2466
Template load0.00220.431420.0011
Template processing0.491094.755120.2455
Template load and register function0.00020.033810.0002
states
state_id_array0.00080.156510.0008
state_identifier_array0.00070.136720.0004
Override
Cache load0.00190.3608170.0001
Sytem overhead
Fetch class attribute can translate value0.00130.242830.0004
Fetch class attribute name0.00130.242440.0003
XML
Image XML parsing0.00060.121830.0002
class_abstraction
Instantiating content class attribute0.00000.006440.0000
General
dbfile0.00400.7628270.0001
String conversion0.00000.001030.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
3content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
5content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
2content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
1content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 13
 Number of unique templates used: 6

Time used to render debug report: 0.0002 secs