Forums / General / How many objects can eZPublish handle?

How many objects can eZPublish handle?

Author Message

Ivo Lukac

Monday 16 June 2008 6:22:45 am

Is there some real experience on where are the practical limits? One million objects maybe?
At which point system is no longer usable?

What is the bottleneck for this? meta database model or tree model or something else?

What can be done to prepare for this:
- reduce number of attributes per object?
- something else?

What can be done when we reach the limits:
- reduce number of versions?
- disable smart view cache?
- go to clustering?
- something else?

Thanks for any info

http://www.linkedin.com/in/ivolukac
http://www.netgen.hr/eng/blog
http://twitter.com/ilukac

Piotrek Karaƛ

Thursday 23 October 2008 7:08:43 am

I support these questions ;)

--
Company: mediaSELF Sp. z o.o., http://www.mediaself.pl
eZ references: http://ez.no/partners/worldwide_partners/mediaself
eZ certified developer: http://ez.no/certification/verify/272585
eZ blog: http://ez.ryba.eu

Ivo Lukac

Thursday 23 October 2008 8:10:36 am

It is rather sad that nobody answered in 3 month :(

http://www.linkedin.com/in/ivolukac
http://www.netgen.hr/eng/blog
http://twitter.com/ilukac

Gaetano Giunta

Thursday 23 October 2008 11:20:57 am

<i>Is there some real experience on where are the practical limits? One million objects maybe?</i>

Hard to give an estimate based on number of objects. It depends on:
- attributes per object
- languages per object
- object versions per object
- object relations per object

1 million is not a pain point, most likely. 10 millions could be.

<i>At which point system is no longer usable?</i>

It depends on the definition of "usable". Editors often have a very different pov than users (eg. preview-generation time can be all to them, but it has little correlation to front-end performance).

<i>What is the bottleneck for this? meta database model or tree model or something else?</i>

The database model of eZP is built for flexibility (eg class definition via backoffice), not speed. It usually becomes a bottleneck at some point.

But there are just so many factors that is very hard to give a real estimate:
- bad templates can kill an eZP site with 10000 objects
- cache-block tuning can be a subtle art. Use them, but don't overdo them
- smart-view-cache configuration is a subtle art, too
- static cache can improve a lot response times if generating a page template takes too long, but it imposes heavy requirements on design of the site
- do not put too many objects inside a single parent folder
- be careful with workflows

<i>What can be done to prepare for this:
- reduce number of attributes per object?
- something else?

What can be done when we reach the limits:
- reduce number of versions?
- disable smart view cache?
- go to clustering?
- something else?</i>

See above for some hints.eZ cluster will not help very much - if at all - with scaling the number of objects. Reduce number of versions stored. Instead of disabling smart cache, check CacheThreshold in site.ini.

Principal Consultant International Business
Member of the Community Project Board

eZ debug

Timing: Jan 18 2025 11:24:12
Script start
Timing: Jan 18 2025 11:24:12
Module start 'content'
Timing: Jan 18 2025 11:24:13
Module end 'content'
Timing: Jan 18 2025 11:24:13
Script end

Main resources:

Total runtime1.2460 sec
Peak memory usage4,096.0000 KB
Database Queries199

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0051 588.8438180.8359
Module start 'content' 0.00511.1039 769.6797615.6484
Module end 'content' 1.10900.1369 1,385.3281337.3750
Script end 1.2459  1,722.7031 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00400.3187210.0002
Check MTime0.00150.1187210.0001
Mysql Total
Database connection0.00050.039010.0005
Mysqli_queries1.164893.48091990.0059
Looping result0.00210.16821970.0000
Template Total1.215697.620.6078
Template load0.00230.182020.0011
Template processing1.213397.373620.6066
Template load and register function0.00020.013310.0002
states
state_id_array0.00090.073910.0009
state_identifier_array0.00110.091020.0006
Override
Cache load0.00200.1612510.0000
Sytem overhead
Fetch class attribute can translate value0.00140.111440.0003
Fetch class attribute name0.00170.138070.0002
XML
Image XML parsing0.00160.132240.0004
class_abstraction
Instantiating content class attribute0.00000.001280.0000
General
dbfile0.00190.1509410.0000
String conversion0.00000.000530.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
4content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
4content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
7content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
10content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 27
 Number of unique templates used: 6

Time used to render debug report: 0.0001 secs