Forums / General / Scalability with a LOT of content

Scalability with a LOT of content

Author Message

Gabriel Ambuehl

Saturday 13 November 2004 7:59:49 am

How's 3.5 gonna work for sites with a few thousand, tens of thousands or even hundreds of thousands of objects?

The particular project I'm concerned about won't be heavy load (very little traffic expected) but there will eventually be at least tens of thousands objects (including images, with say 20 attributes per object) in many categories.

Am I in for a scalability nightmare or is this gonna work fine (a low end dedicated box will be used but I'd hate to have to go for dual or quad boxes, much less clustering)?

How will the admin interface (especially the dynamic tree in 3.5) cope with it?

Visit http://triligon.org

Frederik Holljen

Saturday 13 November 2004 8:07:09 am

eZ publish currently scales to around 500.000 objects. We are running several projects with an object count close to this.

The tree menu of course does not scale to that many objects (the amount of data alone would be far more than most connections can handle). Therefore it is configurable; you can configure what object types to display, the max depth to display and the maximum number of nodes.

Gabriel Ambuehl

Saturday 13 November 2004 8:09:55 am

Thanks for your comment. Do the hardware needs climb noticeably for the same amount of traffic on large sites or will I mostly be fine with the same hardware for the same amount of traffic (we will try to pack DBs in RAM, of course)?

Visit http://triligon.org

eZ debug

Timing: Jan 18 2025 11:20:34
Script start
Timing: Jan 18 2025 11:20:34
Module start 'content'
Timing: Jan 18 2025 11:20:35
Module end 'content'
Timing: Jan 18 2025 11:20:35
Script end

Main resources:

Total runtime1.1098 sec
Peak memory usage4,096.0000 KB
Database Queries194

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0060 588.8438180.8359
Module start 'content' 0.00600.9288 769.6797534.7969
Module end 'content' 0.93480.1749 1,304.4766332.9063
Script end 1.1097  1,637.3828 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00450.4054210.0002
Check MTime0.00150.1355210.0001
Mysql Total
Database connection0.00130.117010.0013
Mysqli_queries1.034593.20991940.0053
Looping result0.00230.20631920.0000
Template Total1.077497.120.5387
Template load0.00250.228120.0013
Template processing1.074996.852520.5374
Template load and register function0.00030.024410.0003
states
state_id_array0.00110.095910.0011
state_identifier_array0.00310.278220.0015
Override
Cache load0.00210.1918130.0002
Sytem overhead
Fetch class attribute can translate value0.00150.133830.0005
Fetch class attribute name0.00320.292740.0008
XML
Image XML parsing0.00110.100830.0004
class_abstraction
Instantiating content class attribute0.00000.001240.0000
General
dbfile0.00310.2749270.0001
String conversion0.00000.000630.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
3content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
3content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
1content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 9
 Number of unique templates used: 5

Time used to render debug report: 0.0001 secs