Forums / Suggestions / ez with big web site

ez with big web site

Author Message

stephane couzinier

Saturday 25 November 2006 2:41:16 am

1)Image storage
It will be usefull to change the storage dir for big web site.
Actually when I upload a image, the url contains :
/myfolder/myfolder2/imgname.png
Maybe it's a nice way to find it on the drive and for google but
if i have hundred of folder on ez, I will have hundred of directory on my filesystem.
Just try to list a directory with millions of file or folder ....

Maybe it'll be a go way to store file like the cache files:
url will be /0/1/4/aaa.png

2) static cache
I have the same trouble with the static cache.
the static cache, create on folder and one index page for each nodes.
with this system, it's easy to configure apache to find the good page, but what happen if I have a folder with 10000 object ,I will have 10000 directory on my disk with 1 file in each folder.
Why don't you use the same way of the cache file?

don't flush the cache

Björn Dieding@xrow.de

Sunday 26 November 2006 2:34:48 pm

I think eZ can't scale in this way

if you have millions of files and images... you have doing it the native way millions of content objects

eZ will not work with such a high number of content objects.

I would try to write a mail to eZ systems.... you just hit a limit... you need a alternate storage...

Looking for a new job? http://www.xrow.com/xrow-GmbH/Jobs
Looking for hosting? http://hostingezpublish.com
-----------------------------------------------------------------------------
GMT +01:00 Hannover, Germany
Web: http://www.xrow.com/

stephane couzinier

Tuesday 28 November 2006 2:48:47 pm

So what the limit of ez (not only for the storage but for the number of object EZ could manage)
How many users/objects (small object with 10 or less attributes and big object with 20 attributes) ez will manage?

I don't think I need to have millions of images to have a bug with the filesystem.
Just try to list a directory when you have more than 10000 sub folders.

How do you manage your 50000 post? do you use special extension?

Thanks for your answer.

don't flush the cache

Björn Dieding@xrow.de

Tuesday 28 November 2006 4:53:24 pm

eZ says the limit is wiht 250000 contentobjects

Looking for a new job? http://www.xrow.com/xrow-GmbH/Jobs
Looking for hosting? http://hostingezpublish.com
-----------------------------------------------------------------------------
GMT +01:00 Hannover, Germany
Web: http://www.xrow.com/

Bård Farstad

Wednesday 29 November 2006 1:07:21 am

Just to clearify: eZ does not say that the limit of eZ publish is 250 000 objects.

The eZ publish 3.8 package was tested with 2 million objects and it worked fine.

The performance and number of objects is no an exact science though. It does depend on the design of the content architecture. If you e.g. have all the objects in the same folder you get performance issues with sorting when you have large amount of objects under one node. It does also depend on the structure of your content classes. Some setups are heavier than others. So, to know the limitations of your setup you need to test for this.

Our testing was done with the standard content class setup in eZ publish. We created folders with 5 000 articles in each folder using a 3 level hierarchy.

Cheers,

-bård

Documentation: http://ez.no/doc

Björn Dieding@xrow.de

Wednesday 29 November 2006 11:05:03 am

For your information...

I took the number of 250000 from the eZ network plans... the standard support plans support only up to 250000 objects.

I have also read from the forums that people were getting troubles with more as 200000 objects.

So my figure might be just something reasonable. Though is bard sais it highly depends.

Looking for a new job? http://www.xrow.com/xrow-GmbH/Jobs
Looking for hosting? http://hostingezpublish.com
-----------------------------------------------------------------------------
GMT +01:00 Hannover, Germany
Web: http://www.xrow.com/

stephane couzinier

Friday 26 January 2007 11:32:44 am

Just for information ez publish work great with 400000 object (4 M lines in the ezcontentobject_attribute table)

We just have to change the user system and it'll be great...

don't flush the cache

Łukasz Serwatka

Friday 26 January 2007 12:29:27 pm

The eZ publish 3.8 package was tested with 2 million objects and it worked fine.

Actually it was tested with more then 4 million objects and it worked fine ;)

Personal website -> http://serwatka.net
Blog (about eZ Publish) -> http://serwatka.net/blog

eZ debug

Timing: Jan 31 2025 00:23:24
Script start
Timing: Jan 31 2025 00:23:24
Module start 'content'
Timing: Jan 31 2025 00:23:24
Module end 'content'
Timing: Jan 31 2025 00:23:24
Script end

Main resources:

Total runtime0.1967 sec
Peak memory usage8,192.0000 KB
Database Queries141

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0110 587.9063370.3047
Module start 'content' 0.01100.0150 958.21091,013.6094
Module end 'content' 0.02600.1706 1,971.82033,905.2188
Script end 0.1966  5,877.0391 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00482.4153200.0002
Check MTime0.00140.7338200.0001
Mysql Total
Database connection0.00130.656410.0013
Mysqli_queries0.094748.12791410.0007
Looping result0.00130.66091390.0000
Template Total0.170286.510.1702
Template load0.00070.365510.0007
Template processing0.169586.164910.1695
Override
Cache load0.00050.257810.0005
Sytem overhead
Fetch class attribute can translate value0.00201.022010.0020
XML
Image XML parsing0.00020.116010.0002
General
dbfile0.01135.7339200.0006
String conversion0.00000.006130.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 1
 Number of unique templates used: 1

Time used to render debug report: 0.0001 secs