Forums / Developer / Weirds files making the site 320MB more fat

Weirds files making the site 320MB more fat

Author Message

Nicolò Zanetti

Monday 14 April 2008 7:47:30 am

Hi ezcommunity,
I was uploading a website that should be really small, just 4 pages, but the file of the directory was 391 MB uncompressed, that was a bit strange.
Having a step backward, this site is a copy paste and edit of a much larger site. Those files, something like 320MB, was in /var/ezwebin_site/storage/original/application, when i deleted the full /application directory the site still worked, and it's working with no problems, so this is almost solved, i just found that strange, have you any tip about what those file was and why they where such huge?

One more thing, in /var/ezwebin_site/storage/image/ there are all the images that i uploaded with the ezinterface, also the one of the copied site, it's a 36MB on 77MB space waste, I'm afraid it's a bit dangerous to delete them also if all the old nodes (the one from the copied site) where deleted and rewritten. If i manually delete them can this have conseguences on the site stability?

Maxime Thomas

Tuesday 15 April 2008 10:38:43 pm

Some information for you :
- eZPublish is using image aliasing : it means that each image you upload will be declined in several alias as small, medium and large pictures. If you have a lot of pictures it can take some space.
- eZPublish is versionning content. It means that each content you upload is stored and each time you edit this content, a bunch of new attributes will be created. It implies that if you use the File content to store big files (eg Windows SP1), and you see that you have made a mitake in the comment of the content and you modify it, the Windows SP1 is duplicated. You can limit that with some Version settings.
- all the data files (images, videos, PDF and so on) are stored in the var/<siteaccess> directory. If you delete them you will lose data files and so, if you try to download a file from the front interface, you will have an object not found error.

Hope it helps

Maxime Thomas
maxime.thomas@wascou.org | www.wascou.org | http://twitter.com/wascou

Company Blog : http://www.wascou.org/eng/Company/Blog
Technical Blog : http://share.ez.no/blogs/maxime-thomas

Nicolò Zanetti

Thursday 17 April 2008 1:13:37 am

Hi Thomas,
First of all thank you for your help.
If the only consequences of deleting those file will be "missing file error" I will delete them now, I was just worried about system error, since I don't need them in the copied site.
Anyway I haven't uploaded anything such huge in the site, and the removal of the var/siteaccess/storage/original/application directory hadn't any conseguences in the site, apart from the loss of some *.swf file, reuploaded, now it's everything fine.
Since I don't have unlimited disk space, any useless file deleted is a good thing.
Thank you again, bye

Nicolò Zanetti

Thursday 17 April 2008 3:32:31 am

Ok that 320 MB was the *.swf pdfs and all the other files I uploaded, like Thomas said, but they was about the main site I copied the data from, it was simple... now i know it.

All the pdf did lost their extension, and their original name (now they are something like "02d261ab6246eec2f8b3b3e8b1fbf06f") so it was not that easy to catch this, anyway if i upload a file by the ez interface, and than i delete it, it will still be there, because the local full site directory (images, swf, pdf, video, docs...) is 220MB, the ezpublish /storage/original/application itself is 320MB, and i deleted all the files that i use no more with ezinterface, so there is a lot of MB that still should be useless, and if i upload a file, i save the http adress , than i delete the file with the ezinterface and i use the saved adress i will still find the item. So I think that deleting them from the ez panel is just deleting the link, but the files are still there in that directory. But this is a waste of space, how can i clean it without a full wash&reupload operation?

eZ debug

Timing: Jan 18 2025 16:06:05
Script start
Timing: Jan 18 2025 16:06:05
Module start 'content'
Timing: Jan 18 2025 16:06:06
Module end 'content'
Timing: Jan 18 2025 16:06:06
Script end

Main resources:

Total runtime1.1071 sec
Peak memory usage4,096.0000 KB
Database Queries197

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0088 587.8438180.8125
Module start 'content' 0.00880.9199 768.6563560.1953
Module end 'content' 0.92870.1783 1,328.8516336.7422
Script end 1.1070  1,665.5938 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00410.3733210.0002
Check MTime0.00150.1355210.0001
Mysql Total
Database connection0.00240.216510.0024
Mysqli_queries1.028092.85591970.0052
Looping result0.00210.18731950.0000
Template Total1.067596.420.5338
Template load0.00240.220720.0012
Template processing1.065196.202820.5325
Template load and register function0.00020.020410.0002
states
state_id_array0.00150.133010.0015
state_identifier_array0.00150.139220.0008
Override
Cache load0.00210.1919240.0001
Sytem overhead
Fetch class attribute can translate value0.00150.131730.0005
Fetch class attribute name0.00100.091450.0002
XML
Image XML parsing0.00080.075230.0003
class_abstraction
Instantiating content class attribute0.00000.000950.0000
General
dbfile0.00310.2819270.0001
String conversion0.00000.000730.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
4content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
3content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
4content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
1content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 14
 Number of unique templates used: 6

Time used to render debug report: 0.0002 secs