Weirds files making the site 320MB more fat

Author Message

Nicolò Zanetti

Monday 14 April 2008 7:47:30 am

Hi ezcommunity,
I was uploading a website that should be really small, just 4 pages, but the file of the directory was 391 MB uncompressed, that was a bit strange.
Having a step backward, this site is a copy paste and edit of a much larger site. Those files, something like 320MB, was in /var/ezwebin_site/storage/original/application, when i deleted the full /application directory the site still worked, and it's working with no problems, so this is almost solved, i just found that strange, have you any tip about what those file was and why they where such huge?

One more thing, in /var/ezwebin_site/storage/image/ there are all the images that i uploaded with the ezinterface, also the one of the copied site, it's a 36MB on 77MB space waste, I'm afraid it's a bit dangerous to delete them also if all the old nodes (the one from the copied site) where deleted and rewritten. If i manually delete them can this have conseguences on the site stability?

Maxime Thomas

Tuesday 15 April 2008 10:38:43 pm

Some information for you :
- eZPublish is using image aliasing : it means that each image you upload will be declined in several alias as small, medium and large pictures. If you have a lot of pictures it can take some space.
- eZPublish is versionning content. It means that each content you upload is stored and each time you edit this content, a bunch of new attributes will be created. It implies that if you use the File content to store big files (eg Windows SP1), and you see that you have made a mitake in the comment of the content and you modify it, the Windows SP1 is duplicated. You can limit that with some Version settings.
- all the data files (images, videos, PDF and so on) are stored in the var/<siteaccess> directory. If you delete them you will lose data files and so, if you try to download a file from the front interface, you will have an object not found error.

Hope it helps

Maxime Thomas
maxime.thomas@wascou.org | www.wascou.org | http://twitter.com/wascou

Company Blog : http://www.wascou.org/eng/Company/Blog
Technical Blog : http://share.ez.no/blogs/maxime-thomas

Nicolò Zanetti

Thursday 17 April 2008 1:13:37 am

Hi Thomas,
First of all thank you for your help.
If the only consequences of deleting those file will be "missing file error" I will delete them now, I was just worried about system error, since I don't need them in the copied site.
Anyway I haven't uploaded anything such huge in the site, and the removal of the var/siteaccess/storage/original/application directory hadn't any conseguences in the site, apart from the loss of some *.swf file, reuploaded, now it's everything fine.
Since I don't have unlimited disk space, any useless file deleted is a good thing.
Thank you again, bye

Nicolò Zanetti

Thursday 17 April 2008 3:32:31 am

Ok that 320 MB was the *.swf pdfs and all the other files I uploaded, like Thomas said, but they was about the main site I copied the data from, it was simple... now i know it.

All the pdf did lost their extension, and their original name (now they are something like "02d261ab6246eec2f8b3b3e8b1fbf06f") so it was not that easy to catch this, anyway if i upload a file by the ez interface, and than i delete it, it will still be there, because the local full site directory (images, swf, pdf, video, docs...) is 220MB, the ezpublish /storage/original/application itself is 320MB, and i deleted all the files that i use no more with ezinterface, so there is a lot of MB that still should be useless, and if i upload a file, i save the http adress , than i delete the file with the ezinterface and i use the saved adress i will still find the item. So I think that deleting them from the ez panel is just deleting the link, but the files are still there in that directory. But this is a waste of space, how can i clean it without a full wash&reupload operation?

Powered by eZ Publish™ CMS Open Source Web Content Management. Copyright © 1999-2014 eZ Systems AS (except where otherwise noted). All rights reserved.

eZ debug

Timing: Jan 18 2025 18:36:03
Script start
Timing: Jan 18 2025 18:36:03
Module start 'layout'
Timing: Jan 18 2025 18:36:03
Module start 'content'
Timing: Jan 18 2025 18:36:04
Module end 'content'
Timing: Jan 18 2025 18:36:04
Script end

Main resources:

Total runtime0.7321 sec
Peak memory usage4,096.0000 KB
Database Queries60

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0132 588.0469152.6406
Module start 'layout' 0.01320.0048 740.687539.4766
Module start 'content' 0.01790.7129 780.1641555.1016
Module end 'content' 0.73080.0013 1,335.265612.1250
Script end 0.7321  1,347.3906 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00380.5171160.0002
Check MTime0.00160.2229160.0001
Mysql Total
Database connection0.00090.127110.0009
Mysqli_queries0.665590.8959600.0111
Looping result0.00060.0875580.0000
Template Total0.681893.120.3409
Template load0.00230.312820.0011
Template processing0.679592.808220.3397
Template load and register function0.00020.032810.0002
states
state_id_array0.00090.125510.0009
state_identifier_array0.00070.101520.0004
Override
Cache load0.00200.2666240.0001
Sytem overhead
Fetch class attribute can translate value0.00260.349720.0013
Fetch class attribute name0.00170.225450.0003
XML
Image XML parsing0.00060.082120.0003
class_abstraction
Instantiating content class attribute0.00000.002750.0000
General
dbfile0.00150.1987160.0001
String conversion0.00000.001540.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
4content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
3content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
4content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
1content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1print_pagelayout.tpl<No override>extension/community/design/community/templates/print_pagelayout.tplEdit templateOverride template
 Number of times templates used: 14
 Number of unique templates used: 6

Time used to render debug report: 0.0001 secs