Forums / Developer / How can I upload large media file in eZ system

How can I upload large media file in eZ system

Author Message

John Ellingsen

Wednesday 09 September 2009 2:07:48 pm

Hi friends,

I can upload any small media (datatype) file (150-200 MB) from my local PC to the apache server. But it doesn’t work for very large media file. I can not upload any large media file (e.g. 6GB- 8GB) in the webserver through the html form. I am using Apache 2+, PHP 5 and MySQL5+ and windows XP.
My question:
How can I change the execution of the media data type to be able to browsing the large media file in the local disk on apache server? Can I do it by changing the followings in php.ini configuration file? The current settings in php.ini is as follow:
max_execution_time = 480 ; Maximum execution time of each script, in seconds
max_input_time = 240 ; Maximum amount of time each script may spend parsing request data
;max_input_nesting_level = 64 ; Maximum input variable nesting level
memory_limit = 512M ; Maximum amount of memory a script may consume (128MB)
Any suggestion is well come!!

With regards,
John :)
NESRC

Steven E. Bailey

Thursday 10 September 2009 12:36:47 am

Webdav. That's pretty much your only option. You can try and play around with php variables - but that probably will never work well. Even if you got php to do the large file, then - if I remember correctly, apache has a 4GB file size limit unless it has large file size support compiled in.

Certified eZPublish developer
http://ez.no/certification/verify/396111

Available for ezpublish troubleshooting, hosting and custom extension development: http://www.leidentech.com

André R.

Thursday 10 September 2009 12:54:32 am

Webdav is still handled by http, so is limited by the same limitations.

There are two options, and they both involve coding:
* modify the file / media datatype to let you browse a specific folder on the server, and use ftp to upload the file there*
* Create an extension similar to the ezmultiupload extension, but use any of the large upload clients instead of the YUI Upload/SWFUpload . Most of them seems to be written in java, and they normally split the file up in smaller pieces and sends one piece at a time. So you'll also need to merge them back together on the server.

Large file upload is on the roadmap for 4.3, but thats another 6 and a half month away, and there is no guarantee that it will stay on the roadmap or slip to the next version.
* We do actually have code for this, so I'll try to clean it up and make it public soon.

eZ Online Editor 5: http://projects.ez.no/ezoe || eZJSCore (Ajax): http://projects.ez.no/ezjscore || eZ Publish EE http://ez.no/eZPublish/eZ-Publish-Enterprise-Subscription
@: http://twitter.com/andrerom

Gaetano Giunta

Thursday 10 September 2009 1:00:43 am

There is also an ezftp extension (in projects.ez.no) that might also be tried. Iirc somebody who tried it said it consumes too much cpu though...

Principal Consultant International Business
Member of the Community Project Board

Jean-Yves Zinsou

Thursday 10 September 2009 3:17:48 am

Hello,
i have integrated for a client a java applet that allows the user to upload large files to a temporary file on the server an then select them to be integrated to ezpublish as a standard file. Of corse an ftp server is needed, would you like me to submit it as a contribution , or have you find a solution ...

Jey

Do Androids Dream of Electric Sheep?
I dream of eZpubliSheep....
------------------------------------------------------------------------
http://www.alma.fr

Hatem Ounis

Thursday 18 February 2010 3:35:49 am

Hy all

Is there any news about large files support with webdav ?

i don't want to use ftp or any other protocol i want only webdav

and please don't answer me about apache or php limits i want the ez webdav limit of file size.

Thank you.

Steven E. Bailey

Friday 12 March 2010 5:01:23 am

I've created an extension to allow for large file uploads using Moxiecode's plupload www.plupload.com - I've been testing with file sizes up to 1.5 GB using the flash runtime. It's still in beta, but you can take a look at the code at http://code.google.com/p/ezplupload/

Certified eZPublish developer
http://ez.no/certification/verify/396111

Available for ezpublish troubleshooting, hosting and custom extension development: http://www.leidentech.com

eZ debug

Timing: Jan 30 2025 19:53:10
Script start
Timing: Jan 30 2025 19:53:10
Module start 'content'
Timing: Jan 30 2025 19:53:10
Module end 'content'
Timing: Jan 30 2025 19:53:11
Script end

Main resources:

Total runtime0.3546 sec
Peak memory usage8,192.0000 KB
Database Queries141

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0119 588.0625370.2734
Module start 'content' 0.01190.0383 958.33591,009.5781
Module end 'content' 0.05020.3043 1,967.91413,899.0391
Script end 0.3545  5,866.9531 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00521.4612200.0003
Check MTime0.00160.4458200.0001
Mysql Total
Database connection0.00170.471810.0017
Mysqli_queries0.173648.96921410.0012
Looping result0.00210.58201390.0000
Template Total0.303785.710.3037
Template load0.00100.294410.0010
Template processing0.302785.356010.3027
Override
Cache load0.00070.191510.0007
Sytem overhead
Fetch class attribute can translate value0.00230.645810.0023
XML
Image XML parsing0.00030.072810.0003
General
dbfile0.068619.3454200.0034
String conversion0.00000.002230.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 1
 Number of unique templates used: 1

Time used to render debug report: 0.0002 secs