How can I upload large media file in eZ system

Author Message

John Ellingsen

Wednesday 09 September 2009 2:07:48 pm

Hi friends,

I can upload any small media (datatype) file (150-200 MB) from my local PC to the apache server. But it doesn’t work for very large media file. I can not upload any large media file (e.g. 6GB- 8GB) in the webserver through the html form. I am using Apache 2+, PHP 5 and MySQL5+ and windows XP.
My question:
How can I change the execution of the media data type to be able to browsing the large media file in the local disk on apache server? Can I do it by changing the followings in php.ini configuration file? The current settings in php.ini is as follow:
max_execution_time = 480 ; Maximum execution time of each script, in seconds
max_input_time = 240 ; Maximum amount of time each script may spend parsing request data
;max_input_nesting_level = 64 ; Maximum input variable nesting level
memory_limit = 512M ; Maximum amount of memory a script may consume (128MB)
Any suggestion is well come!!

With regards,
John :)
NESRC

Steven E. Bailey

Thursday 10 September 2009 12:36:47 am

Webdav. That's pretty much your only option. You can try and play around with php variables - but that probably will never work well. Even if you got php to do the large file, then - if I remember correctly, apache has a 4GB file size limit unless it has large file size support compiled in.

Certified eZPublish developer
http://ez.no/certification/verify/396111

Available for ezpublish troubleshooting, hosting and custom extension development: http://www.leidentech.com

André R.

Thursday 10 September 2009 12:54:32 am

Webdav is still handled by http, so is limited by the same limitations.

There are two options, and they both involve coding:
* modify the file / media datatype to let you browse a specific folder on the server, and use ftp to upload the file there*
* Create an extension similar to the ezmultiupload extension, but use any of the large upload clients instead of the YUI Upload/SWFUpload . Most of them seems to be written in java, and they normally split the file up in smaller pieces and sends one piece at a time. So you'll also need to merge them back together on the server.

Large file upload is on the roadmap for 4.3, but thats another 6 and a half month away, and there is no guarantee that it will stay on the roadmap or slip to the next version.
* We do actually have code for this, so I'll try to clean it up and make it public soon.

eZ Online Editor 5: http://projects.ez.no/ezoe || eZJSCore (Ajax): http://projects.ez.no/ezjscore || eZ Publish EE http://ez.no/eZPublish/eZ-Publish-Enterprise-Subscription
@: http://twitter.com/andrerom

Gaetano Giunta

Thursday 10 September 2009 1:00:43 am

There is also an ezftp extension (in projects.ez.no) that might also be tried. Iirc somebody who tried it said it consumes too much cpu though...

Principal Consultant International Business
Member of the Community Project Board

Jean-Yves Zinsou

Thursday 10 September 2009 3:17:48 am

Hello,
i have integrated for a client a java applet that allows the user to upload large files to a temporary file on the server an then select them to be integrated to ezpublish as a standard file. Of corse an ftp server is needed, would you like me to submit it as a contribution , or have you find a solution ...

Jey

Do Androids Dream of Electric Sheep?
I dream of eZpubliSheep....
------------------------------------------------------------------------
http://www.alma.fr

Hatem Ounis

Thursday 18 February 2010 3:35:49 am

Hy all

Is there any news about large files support with webdav ?

i don't want to use ftp or any other protocol i want only webdav

and please don't answer me about apache or php limits i want the ez webdav limit of file size.

Thank you.

Steven E. Bailey

Friday 12 March 2010 5:01:23 am

I've created an extension to allow for large file uploads using Moxiecode's plupload www.plupload.com - I've been testing with file sizes up to 1.5 GB using the flash runtime. It's still in beta, but you can take a look at the code at http://code.google.com/p/ezplupload/

Certified eZPublish developer
http://ez.no/certification/verify/396111

Available for ezpublish troubleshooting, hosting and custom extension development: http://www.leidentech.com

Powered by eZ Publish™ CMS Open Source Web Content Management. Copyright © 1999-2014 eZ Systems AS (except where otherwise noted). All rights reserved.

eZ debug

Timing: Jan 18 2025 15:17:17
Script start
Timing: Jan 18 2025 15:17:17
Module start 'layout'
Timing: Jan 18 2025 15:17:17
Module start 'content'
Timing: Jan 18 2025 15:17:19
Module end 'content'
Timing: Jan 18 2025 15:17:19
Script end

Main resources:

Total runtime1.1786 sec
Peak memory usage4,096.0000 KB
Database Queries77

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0065 589.1797152.6406
Module start 'layout' 0.00650.0039 741.820339.4766
Module start 'content' 0.01041.1664 781.2969750.8672
Module end 'content' 1.17680.0018 1,532.164120.1250
Script end 1.1786  1,552.2891 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00340.2887160.0002
Check MTime0.00130.1113160.0001
Mysql Total
Database connection0.00070.060310.0007
Mysqli_queries1.116194.6931770.0145
Looping result0.00060.0504750.0000
Template Total1.145897.220.5729
Template load0.00200.166120.0010
Template processing1.143897.047720.5719
Template load and register function0.00020.015210.0002
states
state_id_array0.00070.055310.0007
state_identifier_array0.00100.083720.0005
Override
Cache load0.00170.1467430.0000
Sytem overhead
Fetch class attribute can translate value0.00050.044760.0001
Fetch class attribute name0.00090.0784110.0001
XML
Image XML parsing0.00190.162760.0003
class_abstraction
Instantiating content class attribute0.00000.0023120.0000
General
dbfile0.00110.0943360.0000
String conversion0.00000.000740.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
7content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
11content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
5content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
5content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1print_pagelayout.tpl<No override>extension/community/design/community/templates/print_pagelayout.tplEdit templateOverride template
 Number of times templates used: 30
 Number of unique templates used: 6

Time used to render debug report: 0.0001 secs