Forums / Install & configuration / Uploading large files

Uploading large files

Author Message

Vincent Saulnier

Monday 10 February 2003 9:56:33 am

Please help,

I still have problems to upload large files in classes containing eZBinaryFiles.

Bruce Morrison

Monday 10 February 2003 1:54:17 pm

> Please help,
>
> I still have problems to upload large files in classes
> containing eZBinaryFiles.

What error messages if any are you getting?

How big are the files?

Bruce

My Blog: http://www.stuffandcontent.com/
Follow me on twitter: http://twitter.com/brucemorrison
Consolidated eZ Publish Feed : http://friendfeed.com/rooms/ez-publish

Vincent Saulnier

Monday 10 February 2003 2:01:29 pm

> What error messages if any are you getting?

No error at all, only a blank object.

> How big are the files?

5.5 Mb

My php configuration is at
upload_max_filesize = 50 Mb

My BinaryFile DataType is at 50 Mb.

I'm desperate...
Thanks for helping me!

Bruce Morrison

Monday 10 February 2003 3:13:58 pm

> > What error messages if any are you getting?
>
> No error at all, only a blank object.

Are there any errors in the webserver logs?

> > How big are the files?
>
> 5.5 Mb
>
> My php configuration is at
> upload_max_filesize = 50 Mb
>
> My BinaryFile DataType is at 50 Mb.

and it does work for smaller files?
bruce

My Blog: http://www.stuffandcontent.com/
Follow me on twitter: http://twitter.com/brucemorrison
Consolidated eZ Publish Feed : http://friendfeed.com/rooms/ez-publish

Vincent Saulnier

Monday 10 February 2003 6:16:12 pm

> Are there any errors in the webserver logs?

There's nothing aparently, I only got http/200 status and 302.
Everything seems OK!

> and it does work for smaller files?

Yes, it does with a 3.5 Mb file

Vincent Saulnier

Monday 10 February 2003 6:16:36 pm

> Are there any errors in the webserver logs?

There's nothing aparently, I only got http/200 status and 302.
Everything seems OK!

> and it does work for smaller files?

Yes, it does with a 3.5 Mb file

Bruce Morrison

Monday 10 February 2003 6:34:47 pm

> > Are there any errors in the webserver logs?
>
> There's nothing aparently, I only got http/200 status and
> 302.
> Everything seems OK!

You may want to check the error log (for apache)

> > and it does work for smaller files?
>
> Yes, it does with a 3.5 Mb file

I'm guessing here as I do not have access to your system but I'd say that it is a resource related issue.

The system is running out of resources (memory/diskspace) and the process is not completing.

It seems that ezpublish relies on imagemagick for image processing and it may be running out of resources.

You may try uping the memory_limit in php.ini - I'm not sure if this will help - it usually generates a visable error if this is an issue.

Bruce

My Blog: http://www.stuffandcontent.com/
Follow me on twitter: http://twitter.com/brucemorrison
Consolidated eZ Publish Feed : http://friendfeed.com/rooms/ez-publish

Vincent Saulnier

Tuesday 11 February 2003 6:53:47 am

> You may want to check the error log (for apache)

There's nothig in apache error log only what I said earlier in apache access log.

> I'm guessing here as I do not have access to your system but
> I'd say that it is a resource related issue.
>
> The system is running out of resources (memory/diskspace)
> and the process is not completing.
>
> It seems that ezpublish relies on imagemagick for image
> processing and it may be running out of resources.
>
> You may try uping the memory_limit in php.ini - I'm not
> sure if this will help - it usually generates a visable
> error if this is an issue.

I've changed memory_limit to 50Mb, I can now upload 6.5 Mb files, but for larger files like 18 Mb theres a php warning :

Warning: PHP Feb 11 2003 09:49:01
Undefined variable: validatedAttributesLog in /<install dir>/kernel/content/attribute_edit.php on line 263
Warning: PHP Feb 11 2003 09:49:01
Undefined variable: OmitSectionSetting in /<install dir>/kernel/content/attribute_edit.php on line 273

Vincent Saulnier

Tuesday 11 February 2003 6:54:37 am

> You may want to check the error log (for apache)

There's nothig in apache error log only what I said earlier in apache access log.

> I'm guessing here as I do not have access to your system but
> I'd say that it is a resource related issue.
>
> The system is running out of resources (memory/diskspace)
> and the process is not completing.
>
> It seems that ezpublish relies on imagemagick for image
> processing and it may be running out of resources.
>
> You may try uping the memory_limit in php.ini - I'm not
> sure if this will help - it usually generates a visable
> error if this is an issue.

I've changed memory_limit to 50Mb, I can now upload 6.5 Mb files, but for larger files like 18 Mb theres a php warning :

Warning: PHP Feb 11 2003 09:49:01
Undefined variable: validatedAttributesLog in /<install dir>/kernel/content/attribute_edit.php on line 263
Warning: PHP Feb 11 2003 09:49:01
Undefined variable: OmitSectionSetting in /<install dir>/kernel/content/attribute_edit.php on line 273

Vincent Saulnier

Tuesday 11 February 2003 6:55:35 am

> You may want to check the error log (for apache)

There's nothig in apache error log only what I said earlier in apache access log.

> I'm guessing here as I do not have access to your system but
> I'd say that it is a resource related issue.
>
> The system is running out of resources (memory/diskspace)
> and the process is not completing.
>
> It seems that ezpublish relies on imagemagick for image
> processing and it may be running out of resources.
>
> You may try uping the memory_limit in php.ini - I'm not
> sure if this will help - it usually generates a visable
> error if this is an issue.

I've changed memory_limit to 50Mb, I can now upload 6.5 Mb files, but for larger files like 18 Mb theres a php warning :

Warning: PHP Feb 11 2003 09:49:01
Undefined variable: validatedAttributesLog in /<install dir>/kernel/content/attribute_edit.php on line 263
Warning: PHP Feb 11 2003 09:49:01
Undefined variable: OmitSectionSetting in /<install dir>/kernel/content/attribute_edit.php on line 273

Vincent Saulnier

Tuesday 11 February 2003 7:10:08 am

In apache error log, it says :

invalid method in request ------------------- 7d3108102022a

Bruce Morrison

Tuesday 11 February 2003 1:58:38 pm

> > You may want to check the error log (for apache)
>
> There's nothig in apache error log only what I said earlier
> in apache access log.
>
> > I'm guessing here as I do not have access to your
> system but
> > I'd say that it is a resource related issue.
> >
> > The system is running out of resources
> (memory/diskspace)
> > and the process is not completing.
> >
> > It seems that ezpublish relies on imagemagick for
> image
> > processing and it may be running out of resources.
> >
> > You may try uping the memory_limit in php.ini - I'm
> not
> > sure if this will help - it usually generates a
> visable
> > error if this is an issue.
>
> I've changed memory_limit to 50Mb, I can now upload 6.5 Mb
> files, but for larger files like 18 Mb theres a php warning
> :

So it does look like a memory resource issue. I guess you will have to increase the memory_limit until you can process the size of the files you want. You may have to add more memory to your system ;)

My guess is the lines below are due to the failure of the upload.

Bruce
>
> Warning: PHP Feb 11 2003 09:49:01
> Undefined variable: validatedAttributesLog in /<install
> dir>/kernel/content/attribute_edit.php on line 263
> Warning: PHP Feb 11 2003 09:49:01
> Undefined variable: OmitSectionSetting in /<install
> dir>/kernel/content/attribute_edit.php on line 273

My Blog: http://www.stuffandcontent.com/
Follow me on twitter: http://twitter.com/brucemorrison
Consolidated eZ Publish Feed : http://friendfeed.com/rooms/ez-publish

Vincent Saulnier

Tuesday 11 February 2003 8:48:34 pm

Thanks Bruce,

I'll check and get back to you with that!

Björn Dieding@xrow.de

Thursday 13 February 2003 6:03:58 am

I have to find a solution to upload very large files in the future. The files are video files and can be over 50 mb. I looking for a good solution to upload those.

My idea:
Write an applet. That applet gets the file. Splits it in pieces. And transfers it over SOAP to ez. ez will builds the complete file again out of the pieces(server thread to large?).

When it comes to serving I would say that can't be done by php because of the size. I am right? Some Apache thread with 50mb isn't that wise. I thought of an streaming server like darwin to do that.

Has anyone of you a better idea?

Looking for a new job? http://www.xrow.com/xrow-GmbH/Jobs
Looking for hosting? http://hostingezpublish.com
-----------------------------------------------------------------------------
GMT +01:00 Hannover, Germany
Web: http://www.xrow.com/

Dominik Pich

Thursday 11 December 2003 1:31:04 am

Any final solution found?
How should I go?

Marco Zinn

Thursday 11 December 2003 12:26:10 pm

Hm, i just can tell you: I am able to uploade a 11 MB file, after raising the PHP max_post_size and max_upload_size (i think).
No problem, but the system has lots of memory.

Marco
http://www.hyperroad-design.com