.txt file upload takes extremely long time

Author Message

Paul Kinzett

Sunday 28 October 2007 8:43:37 pm

Hi all

I have a form available to users which is the edit view of a custom class. One of the input fields on the form is file field.

When I test uploading a .txt file which contains about 5000 rows of basic data (name, email address, address, etc...) it takes almost 2 minutes to upload this file.

The file size is only 300kb.

I think it has something to do with eZCharTransform, does anyone know why this is taking so long and anyway to reduce the upload time?

Cheers,
Paul

Paul Kinzett

Tuesday 30 October 2007 3:22:21 pm

Does anyway know about this?

Let me know if I need to provide more information, im really interested in to find what is happening.

I noticed this is only an issue with .txt files, if i uploaded a .csv file with the same data is uploads in a few seconds.

Cheers,
Paul

Kåre Køhler Høvik

Wednesday 31 October 2007 12:58:32 am

Hi

I think this may be caused by the search in eZ Publish. When data is published, it'll automatically be indexed. This is probably causing the delay you're experiencing.

You can avoid this by either enabling delayed indexing ( http://ez.no/doc/ez_publish/technical_manual/3_10/reference/configuration_files/site_ini/searchsettings/delayedindexing + http://ez.no/doc/ez_publish/technical_manual/3_10/features/cronjobs/the_cronjob_scripts#indexcontent ), or try the eZ Find search extension ( http://ez.no/ezfind ). eZ Find may also be used with delayed indexing.

Kåre Høvik

Massimiliano Bariola

Wednesday 31 October 2007 9:19:15 am

+1 for Kare, yes we had the same problem when indexing pdf files. disabling the "searchable" property for the attribute solved the problem for us (it wasn't really needed and more of a slip)

Paul Kinzett

Wednesday 31 October 2007 1:40:06 pm

Thanks Kare and Massimiliano, the searchable attribute was exactly what was causing the delay.

Appreciate your help.

Cheers,
Paul

Bartek Modzelewski

Monday 11 February 2008 5:09:27 am

Hello,

This thread saved my life, client was trying to upload 1,7M txt file and we didn't know why 120 sec is not enough for really fast server to publish document :)
Because I prefer to leave "is searchable" flag marked on, it's possible to disable indexing of plain/txt files by adding into <i>settings/override </i> file <i>binaryfile.ini.append.php</i> with:

[HandlerSettings]
MetaDataExtractor[text/plain]=

Bartek

Baobaz
http://www.baobaz.com

Powered by eZ Publish™ CMS Open Source Web Content Management. Copyright © 1999-2014 eZ Systems AS (except where otherwise noted). All rights reserved.

eZ debug

Timing: Jan 18 2025 16:16:44
Script start
Timing: Jan 18 2025 16:16:44
Module start 'layout'
Timing: Jan 18 2025 16:16:44
Module start 'content'
Timing: Jan 18 2025 16:16:45
Module end 'content'
Timing: Jan 18 2025 16:16:45
Script end

Main resources:

Total runtime0.8800 sec
Peak memory usage4,096.0000 KB
Database Queries70

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0050 589.4766152.6406
Module start 'layout' 0.00500.0027 742.117239.4766
Module start 'content' 0.00760.8706 781.5938643.0547
Module end 'content' 0.87820.0017 1,424.648416.1250
Script end 0.8799  1,440.7734 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00320.3597160.0002
Check MTime0.00130.1478160.0001
Mysql Total
Database connection0.00070.077510.0007
Mysqli_queries0.825293.7712700.0118
Looping result0.00070.0816680.0000
Template Total0.847996.420.4239
Template load0.00210.239020.0011
Template processing0.845896.111720.4229
Template load and register function0.00020.023110.0002
states
state_id_array0.00120.137710.0012
state_identifier_array0.00080.088020.0004
Override
Cache load0.00180.2038350.0001
Sytem overhead
Fetch class attribute can translate value0.00070.079440.0002
Fetch class attribute name0.00090.099380.0001
XML
Image XML parsing0.00110.126740.0003
class_abstraction
Instantiating content class attribute0.00000.001780.0000
General
dbfile0.00080.0873220.0000
String conversion0.00000.000740.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
6content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
11content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
4content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
2content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1content/datatype/view/ezxmltags/literal.tpl<No override>extension/community/design/standard/templates/content/datatype/view/ezxmltags/literal.tplEdit templateOverride template
1print_pagelayout.tpl<No override>extension/community/design/community/templates/print_pagelayout.tplEdit templateOverride template
 Number of times templates used: 26
 Number of unique templates used: 7

Time used to render debug report: 0.0001 secs