Forums / Extensions / eZ Find / Avoiding problems using Tomcat at high-load indexes

Avoiding problems using Tomcat at high-load indexes

Previous topic

eZ Find

Next topic

Author	Message
Jens Görisch	Wednesday 22 July 2009 10:24:25 am Hello, as the title may already suggest, I'm interested in using eZ Find (i.e. Solr) with a Tomcat servlet container. The reason for this are problems, when running the default setting (with Jetty). We have an index with overall more than 100k documents. After some time running, the Solr server runs into troubles. It doesn't update the index anymore (apparently COMMIT doesn't work) and a look into the log files reveals, that logging was stopped abruptly (i.e. the last log entry is incomplete). Also some compiled servlets are missing (e.g. <i>/solr/admin/registry.jsp</i>) and an exception is thrown, when the respective page is accessed. All this sounds for me like it is caused by the container. Now I'm very curious, if perhaps this happened to anyone else and thus about your experiences with such kind of behaviour. Also I would like to know, if you could make improvements by using tomcat (or perhaps another servlet container). Thanks in advance Jens Görisch

Author

Message

Jens Görisch

Wednesday 22 July 2009 10:24:25 am

Hello,

as the title may already suggest, I'm interested in using eZ Find (i.e. Solr) with a Tomcat servlet container.

The reason for this are problems, when running the default setting (with Jetty).

We have an index with overall more than 100k documents. After some time running, the Solr server runs into troubles. It doesn't update the index anymore (apparently COMMIT doesn't work) and a look into the log files reveals, that logging was stopped abruptly (i.e. the last log entry is incomplete). Also some compiled servlets are missing (e.g. <i>/solr/admin/registry.jsp</i>) and an exception is thrown, when the respective page is accessed.

All this sounds for me like it is caused by the container. Now I'm very curious, if perhaps this happened to anyone else and thus about your experiences with such kind of behaviour. Also I would like to know, if you could make improvements by using tomcat (or perhaps another servlet container).

Thanks in advance

Jens Görisch

eZ debug

Timing:

Jan 18 2025 02:56:03

Script start

Timing:

Jan 18 2025 02:56:03

Module start 'content'

Timing:

Jan 18 2025 02:56:04

Module end 'content'

Timing:

Jan 18 2025 02:56:04

Script end

Main resources:

Total runtime

0.4820 sec

Peak memory usage

4,096.0000 KB

Database Queries

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0072	587.9844	180.7578
Module start 'content'	0.0072	0.4695	768.7422	407.3672
Module end 'content'	0.4766	0.0053	1,176.1094	42.0469
Script end	0.4820		1,218.1563

Checkpoint

Start (sec)

Duration (sec)

Memory at start (KB)

Memory used (KB)

Script start

0.0000

0.0072

587.9844

180.7578

Module start 'content'

0.0072

0.4695

768.7422

407.3672

Module end 'content'

0.4766

0.0053

1,176.1094

42.0469

Script end

0.4820

1,218.1563

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0029	0.5964	14	0.0002
Check MTime	0.0013	0.2712	14	0.0001
Mysql Total
Database connection	0.0010	0.2108	1	0.0010
Mysqli_queries	0.4495	93.2448	49	0.0092
Looping result	0.0004	0.0928	47	0.0000
Template Total	0.4542	94.2	2	0.2271
Template load	0.0019	0.3929	2	0.0009
Template processing	0.4523	93.8308	2	0.2261
Template load and register function	0.0002	0.0459	1	0.0002
states
state_id_array	0.0008	0.1683	1	0.0008
state_identifier_array	0.0008	0.1720	2	0.0004
Override
Cache load	0.0015	0.3135	10	0.0002
Sytem overhead
Fetch class attribute can translate value	0.0007	0.1537	1	0.0007
Fetch class attribute name	0.0008	0.1685	1	0.0008
XML
Image XML parsing	0.0001	0.0210	1	0.0001
class_abstraction
Instantiating content class attribute	0.0000	0.0008	1	0.0000
General
dbfile	0.0020	0.4150	12	0.0002
String conversion	0.0000	0.0012	3	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Accumulator

Duration (sec)

Duration (%)

Count

Average (sec)

Ini load

Load cache

0.0029

0.5964

0.0002

Check MTime

0.0013

0.2712

0.0001

Mysql Total

Database connection

0.0010

0.2108

0.0010

Mysqli_queries

0.4495

93.2448

0.0092

Looping result

0.0004

0.0928

0.0000

Template Total

0.4542

94.2

0.2271

Template load

0.0019

0.3929

0.0009

Template processing

0.4523

93.8308

0.2261

Template load and register function

0.0002

0.0459

0.0002

states

state_id_array

0.0008

0.1683

0.0008

state_identifier_array

0.0008

0.1720

0.0004

Override

Cache load

0.0015

0.3135

0.0002

Sytem overhead

Fetch class attribute can translate value

0.0007

0.1537

0.0007

Fetch class attribute name

0.0008

0.1685

0.0008

XML

Image XML parsing

0.0001

0.0210

0.0001

class_abstraction

Instantiating content class attribute

0.0000

0.0008

0.0000

General

dbfile

0.0020

0.4150

0.0002

String conversion

0.0000

0.0012

0.0000

Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
1	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
1	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
1	pagelayout.tpl	<No override>	extension/sevenx/design/simple/templates/pagelayout.tpl
Number of times templates used: 4 Number of unique templates used: 4

Usage

Requested template

Template

Template loaded

Edit

Override

node/view/full.tpl

full/forum_topic.tpl

extension/sevenx/design/simple/override/templates/full/forum_topic.tpl