Forums / Extensions / Exceptions when updating eZ Find index

Exceptions when updating eZ Find index

Author Message

Sander van den Akker

Tuesday 08 March 2011 7:30:59 am

I'm currently investigating a problem where not all content of a site is indexed by eZ Find. When I run updatesearchindexsolr.php, the script generates errors like this:

<code>
...................................................................... 89.45%...................................................................... 90.16%........................................Comitting and optimizing index ...
Fatal error: eZ Publish did not finish its requestThe execution of eZ Publish was abruptly ended, the debug output is present below.
Did not index content correctly: array ()
Creating a new thread: 18331.............................. 90.86%
...................................................................... 89.45%...................................................................... 90.16%........................................Comitting and optimizing index ...
Fatal error: eZ Publish did not finish its requestThe execution of eZ Publish was abruptly ended, the debug output is present below.
Did not index content correctly: array ()
Creating a new thread: 18331.............................. 90.86%
</code>

And on it goes. When I check SOLR I see some SEVERE problems in the output, like these:

<code>

SEVERE: java.lang.NullPointerException

at org.apache.solr.search.FastLRUCache.getStatistics(FastLRUCache.java:252)

at org.apache.solr.search.FastLRUCache.toString(FastLRUCache.java:280)

at java.lang.StringBuilder.append(libgcj.so.90)

at org.apache.solr.search.SolrIndexSearcher.warm(SolrIndexSearcher.java:1480)

at org.apache.solr.core.SolrCore$2.call(SolrCore.java:1127)

at java.util.concurrent.FutureTask$Sync.innerRun(libgcj.so.90)

at java.util.concurrent.FutureTask.run(libgcj.so.90)

at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(libgcj.so.90)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(libgcj.so.90)

at java.lang.Thread.run(libgcj.so.90)

SEVERE: java.util.concurrent.ExecutionException: java.lang.NullPointerException

at java.util.concurrent.FutureTask$Sync.innerGet(libgcj.so.90)

at java.util.concurrent.FutureTask.get(libgcj.so.90)

at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:439)

at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:85)

at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:169)

at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69)

at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54)

at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)

at org.apache.solr.core.SolrCore.execute(SolrCore.java:1321)

at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:341)

at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:244)

at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1089)

at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:365)

at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)

at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:712)

at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:405)

at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:211)

at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)

at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:139)

at org.mortbay.jetty.Server.handle(Server.java:285)

at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:502)

at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:835)

at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:641)

at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:208)

at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:378)

at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:226)

at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:442)

Caused by: java.lang.NullPointerException

at org.apache.solr.search.FastLRUCache.getStatistics(FastLRUCache.java:252)

at org.apache.solr.search.FastLRUCache.toString(FastLRUCache.java:280)

at java.lang.StringBuilder.append(libgcj.so.90)

at org.apache.solr.search.SolrIndexSearcher.close(SolrIndexSearcher.java:223)

at org.apache.solr.core.SolrCore$6.close(SolrCore.java:1243)

at org.apache.solr.util.RefCounted.decref(RefCounted.java:57)

at org.apache.solr.core.SolrCore$5.call(SolrCore.java:1189)

at java.util.concurrent.FutureTask$Sync.innerRun(libgcj.so.90)

at java.util.concurrent.FutureTask.run(libgcj.so.90)

at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(libgcj.so.90)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(libgcj.so.90)

at java.lang.Thread.run(libgcj.so.90)

SEVERE: org.apache.solr.common.SolrException: Document [null] missing required field: meta_guid_ms

at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:337)

at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60)

at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:139)

at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69)

at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54)

at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)

at org.apache.solr.core.SolrCore.execute(SolrCore.java:1321)

at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:341)

at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:244)

at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1089)

at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:365)

at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)

at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:712)

at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:405)

at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:211)

at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)

at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:139)

at org.mortbay.jetty.Server.handle(Server.java:285)

at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:502)

at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:835)

at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:641)

at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:202)

at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:378)

at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:226)

at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:442)</code>

Especially the following line attracts my attention, but I don't have a clue where to look further:

Document [null] missing required field: meta_guid_ms

These errors are also generated when search queries are given. Using eZ Find 2.3 on eZ Publish 4.3. All hints would be very much appreciated!

eZ Publish certified developer
http://auth.ez.no/certification/verify/392313

eZ debug

Timing: Jan 18 2025 00:05:46
Script start
Timing: Jan 18 2025 00:05:46
Module start 'content'
Timing: Jan 18 2025 00:05:46
Module end 'content'
Timing: Jan 18 2025 00:05:46
Script end

Main resources:

Total runtime0.7987 sec
Peak memory usage4,096.0000 KB
Database Queries183

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0054 588.9453180.8359
Module start 'content' 0.00550.6413 769.7813499.7813
Module end 'content' 0.64680.1519 1,269.5625337.2266
Script end 0.7987  1,606.7891 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00480.6017210.0002
Check MTime0.00150.1858210.0001
Mysql Total
Database connection0.00060.077610.0006
Mysqli_queries0.714389.43271830.0039
Looping result0.00210.25751810.0000
Template Total0.771496.620.3857
Template load0.00160.200420.0008
Template processing0.769896.375720.3849
Template load and register function0.00010.010910.0001
states
state_id_array0.00060.072410.0006
state_identifier_array0.00120.145520.0006
Override
Cache load0.00150.18781010.0000
Sytem overhead
Fetch class attribute can translate value0.00190.243020.0010
Fetch class attribute name0.00080.095720.0004
XML
Image XML parsing0.00080.102120.0004
class_abstraction
Instantiating content class attribute0.00000.000520.0000
General
dbfile0.00380.4787280.0001
String conversion0.00000.000830.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
1content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
3content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
2content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 9
 Number of unique templates used: 6

Time used to render debug report: 0.0002 secs