eZFind - indexing errors

Next topic

Author	Message
Fabien Mas	Friday 11 September 2009 2:32:02 am Hi, I have a lot of errors when I index my site : **** Warning: Fonts with Subtype = /TrueType should be embedded. But Arial-ItalicMT is not embedded. and so my object is not indexed after that ( not only the file datatype, all my object is not indexed) How can I solve it ? Thx
Paul Borgermans	Friday 11 September 2009 2:58:06 am What do you use for conversion of binary files? It seems you use pstotext as is the default setting (but far from the best) Paul eZ Publish, eZ Find, Solr expert consulting and training http://twitter.com/paulborgermans
Fabien Mas	Friday 11 September 2009 5:01:22 am Hi Paul, Effectively, I am using pstotext Which one do you advice me to use ? thx for your help :) Fabien
Vincent Tabary	Friday 11 September 2009 5:31:52 am Hi all, That could be interesting for me too :) I installed pstotext because eZFind asked for it but I do not know any other software for that Vinz http://vincent.tabary.me
Fabien Mas	Friday 11 September 2009 5:40:38 am I have activated the eztika extension but I have also some troubles Exception in thread "main" org.apache.tika.exception.TikaException: Unable to extract PDF content at org.apache.tika.parser.pdf.PDF2XHTML.process(PDF2XHTML.java:58) at org.apache.tika.parser.pdf.PDFParser.parse(PDFParser.java:51) at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:108) at org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:80) at org.apache.tika.cli.TikaCLI.process(TikaCLI.java:111) at org.apache.tika.cli.TikaCLI.main(TikaCLI.java:57)
Paul Borgermans	Friday 11 September 2009 12:32:31 pm Hello eztika is not too robust wrt asian character sets, but should be fine with others For pdf in general, the best is to use xpdf tools You need to create a wrapper script for xpdf's pdftotext utility This is what I use (locally called ezpdftotext): #!/bin/sh /opt/local/bin/pdfinfo $1 >> /tmp/ezpdftotext.log /opt/local/bin/pdftotext -enc "UTF-8" $1 - the pdfinfo line is used for logging and can be suppressed if all goes well configuration wise So all considered: use eztika for everything except pdf, for which you should use xpdf Expect eztika to improve in the future, it is also getting into Solr (and when stable enough, eZ Find will use that instead of the binary file wrappers) Cheers Paul eZ Publish, eZ Find, Solr expert consulting and training http://twitter.com/paulborgermans
Fabien Mas	Monday 14 September 2009 7:59:32 am Hi Paul, I have created my own parser using xpdf. I have no error now. I log the text generated and it's ok But I have a new problem ;) With the default searchengine, it works well but with ezfind activated, no word of my file is indexed (even if xpdf works well) When I search a word, I have no result Is there a specific thing to do for ezfind ? Thx, Fabien
Fabien Mas	Thursday 17 September 2009 1:41:30 am I got it :) That was the pagebreaks who made mischief in the xml generated by solr so now I use this code and it works fine : pdftotext -enc "UTF-8" -eol unix -nopgbrk $1 -

eZ debug

Timing:	Jan 18 2025 11:25:10
Script start
Timing:	Jan 18 2025 11:25:10
Module start 'layout'
Timing:	Jan 18 2025 11:25:10
Module start 'content'
Timing:	Jan 18 2025 11:25:11
Module end 'content'
Timing:	Jan 18 2025 11:25:11
Script end

Main resources:

Total runtime	0.9422 sec
Peak memory usage	4,096.0000 KB
Database Queries	74

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0047	587.9063	152.6250
Module start 'layout'	0.0047	0.0022	740.5313	39.4297
Module start 'content'	0.0069	0.9339	779.9609	635.0859
Module end 'content'	0.9408	0.0013	1,415.0469	16.1797
Script end	0.9421		1,431.2266

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0029	0.3082	16	0.0002
Check MTime	0.0013	0.1354	16	0.0001
Mysql Total
Database connection	0.0008	0.0841	1	0.0008
Mysqli_queries	0.8196	86.9876	74	0.0111
Looping result	0.0007	0.0744	72	0.0000
Template Total	0.8484	90.0	2	0.4242
Template load	0.0021	0.2187	2	0.0010
Template processing	0.8463	89.8228	2	0.4231
Template load and register function	0.0001	0.0146	1	0.0001
states
state_id_array	0.0018	0.1950	1	0.0018
state_identifier_array	0.0020	0.2109	2	0.0010
Override
Cache load	0.0017	0.1771	56	0.0000
Sytem overhead
Fetch class attribute can translate value	0.0008	0.0831	3	0.0003
Fetch class attribute name	0.0010	0.1106	9	0.0001
XML
Image XML parsing	0.0009	0.0951	3	0.0003
class_abstraction
Instantiating content class attribute	0.0000	0.0026	10	0.0000
General
dbfile	0.0008	0.0890	17	0.0000
String conversion	0.0000	0.0006	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
8	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
10	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
16	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
4	content/datatype/view/ezxmltags/literal.tpl	<No override>	extension/community/design/standard/templates/content/datatype/view/ezxmltags/literal.tpl
2	content/datatype/view/ezimage.tpl	<No override>	extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 42 Number of unique templates used: 7

Time used to render debug report: 0.0001 secs