Searching content into a pdf file

Next topic

Author	Message
Simone Conti	Monday 01 August 2011 7:34:00 am Hi there, I have a lot of pdf files in my site and I need to enable EzPublish look for a specific content into those pdf files, in order to list the results together with the standard search results. Is that possible? Is there any extension or something else to enable to make it possible? Thank you so much!
Peter Keung	Monday 01 August 2011 7:51:40 am This is the first thing that comes to mind: http://projects.ez.no/eztika http://www.mugo.ca Mugo Web, eZ Partner in Vancouver, Canada
Simone Conti	Monday 01 August 2011 8:05:24 am Unfortunately is not what I'm looking for. I need something that allows me to search into a pdf files. Somebody told me that EzPublish has this feature embedded but it needs to be allowed. Any suggestions?
Steven E. Bailey	Monday 01 August 2011 9:07:18 am eZPublish does have this feature and you should be seeing your pdfs indexed - with a bunch of caveats. What happens is that when a pdf is saved (or you update your search index), the pdf is run through the tool defined by [PDFHandlerSettings] TextExtractionTool=pstotext in your binaryfile.ini If you don't have this tool on your machine, then your pdfs won't be indexed. If you search for TextExtractionTool or pdftotext in these forums you'll see a couple other possible tools - such as: http://share.ez.no/forums/extensions/ez-find/solr-indexing-error If you have whatever tool you are using and if you're pdfs aren't being indexed, then it probably means that your pdfs aren't structurally text - the content is actually an image (or series of images) saved in the pdf container. It means that you're not going to be able to index using pdftotext - a good test is to run whatever tool you have on the command line against the file that isn't be indexed to see what actually comes out. If nothing comes out you'll have to use some other tool - like eztika (I've never used it) or, something like tesseract to extract the text. Certified eZPublish developer http://ez.no/certification/verify/396111 Available for ezpublish troubleshooting, hosting and custom extension development: http://www.leidentech.com
Simone Conti	Thursday 04 August 2011 3:26:58 am Now something works. I decided to use eztika as suggested by Peter. I have a question: where does eztika store its data? I hope it's not made to scan all pdf for each search... I have a very large number of pdf files!! Thanks
Paul Borgermans	Friday 05 August 2011 10:23:26 am Hi eztika does not store the data itself, its goal is to extract the plain text for subsequent indexing by the configured search plugin (you should use eZ Find of course :) ) the default search plugin stores the indexing result in the database, while eZ Find uses Solr which stores its data into Lucene index files on teh filesystem This is done only when the pdf is uploaded or updated. hth Paul eZ Publish, eZ Find, Solr expert consulting and training http://twitter.com/paulborgermans

eZ debug

Timing:	Jan 18 2025 02:14:53
Script start
Timing:	Jan 18 2025 02:14:53
Module start 'layout'
Timing:	Jan 18 2025 02:14:53
Module start 'content'
Timing:	Jan 18 2025 02:14:54
Module end 'content'
Timing:	Jan 18 2025 02:14:54
Script end

Main resources:

Total runtime	0.7818 sec
Peak memory usage	4,096.0000 KB
Database Queries	72

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0052	591.1016	152.6250
Module start 'layout'	0.0052	0.0030	743.7266	39.4688
Module start 'content'	0.0082	0.7718	783.1953	660.5313
Module end 'content'	0.7800	0.0018	1,443.7266	16.1563
Script end	0.7818		1,459.8828

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0033	0.4252	16	0.0002
Check MTime	0.0013	0.1708	16	0.0001
Mysql Total
Database connection	0.0007	0.0933	1	0.0007
Mysqli_queries	0.7196	92.0365	72	0.0100
Looping result	0.0008	0.1036	70	0.0000
Template Total	0.7506	96.0	2	0.3753
Template load	0.0019	0.2454	2	0.0010
Template processing	0.7486	95.7528	2	0.3743
Template load and register function	0.0001	0.0167	1	0.0001
states
state_id_array	0.0008	0.0998	1	0.0008
state_identifier_array	0.0010	0.1265	2	0.0005
Override
Cache load	0.0017	0.2111	41	0.0000
Sytem overhead
Fetch class attribute can translate value	0.0006	0.0731	4	0.0001
Fetch class attribute name	0.0015	0.1856	9	0.0002
XML
Image XML parsing	0.0018	0.2242	4	0.0004
class_abstraction
Instantiating content class attribute	0.0000	0.0021	9	0.0000
General
dbfile	0.0027	0.3414	31	0.0001
String conversion	0.0000	0.0012	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
6	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
8	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
3	content/datatype/view/ezimage.tpl	<No override>	extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tpl
2	content/datatype/view/ezxmltags/link.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/link.tpl
1	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 22 Number of unique templates used: 7

Time used to render debug report: 0.0002 secs