Indexing external database content

Next topic

Author	Message
Kedar Deshpande	Friday 14 August 2009 8:45:22 am I am trying to index content from an external database and see the updatesearchindexsolr.php file has fields that allow connections to a DB but filling these in dont seem to work at all. array( 'db-host' => "localhost", 'db-user' => "root", 'db-password' => "root", 'db-database' => "cccms", 'db-driver' => "mysql", 'db-type' => "mysql", ... Could someone let me know if indeed this is the way to provide the parameters for external DB indexing and also how to specify which tables within the external DB to index. thanks.
Paul Borgermans	Saturday 15 August 2009 10:43:28 am Hi Kedar This script is used for indexing ez publish content only There are several routes to index external data: - write your own script(s), using the base classes in the ezfind extension - configuring Solr to do this for you through the search backend: see http://wiki.apache.org/solr/DataImportHandler and make a small script using the Solr base classes from the ezfind extension to control this DataImportHandler In both cases, you will probably need to modify the Solr schema file To search this content, you can use the ezfind supplied rawSolrRequest fetch function in templates In a future edition, ez find will be extended to make indexing adn searching external content easier out of the box Regards Paul eZ Publish, eZ Find, Solr expert consulting and training http://twitter.com/paulborgermans

Author

Message

Friday 14 August 2009 8:45:22 am

I am trying to index content from an external database and see the updatesearchindexsolr.php file has fields that allow connections to a DB but filling these in dont seem to work at all.

array( 'db-host' => "localhost",
         'db-user' => "root",
         'db-password' => "root",
         'db-database' => "cccms",
         'db-driver' => "mysql",
         'db-type' => "mysql",
         ...

Could someone let me know if indeed this is the way to provide the parameters for external DB indexing and also how to specify which tables within the external DB to index.

thanks.

Paul Borgermans

Saturday 15 August 2009 10:43:28 am

Hi Kedar

This script is used for indexing ez publish content only

There are several routes to index external data:

- write your own script(s), using the base classes in the ezfind extension
- configuring Solr to do this for you through the search backend:
see http://wiki.apache.org/solr/DataImportHandler and make a small script using the Solr base classes from the ezfind extension to control this DataImportHandler

In both cases, you will probably need to modify the Solr schema file

To search this content, you can use the ezfind supplied rawSolrRequest fetch function in templates

In a future edition, ez find will be extended to make indexing adn searching external content easier out of the box

Regards
Paul

eZ Publish, eZ Find, Solr expert consulting and training
http://twitter.com/paulborgermans

eZ debug

Timing:	Jan 19 2025 18:59:41
Script start
Timing:	Jan 19 2025 18:59:41
Module start 'layout'
Timing:	Jan 19 2025 18:59:41
Module start 'content'
Timing:	Jan 19 2025 18:59:43
Module end 'content'
Timing:	Jan 19 2025 18:59:43
Script end

Main resources:

Total runtime	1.2195 sec
Peak memory usage	4,096.0000 KB
Database Queries	54

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0049	589.1641	152.6250
Module start 'layout'	0.0049	0.0025	741.7891	39.4609
Module start 'content'	0.0074	1.2107	781.2500	526.8906
Module end 'content'	1.2181	0.0013	1,308.1406	8.1563
Script end	1.2194		1,316.2969

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0030	0.2446	16	0.0002
Check MTime	0.0013	0.1046	16	0.0001
Mysql Total
Database connection	0.0006	0.0454	1	0.0006
Mysqli_queries	1.1726	96.1571	54	0.0217
Looping result	0.0005	0.0405	52	0.0000
Template Total	1.1887	97.5	2	0.5943
Template load	0.0018	0.1476	2	0.0009
Template processing	1.1869	97.3269	2	0.5934
Template load and register function	0.0003	0.0264	1	0.0003
states
state_id_array	0.0013	0.1105	1	0.0013
state_identifier_array	0.0018	0.1501	2	0.0009
Override
Cache load	0.0015	0.1195	20	0.0001
Sytem overhead
Fetch class attribute can translate value	0.0005	0.0414	2	0.0003
Fetch class attribute name	0.0008	0.0676	3	0.0003
XML
Image XML parsing	0.0032	0.2604	2	0.0016
class_abstraction
Instantiating content class attribute	0.0000	0.0006	3	0.0000
General
dbfile	0.0040	0.3265	17	0.0002
String conversion	0.0000	0.0007	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
2	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
5	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
1	content/datatype/view/ezxmltags/literal.tpl	<No override>	extension/community/design/standard/templates/content/datatype/view/ezxmltags/literal.tpl
1	content/datatype/view/ezimage.tpl	<No override>	extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tpl
2	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 13 Number of unique templates used: 7

Time used to render debug report: 0.0001 secs