lucene-solr-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Solr Wiki] Update of "DataImportHandler" by NoblePaul
Date Wed, 19 Mar 2008 08:25:39 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The following page has been changed by NoblePaul:
http://wiki.apache.org/solr/DataImportHandler

------------------------------------------------------------------------------
  The use case is as follows:
  There are 3 datasources two RDBMS (jdbc1,jdbc2) and one xml/http (B)
  
-  * `jdbc1` and `jdbc2` are instances of `JdbcDataSource` which are configured in the solrconfig.xml.

+  * `jdbc1` and `jdbc2` are instances of  type `JdbcDataSource` which are configured in the
solrconfig.xml. 
-  * `http` is an instance of `HttpDataSource` 
+  * `http` is an instance of type `HttpDataSource` 
   * The root entity starts with a table called 'A' and uses 'jdbc1' as the datasource . The
entity is conveniently named as the table itself
   * Entity 'A' has 2 sub-entities 'B' and 'C' . 'B' uses the datasource instance  'http'
and 'C' uses the datasource instance 'jdbc2'
   * On doing a `command=full-import` The root-entity (A) is executed first 
@@ -380, +380 @@

     * B has a url  (B is an xml/http datasource) 
     * C has a query
   * C has two transformers ('f' and 'g' )   
-  * Each row that comes out of C is fed into 'f' and 'g' sequentially (transformers are chained)
. Each transformer produces changes the input. Note that the transformer 'g' produces 2 output
rows for an input row `f(C.1))
+  * Each row that comes out of C is fed into 'f' and 'g' sequentially (transformers are chained)
. Each transformer can change the input. Note that the transformer 'g' produces 2 output rows
for an input row `f(C.1))
   * The end output of each entity is combined together to construct a document
     * Note that the intermediate rows from C i.e `C.1, C.2, f(C.1) , f(C1)` are ignored
  

Mime
View raw message