lucene-solr-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Solr Wiki] Trivial Update of "DataImportHandler" by MarkoBonaci
Date Fri, 10 Sep 2010 22:00:20 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "DataImportHandler" page has been changed by MarkoBonaci.
http://wiki.apache.org/solr/DataImportHandler?action=diff&rev1=253&rev2=254

--------------------------------------------------

  == A screenshot ==
  {{attachment:interactive-dev-dataimporthandler.PNG}}
  
- 
- 
+ <<BR>>
+ ----
  
  <<Anchor(scheduling)>>
  = Scheduling =
+ {i}
+  * Data``Import``Handler``Scheduler
   * Version 1.0
+  * Last revision: 10.09.2010.
-  * Author Marko Bonaci, Croatia
+  * Author: Marko Bonaci, Zagreb, Croatia
   * Enables scheduling DIH delta and/or full imports
   * Proofs the concept, needs almost complete overhaul
   * Successfully tested on Apache Tomcat v6 (should work on any container)
-  * Wasn't incorporated in SVN (needs more polishing in order to commit)
- 
- Global /!\ :TODO: /!\
+  * Hasn't been committed to SVN (published only here)
+ <<BR>>
+ <!> Global TODO:
   * add comments to methods
   * try to use Solr's internal classes wherever possible
-  * parametrize the schedule interval in minutes (currently set to 10 minutes in ApplicationListener's
contextInitialized method)
+  * parametrize the schedule interval in minutes (currently set to 10 minutes in Application``Listener's
contextInitialized method)
-  
+ <<BR>>
  == Prereqs ==
-  * working DIH configuration in place
+  {1} working DIH configuration in place <<BR>>
-  * dataimport.properties file in folder ''solr.home/conf/'' with mandatory params inside
(see bellow for the example of dataimport.properties)
+  {2} dataimport.properties file in folder ''solr.home/conf/'' with mandatory params inside
(see bellow for the example of dataimport.properties)
- 
+ <<BR>>
  == SolrDataImportProperties ==
-  * uses [[http://download.oracle.com/javase/6/docs/api/java/util/Properties.html|java.util.Properties]]
to get settings from dataimport.properties
+  * uses [[http://download.oracle.com/javase/6/docs/api/java/util/Properties.html|java.util.Properties]]
to load settings from dataimport.properties
  
- /!\ :TODO: /!\
+ <!> TODO:
-  * uses system property for locating solr.home (use Solr's resource loader instead)
+  * currently uses system property for locating solr.home (use Solr's resource loader instead)
  
  {{{
  package hr.mbo.solr.dataimport;
@@ -1104, +1107 @@

  }
  }}}
  
- 
+ <<BR>>
  == ApplicationListener ==
   * the class implements [[http://download.oracle.com/javaee/6/api/javax/servlet/ServletContextListener.html|javax.servlet.ServletContextListener]]
(listens to web app Initialize and Destroy events)
   * uses HTTPPostScheduler, [[http://download.oracle.com/javase/6/docs/api/java/util/Timer.html|java.util.Timer]]
and context attribute map to facilitate periodic method invocation (scheduling)
@@ -1166, +1169 @@

  }
  }}}
  
- 
+ <<BR>>
  == HTTPPostScheduler ==
   * the class extends [[http://download.oracle.com/javase/6/docs/api/java/util/TimerTask.html|java.util.TimerTask]],
which implements [[http://download.oracle.com/javase/6/docs/api/java/lang/Runnable.html|java.lang.Runnable]]
   * represents main DIHScheduler thread
   * gets DIH params and sets default values if empty
-  * uses those params to compose complete URL
+  * uses those params to assemble complete URL
   * invokes URL using HTTP POST request method
  
- /!\ :TODO: /!\
+ <!> TODO:
   * make it core-aware (to work with and without cores)
   * add ''cancel'' functionality (to enable us to completely disable DIHScheduler and leave
app running) 
   * explode ''params'' to specific parameters
@@ -1292, +1295 @@

  
  }}}
  
- 
+ <<BR>>
  == dataimport.properties file example ==
-  * explains default values when param is omitted
+  * copy/paste ''dataimport scheduler properties'' part to your dataimport.properties file
(param explanations)
  
  {{{
  #Tue Jul 20 15:12:52 CEST 2010
@@ -1324, +1327 @@

  params=/select?clean=false&commit=true&command=delta-import&qt=/dataimport&handler=/dataimport
  }}}
  
- 
+ <<BR>>
+ ----
+ <<BR>>
  
  = Where to find it? =
  DataImportHandler is a new addition to Solr. You can either:

Mime
View raw message