lucene-solr-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Solr Wiki] Trivial Update of "DataImportHandler" by MarkoBonaci
Date Thu, 16 Sep 2010 23:21:06 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "DataImportHandler" page has been changed by MarkoBonaci.
http://wiki.apache.org/solr/DataImportHandler?action=diff&rev1=259&rev2=260

--------------------------------------------------

  {i}
   * Data``Import``Handler``Scheduler
   * Version 1.1
-  * Last revision: 16.09.2010.
+  * Last revision: 17.09.2010.
-  * Author: Marko Bonaci, Zagreb, Croatia
+  * Author: Marko Bonaci
   * Enables scheduling DIH delta and/or full imports
-  * Proofs the concept, needs almost complete overhaul
+  * Proofs the concept, but needs more work
   * Successfully tested on ''Apache Tomcat v6'' (should work on any servlet container)
   * Hasn't been committed to SVN (published only here)
  
  <<BR>>
  <!> Global TODO:
-  * make it ''core-aware'' (to work with and without cores)
+  * make it ''core-aware'' (to work regardless of whether a single or a multi-core Solr is
deployed)
-  * add ''cancel'' functionality (to be able to completely disable DIHScheduler background
thread, without stopping the app/server). Currently sync can be disabled by emptying ''syncCores''
param in dataimport.properties file (but the background thread remains active and reloads
the properties file on every run)
+  * add ''cancel'' functionality (to be able to completely disable ''DIHScheduler'' background
thread, without stopping the app/server). Currently, sync can be disabled by emptying ''syncCores''
param in ''dataimport.properties'' file, but the background thread remains active and reloads
the properties file on every run (so that sync can be hot-deployed)
   * parametrize the schedule interval in minutes (currently set to 10 minutes in ''Application``Listener's
contextInitialized'' method)
-  * try to use Solr's internal classes wherever possible
+  * try to use Solr's classes wherever possible
+  * add javadoc style comments
  
  <<BR>>
  == Prereqs ==
@@ -1064, +1065 @@

   * uses [[http://download.oracle.com/javase/6/docs/api/java/util/Properties.html|java.util.Properties]]
to load settings from ''dataimport.properties''
  
  {OK} Revisions:
-  * v1.1:
+   v1.1:
-  * now using Solr``Resource``Loader to get solr.home (as opposed to System properties in
v1.0)
+  * now using ''Solr``Resource``Loader'' to get ''solr.home'' (as opposed to ''System properties''
in v1.0)
+  * logging done using ''slf4j'' (used ''System.out'' in v1.0)
-  * logging done using slf4j
- 
- <!> TODO:
-  (./) currently uses system property for locating ''solr.home'' (use Solr's resource loader
instead)
-  * add javadoc comments
  
  {{{
  package hr.mbo.solr.dataimport;
@@ -1138, +1135 @@

   * Timer is essentially a facility for threads to schedule tasks for future execution in
a background thread.
  
  {OK} Revisions:
-  * v1.1:
+   v1.1:
-  * logging done using slf4j
+  * logging done using ''slf4j'' (used ''System.out'' in v1.0)
  
  {{{
  package hr.mbo.solr.scheduler;
@@ -1205, +1202 @@

  <<BR>>
  == HTTPPostScheduler ==
   * the class extends [[http://download.oracle.com/javase/6/docs/api/java/util/TimerTask.html|java.util.TimerTask]],
which implements [[http://download.oracle.com/javase/6/docs/api/java/lang/Runnable.html|java.lang.Runnable]]
-  * represents main DIHScheduler thread (run by Timer background thread)
+  * represents main ''DIHScheduler'' thread (run by ''Timer'' background thread)
-  * gets DIH params and sets default values if empty
+  * gets DIH params and sets default values, where appropriate
-  * uses those params to assemble complete URL
+  * uses DIH params to assemble complete URL
   * invokes URL using HTTP POST request
  
  {OK} Revisions:
-  * v1.1:
+   v1.1:
   * forces reloading of the properties file if the response code is not 200
-  * logging done using slf4j
+  * logging done using ''slf4j'' (used ''System.out'' in v1.0)
  
  <!> TODO:
   * explode ''params'' to specific parameters
-  (./) currently logs events to server console -> use logger instead
  
+ <<BR>>
  {{{
  package hr.mbo.solr.scheduler;
  
@@ -1340, +1337 @@

  }}}
  
  <<BR>>
- == dataimport.properties file example ==
+ == dataimport.properties example ==
   * copy/paste ''dataimport scheduler properties'' part to your ''dataimport.properties''
file (param explanations)
  
  {{{

Mime
View raw message