Mailing-List: contact solr-commits-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-dev@lucene.apache.org
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
From: Apache Wiki <wikidiffs@apache.org>
To: Apache Wiki <wikidiffs@apache.org>
Date: Tue, 16 Feb 2010 22:13:56 -0000
Message-ID: <20100216221356.8911.21738@eos.apache.org>
Subject: 
 =?utf-8?q?=5BSolr_Wiki=5D_Trivial_Update_of_=22HadoopIndexing=22_by_Jason?=
 =?utf-8?q?Rutherglen?=

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for chan=
ge notification.

The "HadoopIndexing" page has been changed by JasonRutherglen.
http://wiki.apache.org/solr/HadoopIndexing?action=3Ddiff&rev1=3D2&rev2=3D3

--------------------------------------------------

  =

  CSVIndexer is provided as an example, though for your own application, yo=
u will need to create your own CSVIndexer like class.  CSVIndexer extends o=
rg.apache.hadoop.conf.Configured to be instantiated via the Hadoop command =
line.  Your CSVIndexer like class will set your custom mapper and set the o=
utput format as SolrOutputFormat.  Use the SolrDocumentConverter.setSolrDoc=
umentConverter to set your custom SolrDocumentConverter.
  =

- =3D=3D SolrDocumentConverter =3D=3D =

+ =3D=3D SolrDocumentConverter =3D=3D
  =

  Implement this class to convert an object from a proprietary format into =
a SolrInputDocument that may be indexed into Solr.
  =

- =3D=3D Heartbeater =3D=3D =

+ =3D=3D Heartbeater =3D=3D
  =

  Hadoop will try to kill a running task if it doesn't receive a periodic h=
eartbeat.  This is why in a background thread the HeartBeater class continu=
ously notifies Hadoop that the current task is still executing.  This is ne=
cessary with Solr and Lucene because some tasks such as an optimizing a lar=
ge shard can take several minutes to several hours.
 =20