Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of erickerickson@gmail.com
 designates 209.85.220.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CACiMRG+Ad4=n_U2YvKXo7O495V5zb48_hYYB4-HFv0rQdTaUnw@mail.gmail.com>
References: 
 <CABDm0O9OHqBJ7FPie8YhGELyT3SMWAE9MNk2oy873pwsWjt1Vw@mail.gmail.com>
	<CANNBgPKB5B84xLTA5GJsutMR15SHFREvQw8O=wCAepEHqKMR8w@mail.gmail.com>
	<CABDm0O97Nu90r6ovsybg-s1z1hdbgQCfsehVLWA811kPkS=+4w@mail.gmail.com>
	<69E73D70-FCF2-4C59-9269-4B19538A6F9F@innoventsolutions.com>
	<CABDm0O9eRDTCfwtvDnsfdSXtbe+eP+PR0BciqKQzDwZgmJtAqQ@mail.gmail.com>
	<CACiMRG+Ad4=n_U2YvKXo7O495V5zb48_hYYB4-HFv0rQdTaUnw@mail.gmail.com>
Date: Sat, 6 Jul 2013 08:27:31 -0400
Message-ID: 
 <CAN4YXvewwFNvUCZyeOzd8sxV5_+0z2ufd=T8XvmiCAEEX2ZjgA@mail.gmail.com>
Subject: Re: 2.1billion+ document
From: Erick Erickson <erickerickson@gmail.com>
To: solr-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=047d7b66fd3b6baaf804e0d6efbf

--047d7b66fd3b6baaf804e0d6efbf
Content-Type: text/plain; charset=ISO-8859-1

uniqueKey is used to enforce there
being only a single copy of a doc. Say
a doc changes and you re-index it. If
there is a doc in the index already _with
the same uniqueKey_ it'll be deleted
and the new one will be the only one
visible.

Which implies that if you do implement
the suggestions, be sure you send any
docs you update to the _same_ shard
you sent them to originally.  If you have
no occasion to update docs that already
exist in your index, you don't care about
this much.

Best
Erick


On Sat, Jul 6, 2013 at 12:53 AM, Gora Mohanty <gora@mimirtech.com> wrote:

> On 6 July 2013 09:45, Ali, Saqib <docbook.xml@gmail.com> wrote:
> > Thanks Jason! That was very helpful.
> >
> > I read on the solr wiki that:
> > "Documents must have a unique key and the unique key must be stored
> > (stored="true" in schema.xml)"
> >
> > What is this unique key? Is this just a id that we define in the
> schema.xml
> > that is unique to all documents? We have something as follows:
> >         <field name="id" type="long" indexed="true" stored="true"/>
> >
> > Will this suffice?
>
> By default, schema.xml should also have
> <uniqueKey>id</uniqueKey>
> and with these, you should be all set as
> far as the configuration goes.
>
> At index time, you also have to provide
> this unique key to Solr, and for distributed
> search, ensure that it is unique across all
> shards, as the Wiki notes. How you form
> this unique key depends on your use case,
> but for example, you could use the system
> filepath, or a MD5 sum of the file contents.
>
> Regards,
> Gora
>

--047d7b66fd3b6baaf804e0d6efbf--