Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
MIME-Version: 1.0
In-Reply-To: <F13EF7C4-8391-460B-80D1-CC59F24E2FBF@wunderwood.org>
References: <CANsFX05x2qkeOgBLm9wqG856xNBRZv=53Wy34By4mBymcNh5hw@mail.gmail.com>
 <3b9a8a65-1774-e747-62bd-451784ed1c35@elyograg.org> <CANsFX06dN04RRWZoEdNDP8cCJNTLzWL8QpdiNf2oV3m1UfEJOQ@mail.gmail.com>
 <CAN4YXvcT5n_n6ZfvK8Cp58+bh7He8qmNiQrYet+N4YcBwXZBJw@mail.gmail.com>
 <CANsFX07WSq0PiGJ1BNifre78AoSMT8JJiq+2R5svDBRt=io6mw@mail.gmail.com>
 <CAB_8Yd__QdO6g=+avJhbRsaW6MtwwiJyVJeVh8QCyZ4t5HCSEQ@mail.gmail.com>
 <CANsFX06tG8FdXztoANaJi47NsECOrWRKL_rswo1iXpuMhKzqcQ@mail.gmail.com>
 <CAB_8Yd_Vg4w4tbtoLEvN9+tk4=rHQmCWAW7WCCe5OzWwvbzKXA@mail.gmail.com> <F13EF7C4-8391-460B-80D1-CC59F24E2FBF@wunderwood.org>
From: Dorian Hoxha <dorian.hoxha@gmail.com>
Date: Sat, 29 Apr 2017 20:38:47 +0200
Message-ID: <CANsFX064WPxvFg_=DstYqVnpK9XwMzT9aKXnZebsWLbD0aP1tg@mail.gmail.com>
Subject: Re: Why no composite primary-key in lucene ?
To: dev@lucene.apache.org
Content-Type: multipart/alternative; boundary=001a113cd2905624f6054e52817d
archived-at: Sat, 29 Apr 2017 18:39:12 -0000

--001a113cd2905624f6054e52817d
Content-Type: text/plain; charset=UTF-8

@Yonik Thanks, makes sense.

@Walter

After reading the cwiki page on update request processor
<https://cwiki.apache.org/confluence/display/solr/Update+Request+Processors>
looks like you can't modify the GET/DELETE handlers, right ?
Because I want to NOT index/store the 'id' field, so clients/solr-cloud
(which needs /get) continue to work normally but internally 'id' appears
only in translog.
And I need to do something similar for GET/DELETE.

How to do that ?

Regards,
Dorian

On Sat, Apr 29, 2017 at 8:04 PM, Walter Underwood <wunder@wunderwood.org>
wrote:

> If you do want a composite key in Solr, you could use an update request
> processor script to make it out of the multiple fields.
>
> wunder
> Walter Underwood
> wunder@wunderwood.org
> http://observer.wunderwood.org/  (my blog)
>
>
> On Apr 29, 2017, at 11:02 AM, Yonik Seeley <yseeley@gmail.com> wrote:
>
> On Sat, Apr 29, 2017 at 1:45 PM, Dorian Hoxha <dorian.hoxha@gmail.com>
> wrote:
>
> @Yonik
>
> Thanks makes sense. So this means that the 'id' need to be indexed(is
> always?), (so you can get/update/delete docs not in translog), right ?
>
>
> In Solr, yes.  In Lucene, only if you want lookup-by-id to be fast, or
> if you want to use updateDocument with an indexed term for overwriting
> documents.
>
> -Yonik
>
>
> On Sat, Apr 29, 2017 at 7:24 PM, Yonik Seeley <yseeley@gmail.com> wrote:
>
>
> Solr doesn't use Lucene for RT GET, it uses it's transaction log.
> Only when the document is not found in the transaction log will it go
> and consult the lucene index (which can only search as of the last
> commit).
>
> -Yonik
>
> On Sat, Apr 29, 2017 at 12:57 PM, Dorian Hoxha <dorian.hoxha@gmail.com>
> wrote:
>
> I know all that. My point is, lucene is NRT, while GET is RT (in both
> ES/SOLR). How does lucene return the right document (Term Query) before
> doing a commit on GET ?
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
>

--001a113cd2905624f6054e52817d
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div><div><div>@Yonik Thanks, makes sense.<br><b=
r></div>@Walter<br><br></div>After reading the cwiki page on <a href=3D"htt=
ps://cwiki.apache.org/confluence/display/solr/Update+Request+Processors" ta=
rget=3D"_blank">update request processor</a> looks like you can&#39;t modif=
y the GET/DELETE handlers, right ?<br></div>Because I want to NOT index/sto=
re the &#39;id&#39; field, so clients/solr-cloud (which needs /get) continu=
e to work normally but internally &#39;id&#39; appears only in translog.</d=
iv><div>And I need to do something similar for GET/DELETE. <br><br>How to d=
o that ?<br><br>Regards,<br></div></div>Dorian<br></div><div class=3D"gmail=
_extra"><br><div class=3D"gmail_quote">On Sat, Apr 29, 2017 at 8:04 PM, Wal=
ter Underwood <span dir=3D"ltr">&lt;<a href=3D"mailto:wunder@wunderwood.org=
" target=3D"_blank">wunder@wunderwood.org</a>&gt;</span> wrote:<br><blockqu=
ote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc s=
olid;padding-left:1ex"><div style=3D"word-wrap:break-word">If you do want a=
 composite key in Solr, you could use an update request processor script to=
 make it out of the multiple fields.<div><br></div><div>wunder<span class=
=3D"HOEnZb"><font color=3D"#888888"><br><div>
<div style=3D"color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-=
indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wra=
p:break-word">Walter Underwood<br><a href=3D"mailto:wunder@wunderwood.org" =
target=3D"_blank">wunder@wunderwood.org</a><br><a href=3D"http://observer.w=
underwood.org/" target=3D"_blank">http://observer.wunderwood.<wbr>org/</a> =
=C2=A0(my blog)<br><br></div>

</div></font></span><div><div class=3D"h5">
<br><div><blockquote type=3D"cite"><div>On Apr 29, 2017, at 11:02 AM, Yonik=
 Seeley &lt;<a href=3D"mailto:yseeley@gmail.com" target=3D"_blank">yseeley@=
gmail.com</a>&gt; wrote:</div><br class=3D"m_1610598727547475644Apple-inter=
change-newline"><div><div>On Sat, Apr 29, 2017 at 1:45 PM, Dorian Hoxha &lt=
;<a href=3D"mailto:dorian.hoxha@gmail.com" target=3D"_blank">dorian.hoxha@g=
mail.com</a>&gt; wrote:<br><blockquote type=3D"cite">@Yonik<br><br>Thanks m=
akes sense. So this means that the &#39;id&#39; need to be indexed(is<br>al=
ways?), (so you can get/update/delete docs not in translog), right ?<br></b=
lockquote><br>In Solr, yes.=C2=A0 In Lucene, only if you want lookup-by-id =
to be fast, or<br>if you want to use updateDocument with an indexed term fo=
r overwriting<br>documents.<br><br>-Yonik<br><br><br><blockquote type=3D"ci=
te">On Sat, Apr 29, 2017 at 7:24 PM, Yonik Seeley &lt;<a href=3D"mailto:yse=
eley@gmail.com" target=3D"_blank">yseeley@gmail.com</a>&gt; wrote:<br><bloc=
kquote type=3D"cite"><br>Solr doesn&#39;t use Lucene for RT GET, it uses it=
&#39;s transaction log.<br>Only when the document is not found in the trans=
action log will it go<br>and consult the lucene index (which can only searc=
h as of the last<br>commit).<br><br>-Yonik<br><br>On Sat, Apr 29, 2017 at 1=
2:57 PM, Dorian Hoxha &lt;<a href=3D"mailto:dorian.hoxha@gmail.com" target=
=3D"_blank">dorian.hoxha@gmail.com</a>&gt;<br>wrote:<br><blockquote type=3D=
"cite">I know all that. My point is, lucene is NRT, while GET is RT (in bot=
h<br>ES/SOLR). How does lucene return the right document (Term Query) befor=
e<br>doing a commit on GET ?<br></blockquote><br>--------------------------=
----<wbr>------------------------------<wbr>---------<br>To unsubscribe, e-=
mail: <a href=3D"mailto:dev-unsubscribe@lucene.apache.org" target=3D"_blank=
">dev-unsubscribe@lucene.apache.<wbr>org</a><br>For additional commands, e-=
mail: <a href=3D"mailto:dev-help@lucene.apache.org" target=3D"_blank">dev-h=
elp@lucene.apache.org</a><br><br></blockquote><br></blockquote><br>--------=
----------------------<wbr>------------------------------<wbr>---------<br>=
To unsubscribe, e-mail: <a href=3D"mailto:dev-unsubscribe@lucene.apache.org=
" target=3D"_blank">dev-unsubscribe@lucene.apache.<wbr>org</a><br>For addit=
ional commands, e-mail: <a href=3D"mailto:dev-help@lucene.apache.org" targe=
t=3D"_blank">dev-help@lucene.apache.org</a><br><br></div></div></blockquote=
></div><br></div></div></div></div></blockquote></div><br></div>

--001a113cd2905624f6054e52817d--