Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
MIME-Version: 1.0
References: <CA+UU3+xuPxJjHg38fkn06QqSaXE_xDR_1nW0-cr+MctYKzaJbQ@mail.gmail.com>
 <CAL8PwkbB8RLyo949v0qnkLiGfcT7GGkY0FZ5LyjwG-L_WFqUUA@mail.gmail.com>
 <CA+UU3+zdcODCWn4tH_4bp3sux9Yspdj+WFSfpwLi3hJhyuxKww@mail.gmail.com> <CAL8PwkY2q8U-FjRVtMS6JX=7YnnSxSbz-E_L909eJ0DFU81NzA@mail.gmail.com>
In-Reply-To: <CAL8PwkY2q8U-FjRVtMS6JX=7YnnSxSbz-E_L909eJ0DFU81NzA@mail.gmail.com>
From: Adrien Grand <jpountz@gmail.com>
Date: Tue, 16 Aug 2016 08:45:32 +0000
Message-ID: <CAPsWd+Ofr9_wTxiacgVdQJhdPTshgmHTRw03ry9n_zWuMWaz_w@mail.gmail.com>
Subject: Re: LUCENE-6766 index sorting and custom SortField
To: java-user@lucene.apache.org, =?UTF-8?Q?Andres_de_la_Pe=C3=B1a?= <adelapena@stratio.com>
Content-Type: multipart/alternative; boundary=001a1142af6cc2e3a7053a2c5f3c
archived-at: Tue, 16 Aug 2016 08:45:51 -0000

--001a1142af6cc2e3a7053a2c5f3c
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Maybe another way would be to create a custom SegmentInfoFormat that
handles the serialization of this custom SortField. That would put the
burden on the user to handle backward compatibility, but on the other hand
it would not require SortFields to handle their own serialization? It would
not work today since IndexWriterConfig does its own checks, but maybe this
is something we can fix to allow for custom sort orders?

Le lun. 15 ao=C3=BBt 2016 =C3=A0 20:57, Michael McCandless <lucene@mikemcca=
ndless.com>
a =C3=A9crit :

> Hmm I see.  Yeah, it seems like the only way forward is to explore
> SortField (and its subclasses) handling their own serialization, maybe vi=
a
> SPI (what we use for codecs), though that sounds somewhat heavy.  Maybe
> open an issue for discussion?
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
> On Mon, Aug 15, 2016 at 12:12 PM, Andres de la Pe=C3=B1a <adelapena@strat=
io.com
> >
> wrote:
>
> > Hi,
> >
> > We are using a custom SortField
> > <
> https://github.com/Stratio/cassandra-lucene-index/blob/branch-3.0.8/plugi=
n/src/main/java/com/stratio/cassandra/lucene/key/KeySort.java
> >
> > to sort Cassandra primary keys. The sort criteria is based on the
> > marshalled values of each of the columns in the primary key, so it is n=
ot
> > trivial at all to compute an equivalent collated value to be indexed in
> doc
> > values.
> >
> > Maybe it could be possible to define how to do this
> > serialization-deserialization when extending SortField. This way it wil=
l
> be
> > possible to recover this lost Lucene 5.x feature, don't you think so?
> >
> > Thanks,
> >
> > 2016-08-14 23:09 GMT+01:00 Michael McCandless <lucene@mikemccandless.co=
m
> >:
> >
> >> Unfortunately, as of LUCENE-6766, index sorting only supports simple
> sort
> >> types.  This was needed because Lucene needs to be able to easily
> serialize
> >> and de-serialize the sort order into the index.
> >>
> >> Can you compute your sort criteria and index it as a doc values field
> and
> >> then sort by that?
> >>
> >> Or, patches welcome too ;)
> >>
> >> Mike McCandless
> >>
> >> http://blog.mikemccandless.com
> >>
> >> On Sun, Aug 14, 2016 at 7:19 AM, Andres de la Pe=C3=B1a <
> adelapena@stratio.com
> >> > wrote:
> >>
> >>> Hi,
> >>>
> >>> LUCENE-6766 allows to define index sorting on IndexWriterConfig inste=
ad
> >>> of
> >>> defining a SortingMergePolicy. However, the new index sorting only
> >>> supports
> >>> some types of sort fields, and the old SortingMergePolicy, which didn=
't
> >>> have this limitation, has been removed.
> >>>
> >>> What should do projects depending on index sort with custom SortField=
s?
> >>> Ignore the new index writer sorting and build their own old-style
> sorting
> >>> merge policy?
> >>>
> >>> Thanks,
> >>>
> >>> --
> >>> Andr=C3=A9s de la Pe=C3=B1a
> >>>
> >>> V=C3=ADa de las dos Castillas, 33, =C3=81tica 4, 3=C2=AA Planta
> >>> 28224 Pozuelo de Alarc=C3=B3n, Madrid
> >>> Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
> >>> <https://twitter.com/StratioBD>*
> >>>
> >>
> >>
> >
> >
> > --
> > Andr=C3=A9s de la Pe=C3=B1a
> >
> > V=C3=ADa de las dos Castillas, 33, =C3=81tica 4, 3=C2=AA Planta
> > 28224 Pozuelo de Alarc=C3=B3n, Madrid
> > Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
> > <https://twitter.com/StratioBD>*
> >
>

--001a1142af6cc2e3a7053a2c5f3c--