lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Philip <davidphilipshe...@gmail.com>
Subject Re: Storing 2 dimension array in Solr
Date Sun, 13 Oct 2013 01:56:03 GMT
Hi Erick, Yes it is. But the columns here are dynamically and very
frequently added.They can increase upto 1 million right now. So, 1 document
with 1 million dynamic fields, is it fine? Or any other approach?

While searching through web, I found that docValues are column oriented.
http://searchhub.org/2013/04/02/fun-with-docvalues-in-solr-4-2/
However,  I did not understand, how to use docValues to add these columns.

What is the recommended approach?

Thanks - David






On Sun, Oct 13, 2013 at 3:33 AM, Erick Erickson <erickerickson@gmail.com>wrote:

> Isn't this just indexing each row as a separate document
> with a suitable ID "groupN" in your example?
>
>
> On Sat, Oct 12, 2013 at 2:43 PM, David Philip
> <davidphilipsheron@gmail.com>wrote:
>
> > Hi Erick,
> >
> >    We have set of groups as represented below. New columns (diseases as
> in
> > below matrix) keep coming and we need to add them as new column. To that
> > column, we have values such as 1 or 2 or 3 or 4 (exist, slight, na,
> > notfound) for respective groups.
> >
> > While querying we need  to get the entire row for group:"group1".  We
> will
> > not be searching on columns(*_disease) values, index=false but stored is
> > true.
> >
> > for ex: we use, get group:"group1" and we need to get the entire row-
> > exist,slight, not found. Hoping this explanation is clearer.
> >
> >                disease1    disease2     disease3
> > group1    exist         slight          not found
> > groups2   slight        not found    exist
> > group3    slight         exist
> > groupK    -                na             exist
> >
> >
> >
> > Thanks - David
> >
> >
> >
> >
> >
> > On Sat, Oct 12, 2013 at 11:39 PM, Erick Erickson <
> erickerickson@gmail.com
> > >wrote:
> >
> > > David:
> > >
> > > This feels like it may be an XY problem. _Why_ do you
> > > want to store a 2-dimensional array and what
> > > do you want to do with it? Maybe there are better
> > > approaches.
> > >
> > > Best
> > > Erick
> > >
> > >
> > > On Sat, Oct 12, 2013 at 2:07 AM, David Philip
> > > <davidphilipsheron@gmail.com>wrote:
> > >
> > > > Hi,
> > > >
> > > >   I have a 2 dimension array and want it to be persisted in solr. How
> > > can I
> > > > do that?
> > > >
> > > > Sample case:
> > > >
> > > >              disease1    disease2     disease3
> > > > group1    exist         slight          not found
> > > > groups2   slight        not found    exist
> > > > group2    slight         exist
> > > >
> > > > exist-1 not found - 2 slight-3 .. can be stored like this also.
> > > >
> > > > Note: This array has frequent updates.  Every time new disease get's
> > > added
> > > > and I have to add description about that disease to all groups. And
> at
> > > > query time, I will do get by row  - get by group only group = group2
> > row.
> > > >
> > > > Any suggestion on how I can achieve this?  I am thankful to the forum
> > for
> > > > replying with patience, on achieving this, i will blog and will share
> > it
> > > > with all.
> > > >
> > > > Thanks - David
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message