lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Upayavira ...@odoko.co.uk>
Subject Re: Solr using a ridiculous amount of memory
Date Mon, 15 Apr 2013 12:25:28 GMT
Might be obvious, but just in case - remember that you'll need to
re-index your content once you've added docValues to your schema, in
order to get the on-disk files to be created.

Upayavira

On Mon, Mar 25, 2013, at 03:16 PM, John Nielsen wrote:
> I apologize for the slow reply. Today has been killer. I will reply to
> everyone as soon as I get the time.
> 
> I am having difficulties understanding how docValues work.
> 
> Should I only add docValues to the fields that I actually use for sorting
> and faceting or on all fields?
> 
> Will the docValues magic apply to the fields i activate docValues on or
> on
> the entire document when sorting/faceting on a field that has docValues
> activated?
> 
> I'm not even sure which question to ask. I am struggling to understand
> this
> on a conceptual level.
> 
> 
> On Sun, Mar 24, 2013 at 7:11 PM, Robert Muir <rcmuir@gmail.com> wrote:
> 
> > On Sun, Mar 24, 2013 at 4:19 AM, John Nielsen <jn@mcb.dk> wrote:
> >
> > > Schema with DocValues attempt at solving problem:
> > > http://pastebin.com/Ne23NnW4
> > > Config: http://pastebin.com/x1qykyXW
> > >
> >
> > This schema isn't using docvalues, due to a typo in your config.
> > it should not be DocValues="true" but docValues="true".
> >
> > Are you not getting an error? Solr needs to throw exception if you
> > provide invalid attributes to the field. Nothing is more frustrating
> > than having a typo or something in your configuration and solr just
> > ignores this, reports no error, and "doesnt work the way you want".
> > I'll look into this (I already intend to add these checks to analysis
> > factories for the same reason).
> >
> > Separately, if you really want the terms data and so on to remain on
> > disk, it is not enough to "just enable docvalues" for the field. The
> > default implementation uses the heap. So if you want that, you need to
> > set docValuesFormat="Disk" on the fieldtype. This will keep the
> > majority of the data on disk, and only some key datastructures in heap
> > memory. This might have significant performance impact depending upon
> > what you are doing so you need to test that.
> >
> 
> 
> 
> -- 
> Med venlig hilsen / Best regards
> 
> *John Nielsen*
> Programmer
> 
> 
> 
> *MCB A/S*
> Enghaven 15
> DK-7500 Holstebro
> 
> Kundeservice: +45 9610 2824
> post@mcb.dk
> www.mcb.dk

Mime
View raw message