lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kudrettin Güleryüz <kudret...@gmail.com>
Subject Re: cloud disk space utilization
Date Thu, 30 Aug 2018 14:34:18 GMT
Thank you Shalin. I'll try creating a policy with practically zero effect
for now.

On Wed, Aug 29, 2018 at 11:31 PM Shalin Shekhar Mangar <
shalinmangar@gmail.com> wrote:

> There is a bad oversight on our part which causes preferences to not be
> used for placing replicas unless a cluster policy also exists. We hope to
> fix it in the next release (Solr 7.5). See
> https://issues.apache.org/jira/browse/SOLR-12648
>
> You may also be interested in
> https://issues.apache.org/jira/browse/SOLR-12592
>
>
> On Tue, Aug 28, 2018 at 2:47 AM Kudrettin Güleryüz <kudrettin@gmail.com>
> wrote:
>
> > Hi,
> >
> > We have six Solr nodes with ~1TiB disk space on each mounted as ext4. The
> > indexers sometimes update the collections and create new ones if update
> > wouldn't be faster than scratch indexing. (up to around 5 million
> documents
> > are indexed for each collection) On average there are around 130
> > collections on this SolrCloud. Collection sizes vary from 1GiB to 150GiB.
> >
> > Preferences set:
> >
> >   "cluster-preferences":[{
> >       "maximize":"freedisk",
> >       "precision":10}
> >     ,{
> >       "minimize":"cores",
> >       "precision":1}
> >     ,{
> >       "minimize":"sysLoadAvg",
> >       "precision":3}],
> >
> > * Is it be possible to run out of disk space on one of the nodes while
> > others would have plenty? I observe some are getting close to ~80%
> > utilization while others stay at ~60%
> > * Would this difference be due to collection index size differences or
> due
> > to error on my side to come up with a useful policy/preferences?
> >
> > Thank you
> >
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message