Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Message-Id: <1445346043.870240.415225233.77E2034E@webmail.messagingengine.com>
From: Upayavira <uv@odoko.co.uk>
To: solr-user@lucene.apache.org
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Type: text/plain
Subject: Re: Blob store, blob size & storage mechanism
Date: Tue, 20 Oct 2015 08:00:43 -0500
In-Reply-To: 
 <CAOOKt53VbrM5MFq_4tJ35SK03dnj=5tJRSw+Zp_QRs_3RccscQ@mail.gmail.com>
References: <1445342193.845227.415172417.2C145AA9@webmail.messagingengine.com>
 <CAOOKt53VbrM5MFq_4tJ35SK03dnj=5tJRSw+Zp_QRs_3RccscQ@mail.gmail.com>

Okay, thx. I heard it mentioned at Lucene Revolution as a location for
storing machine learning models. Do people really have models coming in
at under 2Mb?

It'd be good to get this limitation into the BlobStore docs.

Upayavira

On Tue, Oct 20, 2015, at 07:19 AM, Shalin Shekhar Mangar wrote:
> No, the maximum size is limited to 2MB for now. The use-case behind
> the blob store is to store small jars (custom plugins) and stopwords,
> synonyms etc (even though those aren't usable right now) so maybe we
> can relax the limits a little bit. However, it is definitely not meant
> for GBs of data.
> 
> On Tue, Oct 20, 2015 at 5:26 PM, Upayavira <uv@odoko.co.uk> wrote:
> > Is there a maximum size to objects in the blob store? How are objects
> > stored? As a stored field?
> >
> > I've got some machine learning models that are 2-4Gb in size, and whilst
> > machine learning models is one of the intended uses of the blob store,
> > putting GB of data in it scares me a little. Is it reasonable and does
> > it work?
> >
> > Upayavira
> 
> 
> 
> -- 
> Regards,
> Shalin Shekhar Mangar.