lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis.gospodne...@gmail.com>
Subject Re: Solr cloud date based paritioning
Date Tue, 02 Jul 2013 16:22:13 GMT
Hi,

There is nothing automatic that I know of that will create shards (or
maybe you mean SolrCloud Collections?) every month.  You can do that
in your application, though, just create the Collection via the API.
You can make use of aliases to have something like "last2months" alias
point to your last 2 Collections.  You would "shift" this alias every
month after you create your new Collection.  Of course, right after
the shift, you would really be searching only 1 month's worth of data,
so you may want to allow searching across last 3 Collections instead,
optionally enforcing/limiting query to last 2 months based on document
date and a range query.

Otis
--
Solr & ElasticSearch Support -- http://sematext.com/
Performance Monitoring -- http://sematext.com/spm



On Tue, Jul 2, 2013 at 10:35 AM, kowish.adamosh
<kowish.adamosh@gmail.com> wrote:
> Hi guys!
>
> I have simple use case to implement but I have problem with date based
> partitioning... Here are some rules:
>
> 1. At the beginning I have to create huge index (10GB) based on one db
> table.
> 2. Every day I have to update this index.
> 3. 99,999% are queries based on date field (*data from last 2 months*).
>
> So my idea was to create partitions by month an provide month-based
> partition in query like in example in documentation:
> http://localhost:8983/solr/collection1/select?shards=shard_200812,shard_200912,shard_201001
>
> I would provide shards only from 2 months to gain nice performance.
>
> Questions are: how can I create month-based partitions? Is it possible to
> create new shard on each new month are update delta data only to this shard?
>
> Examples are very welcome. I read documentation a few times and can't find
> answers...
>
> Thanks!
> Kowish
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Solr-cloud-date-based-paritioning-tp4074729.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message