incubator-blur-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravikumar Govindarajan <ravikumar.govindara...@gmail.com>
Subject Re: Possible to have a META shard?
Date Tue, 01 Jul 2014 04:11:12 GMT
Yeah...

We have actually modified Blur to do this... But till now we were using an
external system {Redis} to hold the mappings. But I prefer it to be self
contained within Blur eco-system and thats why this META shard stuff came up

--
Ravi


On Tue, Jul 1, 2014 at 6:43 AM, Aaron McCurry <amccurry@gmail.com> wrote:

> Would a configurable partitioner help with what you are trying to do?
>
>
> On Fri, Jun 27, 2014 at 1:43 PM, Ravikumar Govindarajan <
> ravikumar.govindarajan@gmail.com> wrote:
>
> > Aaron,
> >
> > We are trying to externalize RowId to Shard mapping, instead of current
> > hashing algo.
> >
> > We thought of storing this in a META shard, where lucene's in-memory
> > postings format can be used.
> >
> > Also BlurClient can cache these mappings so there are progressively fewer
> > trips to the meta-shard.
> >
> > --
> > Ravi
> >
> >
> >
> > On Fri, Jun 27, 2014 at 6:35 PM, Aaron McCurry <amccurry@gmail.com>
> wrote:
> >
> > > When you get a change let us know what the use case is that you are
> > solving
> > > and perhaps we can add a feature to handle it.
> > >
> > > Aaron
> > >
> > >
> > > On Fri, Jun 27, 2014 at 7:57 AM, Ravikumar Govindarajan <
> > > ravikumar.govindarajan@gmail.com> wrote:
> > >
> > > > Thanks Tim,
> > > >
> > > > Shall surely do that. That should suffice
> > > >
> > > > --
> > > > Ravi
> > > >
> > > >
> > > > On Fri, Jun 27, 2014 at 3:21 PM, Tim Williams <williamstw@gmail.com>
> > > > wrote:
> > > >
> > > > > On Friday, June 27, 2014, Ravikumar Govindarajan <
> > > > > ravikumar.govindarajan@gmail.com> wrote:
> > > > >
> > > > > > We have a use-case whereby there is a need for a META shard.
We
> > don't
> > > > > store
> > > > > > row-documents here as other normal shards, but some arbitrary
> > > > searchable
> > > > > > meta-data
> > > > > >
> > > > > > Is it possible in Blur to do this?
> > > > > >
> > > > >
> > > > > Hi Ravi,
> > > > > Why not just create a "meta" table and put it in there with a 1-1
> > > > > row-record relationship?
> > > > >
> > > > > Thanks,
> > > > > --tim
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message