incubator-blur-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron McCurry <amccu...@gmail.com>
Subject Re: Possible to have a META shard?
Date Thu, 10 Jul 2014 12:32:15 GMT
It would be nice to understand what you changed in Blur and why so that we
may be able to incorporate those changes in the code base so you don't have
to modify on new releases.

Thanks!

Aaron


On Tue, Jul 1, 2014 at 12:11 AM, Ravikumar Govindarajan <
ravikumar.govindarajan@gmail.com> wrote:

> Yeah...
>
> We have actually modified Blur to do this... But till now we were using an
> external system {Redis} to hold the mappings. But I prefer it to be self
> contained within Blur eco-system and thats why this META shard stuff came
> up
>
> --
> Ravi
>
>
> On Tue, Jul 1, 2014 at 6:43 AM, Aaron McCurry <amccurry@gmail.com> wrote:
>
> > Would a configurable partitioner help with what you are trying to do?
> >
> >
> > On Fri, Jun 27, 2014 at 1:43 PM, Ravikumar Govindarajan <
> > ravikumar.govindarajan@gmail.com> wrote:
> >
> > > Aaron,
> > >
> > > We are trying to externalize RowId to Shard mapping, instead of current
> > > hashing algo.
> > >
> > > We thought of storing this in a META shard, where lucene's in-memory
> > > postings format can be used.
> > >
> > > Also BlurClient can cache these mappings so there are progressively
> fewer
> > > trips to the meta-shard.
> > >
> > > --
> > > Ravi
> > >
> > >
> > >
> > > On Fri, Jun 27, 2014 at 6:35 PM, Aaron McCurry <amccurry@gmail.com>
> > wrote:
> > >
> > > > When you get a change let us know what the use case is that you are
> > > solving
> > > > and perhaps we can add a feature to handle it.
> > > >
> > > > Aaron
> > > >
> > > >
> > > > On Fri, Jun 27, 2014 at 7:57 AM, Ravikumar Govindarajan <
> > > > ravikumar.govindarajan@gmail.com> wrote:
> > > >
> > > > > Thanks Tim,
> > > > >
> > > > > Shall surely do that. That should suffice
> > > > >
> > > > > --
> > > > > Ravi
> > > > >
> > > > >
> > > > > On Fri, Jun 27, 2014 at 3:21 PM, Tim Williams <
> williamstw@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > On Friday, June 27, 2014, Ravikumar Govindarajan <
> > > > > > ravikumar.govindarajan@gmail.com> wrote:
> > > > > >
> > > > > > > We have a use-case whereby there is a need for a META shard.
We
> > > don't
> > > > > > store
> > > > > > > row-documents here as other normal shards, but some arbitrary
> > > > > searchable
> > > > > > > meta-data
> > > > > > >
> > > > > > > Is it possible in Blur to do this?
> > > > > > >
> > > > > >
> > > > > > Hi Ravi,
> > > > > > Why not just create a "meta" table and put it in there with
a 1-1
> > > > > > row-record relationship?
> > > > > >
> > > > > > Thanks,
> > > > > > --tim
> > > > > >
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message