zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rakesh Radhakrishnan <rakeshr.apa...@gmail.com>
Subject Re: Zookeeper for storing huge centralize data and Max possible No of zNodes - Please advise
Date Fri, 15 Aug 2014 19:08:42 GMT
Adding one more, you can also explore Apache BookKeeper for storing millions
of K/V data. Since it uses filesystem for storing the ledgers & its
entries(data) size won't be a constraint. But it doesn't have watch
notifications.

Regards,
Rakesh




On Fri, Aug 15, 2014 at 10:18 PM, Alvaro Gareppe <agareppe@gmail.com> wrote:

> It doesn't seems to be the best use of zookeeper, Maybe redis is a best
> "tool" for you.. or some no sql db like Casandra or mongo is going to fit a
> little bit more.
>
>
>
>
> On Fri, Aug 15, 2014 at 3:41 AM, saurabh jain <sauravmanit@gmail.com>
> wrote:
>
> > Hi Folks,
> >
> > I am planning to use ZooKeeper znodes to store my key value data.
> > Name of the znode will be my key and data present inside it will be my
> > value.
> >
> >
> > The problem is I can have millions  of key/value pairs.
> >
> > Is the zookeeper recommended to solve this type of problem.  I read about
> > the zookeeper that
> > it is not an actual File system but a splitted File system  and should be
> > used only for distributed coordination service.
> >
> > My requirement is something like this that I need a global place to store
> > these key values so that all the jobs can access it and even if some job
> > create a new znode then my other jobs can see these changes with the help
> > of watcher.
> >
> > Would you guys recommend using ZooKeeper for above problem statement ?
> >
> > I have also read in one of the mail archive on the limitation of max no
> of
> > znodes , if this limitation still exists then may be this solution won't
> > work in my case.
> >
> >
> >
> http://zookeeper-user.578899.n2.nabble.com/Question-regarding-the-maximum-number-of-ZNODES-a-zookeeper-td6979604.html
> >
> > Please advise
> >
> > Many Thanks
> > Saurabh
> >
>
>
>
> --
> Ing. Alvaro Gareppe
> agareppe@gmail.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message