zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrei Savu <savu.and...@gmail.com>
Subject Re: Integrate Zookeeper with hadoop mapreduce
Date Fri, 01 Jul 2011 07:12:15 GMT
You can store arbitrary data (bytes) inside a znode (less than 1MB).

If you are planning to use ZooKeeper for configuration management you
should probably take a look at:

https://github.com/twitter/twitcher

Cheers,

-- Andrei Savu / andreisavu.ro

On Fri, Jul 1, 2011 at 9:53 AM, Paul Rimba <paul.rimba@gmail.com> wrote:
> Where can i store the configs in ZK? I tried storing it in a znode and it
> seems that it only keep one line of data.
>
> On Fri, Jul 1, 2011 at 1:33 PM, Paul Rimba <paul.rimba@gmail.com> wrote:
>
>> Hey Mahadev,
>> How are you using Zookeeper in MRv2 now?
>>
>> Could you give me a guide or link to how i should build that tool? I just
>> started using Zookeeper recently.
>>
>> Thanks
>> Paul Rimba
>>
>>
>> On Fri, Jul 1, 2011 at 12:47 PM, Mahadev Konar <mahadev@apache.org> wrote:
>>
>>> Hi Paul,
>>>  We have started using ZooKeeper in MRv2 but not yet for configs.
>>>
>>> You'll have to build a tool that would download configs from ZK and
>>> set up the environment for mapreduce to start.
>>>
>>> Hope that helps.
>>>
>>> thanks
>>> mahadev
>>>
>>>
>>> On Thu, Jun 30, 2011 at 6:47 PM, trippleface <paul.rimba@gmail.com>
>>> wrote:
>>> > Hey there,
>>> >
>>> > is it possible to use Zookeeper as a configuration manager for hadoop
>>> > mapreduce?
>>> >
>>> > I am planning to start new instances of hadoop mapreduce on cloud and
>>> each
>>> > instance gets the mapreduce configuration from zookeeper.
>>> >
>>> > Cheers
>>> >
>>> > --
>>> > View this message in context:
>>> http://zookeeper-user.578899.n2.nabble.com/Integrate-Zookeeper-with-hadoop-mapreduce-tp6535967p6535967.html
>>> > Sent from the zookeeper-user mailing list archive at Nabble.com.
>>> >
>>>
>>>
>>>
>>> --
>>> thanks
>>> mahadev
>>> @mahadevkonar
>>>
>>
>>
>

Mime
View raw message