Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 64E6B4CA3 for ; Fri, 1 Jul 2011 17:54:29 +0000 (UTC) Received: (qmail 58924 invoked by uid 500); 1 Jul 2011 17:54:29 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 58829 invoked by uid 500); 1 Jul 2011 17:54:28 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 58813 invoked by uid 99); 1 Jul 2011 17:54:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Jul 2011 17:54:28 +0000 X-ASF-Spam-Status: No, hits=2.8 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ted.dunning@gmail.com designates 209.85.220.170 as permitted sender) Received: from [209.85.220.170] (HELO mail-vx0-f170.google.com) (209.85.220.170) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Jul 2011 17:54:23 +0000 Received: by vxi39 with SMTP id 39so3401404vxi.15 for ; Fri, 01 Jul 2011 10:54:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=MWxKN+411OL7Mb3wbpUEEcS4m/QhxhQNmc1SMqnDAAQ=; b=rBLvNZ+xaDwG8jjm1t25H7cN/STajVUiTmkxnHIpiNzwtKb0V0jWFYzJwaJ/zq/bA2 aUSOSuaMnTOVP3eMk8pkS77CsAZim8nX1z2oQSmR+5R//23q1pb7Pp0Ca7TjzjNd46sW +nOYWapT23pLxJU61/HEyBSpQEBW6xpmkuZQo= Received: by 10.52.92.78 with SMTP id ck14mr1506364vdb.100.1309542842225; Fri, 01 Jul 2011 10:54:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.52.110.68 with HTTP; Fri, 1 Jul 2011 10:53:42 -0700 (PDT) In-Reply-To: References: <1309484848472-6535967.post@n2.nabble.com> From: Ted Dunning Date: Fri, 1 Jul 2011 10:53:42 -0700 Message-ID: Subject: Re: Integrate Zookeeper with hadoop mapreduce To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary=bcaec5016763edd40c04a705b3d8 --bcaec5016763edd40c04a705b3d8 Content-Type: text/plain; charset=UTF-8 You should ask that over on the Zookeeper mailing list. As Andrei said, you can store anything you like in ZK. On Thu, Jun 30, 2011 at 11:53 PM, Paul Rimba wrote: > Where can i store the configs in ZK? I tried storing it in a znode and it > seems that it only keep one line of data. > > On Fri, Jul 1, 2011 at 1:33 PM, Paul Rimba wrote: > > > Hey Mahadev, > > How are you using Zookeeper in MRv2 now? > > > > Could you give me a guide or link to how i should build that tool? I just > > started using Zookeeper recently. > > > > Thanks > > Paul Rimba > > > > > > On Fri, Jul 1, 2011 at 12:47 PM, Mahadev Konar > wrote: > > > >> Hi Paul, > >> We have started using ZooKeeper in MRv2 but not yet for configs. > >> > >> You'll have to build a tool that would download configs from ZK and > >> set up the environment for mapreduce to start. > >> > >> Hope that helps. > >> > >> thanks > >> mahadev > >> > >> > >> On Thu, Jun 30, 2011 at 6:47 PM, trippleface > >> wrote: > >> > Hey there, > >> > > >> > is it possible to use Zookeeper as a configuration manager for hadoop > >> > mapreduce? > >> > > >> > I am planning to start new instances of hadoop mapreduce on cloud and > >> each > >> > instance gets the mapreduce configuration from zookeeper. > >> > > >> > Cheers > >> > > >> > -- > >> > View this message in context: > >> > http://zookeeper-user.578899.n2.nabble.com/Integrate-Zookeeper-with-hadoop-mapreduce-tp6535967p6535967.html > >> > Sent from the zookeeper-user mailing list archive at Nabble.com. > >> > > >> > >> > >> > >> -- > >> thanks > >> mahadev > >> @mahadevkonar > >> > > > > > --bcaec5016763edd40c04a705b3d8--