Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@locus.apache.org Received: (qmail 41282 invoked from network); 26 Jan 2009 18:54:22 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 26 Jan 2009 18:54:22 -0000 Received: (qmail 14410 invoked by uid 500); 26 Jan 2009 18:54:21 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 14378 invoked by uid 500); 26 Jan 2009 18:54:21 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 14246 invoked by uid 99); 26 Jan 2009 18:54:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Jan 2009 10:54:20 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Jan 2009 18:54:20 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id B5760234C48C for ; Mon, 26 Jan 2009 10:53:59 -0800 (PST) Message-ID: <138499012.1232996039742.JavaMail.jira@brutus> Date: Mon, 26 Jan 2009 10:53:59 -0800 (PST) From: "Nitay Joffe (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-1147) Modify the scripts to use Zookeeper In-Reply-To: <1232445439.1232564879697.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1147?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1266= 7348#action_12667348 ]=20 Nitay Joffe commented on HBASE-1147: ------------------------------------ Please see my comments in 1144. I think our configuration scheme is too com= plicated. https://issues.apache.org/jira/browse/HBASE-1144?focusedCommentId=3D1266712= 5#action_12667125 IRC conversation with Stack about this: Jan 26 10:20:21 =09So, whats this about: Jan 26 10:20:22 =09which is really just ripping code out of ZK's rep= o Jan 26 10:20:32 =09The list of quorum servers specified in

${=
HBASE_HOME}/conf/zoo.cfg

should also be written to

${HBASE_HOM=
E}/conf/zookeepers

. Jan 26 10:20:39 =09"The list of quorum servers specified in

$=
{HBASE_HOME}/conf/zoo.cfg

should also be written to

${HBASE_HO=
ME}/conf/zookeepers

. Jan 26 10:20:43 =09.." Jan 26 10:20:49 =09info in two places? Jan 26 10:20:55 =09three actually Jan 26 10:21:05 =09that's why i wrote in my comment we should fix th= at Jan 26 10:21:07 *=09idefine (i=3Droot@twizzler.dreamhost.com) has joined #h= base Jan 26 10:21:13 =09so zoo.cfg is purely for ZK Jan 26 10:21:16 *=09St^Ack HHHRNHH!!!! wrong answer Jan 26 10:21:29 =09well its a part of 1147 Jan 26 10:21:39 =09i was commenting on it saying we should discuss i= t Jan 26 10:21:49 =09zookeepers is for HBase, its analogous to regions= ervers file Jan 26 10:22:06 *=09St^Ack looking Jan 26 10:22:07 =09and then there's the option in hbase-site.xml Jan 26 10:22:12 =09read my whole comments Jan 26 10:22:34 =09specifically, https://issues.apache.org/jira/brow= se/HBASE-1144?focusedCommentId=3D12667125#action_12667125 Jan 26 10:23:05 =09oh, you are on it already Jan 26 10:23:11 =09sorry missed that Jan 26 10:23:16 =09Hi all, quick question (new to hadoop/hbase). I= f I have a bunch of data in a database, do I need to write that data to dis= k inorder to use hadoop to map/reduce? or can the map function pull from th= e database by offsetting that starting index? Jan 26 10:23:37 =09the starting index* Jan 26 10:23:49 =09so most of that is part of 1147, i wrote the over= view.html to match the current way its done, but i think really we should j= ust have zoo.cfg, and parse everything from there Jan 26 10:26:34 =09nitay: just commented. you were on the ball. i= was looking at the cheerleaders Jan 26 10:27:28 =09idefine: I believe there db hookups if you go lo= oking through hadoop; if not in hadoop itself or in contrib, then look in J= IRAs for a patch Jan 26 10:27:38 =09St^Ack, by populated u mean the whole host:port g= oodness? cause i was just thinking of a true/false flag Jan 26 10:27:57 =09if true, parse clientPort=3D and server.X=3D out = of zoo.cfg and start/stop with Hbase Jan 26 10:28:09 =09if not, still have to parse those, but dont try t= o start/stop Jan 26 10:28:22 =09idefine: my faint knowledge comes of quick perus= e of hadoop mailing list subject lines so don't put to much weight on it Jan 26 10:29:03 =09nitay: how do hbase clients know which remote z= k cluster?=20 Jan 26 10:29:34 =09St^Ack: what if I am using hbase for my databas= e, would it make a difference? Jan 26 10:30:09 =09idefine: in that case, there are existant hookup= s. See under the hbase mapred package=20 Jan 26 10:30:19 *=09St^Ack goes to reread nitay comment Jan 26 10:30:24 =09St^Ack: thanks, will do. Jan 26 10:30:40 =09St^Ack, oh b/c hbase=C2=A0clients have just the H= BaseConfiguration thing in the code u're saying, no zoo.cfg?=20 Jan 26 10:31:37 =09nitay: no, zoo.cfg will be on classpath if its i= n conf dir. Jan 26 10:31:47 =09St^Ack, right ye so im confused Jan 26 10:32:00 =09why u need to ever specify ZK host:port in hbase-= X.xml? Jan 26 10:32:01 =09nitay: so, if a remote cluster, zoo.cfg will con= tain the addresses of the remote zk quorum? Jan 26 10:32:06 =09yes Jan 26 10:32:10 =09ok. Jan 26 10:32:13 =09it has to, that's how zookeeper works Jan 26 10:32:18 =09then boolean as you suggest is way to go. Jan 26 10:32:25 =09zoo.cfg: Jan 26 10:32:25 =09tickTime=3D2000 Jan 26 10:32:25 =09dataDir=3D/var/zookeeper Jan 26 10:32:25 =09clientPort=3D2181 Jan 26 10:32:25 =09initLimit=3D5 Jan 26 10:32:25 =09syncLimit=3D2 Jan 26 10:32:25 =09server.1=3Dzoo1:2888:3888 Jan 26 10:32:25 =09server.2=3Dzoo2:2888:3888 Jan 26 10:32:25 =09server.3=3Dzoo3:2888:3888 Jan 26 10:32:49 =09so if u dont have any server.X lines its a local = instance Jan 26 10:33:01 =09I didn't realize that clients would read zoo.con= f to get to remote quorum also. Jan 26 10:33:34 =09right i didnt think about that at first too, but = then i realized ll the info we need is in ZK's zoo.conf, untouched by us, j= ust in different forms Jan 26 10:33:46 =09i also think its important we never add stuff to = zoo.cfg, keep it exactly the same as ZK's Jan 26 10:34:23 =09agreed Jan 26 10:34:28 =09updated my comment in issue > Modify the scripts to use Zookeeper > ----------------------------------- > > Key: HBASE-1147 > URL: https://issues.apache.org/jira/browse/HBASE-1147 > Project: Hadoop HBase > Issue Type: Sub-task > Reporter: Jean-Daniel Cryans > Assignee: Jean-Daniel Cryans > Attachments: hbase-1147.patch > > --=20 This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.