Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 7D135200B9A for ; Fri, 7 Oct 2016 19:12:33 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7BF87160AE8; Fri, 7 Oct 2016 17:12:33 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 39B78160AC6 for ; Fri, 7 Oct 2016 19:12:32 +0200 (CEST) Received: (qmail 2022 invoked by uid 500); 7 Oct 2016 17:12:31 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 2012 invoked by uid 99); 7 Oct 2016 17:12:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Oct 2016 17:12:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D6B96180628 for ; Fri, 7 Oct 2016 17:12:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.102 X-Spam-Level: X-Spam-Status: No, score=-0.102 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 7c-Cb2v9WGlu for ; Fri, 7 Oct 2016 17:12:28 +0000 (UTC) Received: from mail-pa0-f47.google.com (mail-pa0-f47.google.com [209.85.220.47]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id A44955FACD for ; Fri, 7 Oct 2016 17:12:27 +0000 (UTC) Received: by mail-pa0-f47.google.com with SMTP id rz1so25137280pab.1 for ; Fri, 07 Oct 2016 10:12:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-transfer-encoding; bh=UKGXNqFkDoeGA1eH4ropYoBukjORqaUJjt8rfDTjqjU=; b=X+pu+mFQzTAD6HWoclq0jS94NU5hhgl9eBlE5/bFVL6doHY18zBpZs3LPSAVwCVS5g SE32fyb/uPkBmkfaXJEKGCH/CMxa6aMnsJ1VotkDzKcq4eVvTFBkHQ6g06BpJkwihMyK CgO6bQA068i3S5PhfNcJAzH9rY1DCdtoauMWMnvZ7npzyL4bZ2CBWtqtcvK/qjmg35W6 nSpwLdYXYRQ6Y6+vC9wiVKaySoKA/SqzeNPcG4BQ0YVrOeYG7P+uDCCLhXeDlJTeiME2 H88MR+iO00CizGDpcnqaoRQzJyTx0WNgxnw7oZdeaJCJOW2vMnWpl94IEeA/+/3xgL+R WaXw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-transfer-encoding; bh=UKGXNqFkDoeGA1eH4ropYoBukjORqaUJjt8rfDTjqjU=; b=bdbYMBMLaWGDEcV4gzDSvNRdksYePmRU/IXO4GChOT9JF2TYuxYg6xxP1rUuQ2N+FY s1hcqt1otp/+MdLwfvuLjLSs4iwR2UZ2SGjarLO7FwUS275Y1NiNTR064LmDIkWp+1Gb bopzQkOrQgcrU3F83kd+Gw4C7tHqN1db8gvcB8mPeI9DbJDGHHuqR7BYkC1QzN408EDS 7BvK0q/Fz9JRszm7qAFAtixTCvBeimVw8Eq5XmRR0NCact5CTx0dXcP+rQyjtQGy7E1L jfNplSLenMDRmy65fFtfURNq2KGNtgf63Lp5K+iGrB6XronDQL4oGM7k8zyRDkCGdvSA JNWQ== X-Gm-Message-State: AA6/9RlcVFUI3tj5fFu3Rsn8riXwihZp0R3Vo+Bn+IYvDtVUzYRtXCsNGc4+D2+2HS2ZbA== X-Received: by 10.66.10.132 with SMTP id i4mr32153534pab.101.1475860346076; Fri, 07 Oct 2016 10:12:26 -0700 (PDT) Received: from hw10447.local (207.155.208.210.ptr.us.xo.net. [207.155.208.210]) by smtp.googlemail.com with ESMTPSA id a197sm6922349pfa.72.2016.10.07.10.12.24 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Fri, 07 Oct 2016 10:12:25 -0700 (PDT) Message-ID: <57F7D776.1050802@gmail.com> Date: Fri, 07 Oct 2016 13:12:22 -0400 From: Josh Elser User-Agent: Postbox 3.0.11 (Macintosh/20140602) MIME-Version: 1.0 To: user@accumulo.apache.org Subject: Re: Installing Accumulo in multinode setup References: <57F6AC8C.2010102@gmail.com> <57F6BF67.1050003@gmail.com> <57F6CF98.4070107@gmail.com> <57F7B8C5.40108@gmail.com> <57F7C686.9070001@gmail.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit archived-at: Fri, 07 Oct 2016 17:12:33 -0000 I would verify that you set up ZooKeeper correctly. Make sure that the my_id files are created and have the correct contents. Yamini Joshi wrote: > I can see that in my local setup in my laptop. But, I can't see it here > somehow. Idk what exactly is wrong. > > Best regards, > Yamini Joshi > > On Fri, Oct 7, 2016 at 11:00 AM, Josh Elser > wrote: > > It should be generated at /tracers when the Accumulo Tracer is > started for the first time because you are using 1.7.2. > > Yamini Joshi wrote: > > I don't understand why the tracer node is not generated at all. > > Best regards, > Yamini Joshi > > On Fri, Oct 7, 2016 at 10:19 AM, Yamini Joshi > > >> > wrote: > > So the file structure inside zookeeper(now after formatting > zookeepers) is: > Accumulo > > * d61d7dd5-0f11-437b-9152-d3f171f9af33 > o users > o monitor > o problems > o root_tablet > o gc > o hdfs_reservations > o table_locks > o namespaces > o recovery > o fate > o tservers > o tables > o replication > o next_file > o config > o bulk_failed_copyq > o dead > o masters > * instances > o test > > test is the name of my new instance. Yes I reinitialized > accumulo > using /bin/accumulo init > > > Best regards, > Yamini Joshi > > On Fri, Oct 7, 2016 at 10:12 AM, Michael Wall > > >> wrote: > > Yep, I was running 1.6 > > On Fri, Oct 7, 2016 at 11:08 AM Sean Busbey > > >> wrote: > > tracers used to be under the instance id in 1.6. I can > confirm that in > 1.7.2 it is definitely at /tracers. I just ran into > this > issue last > week. > > @Yamini where do you get the Node does not exist error? > Could you > copy/paste the whole stacktrace? When I followed > the same > workaround > Josh mentioned, restarting the Trace servers was > sufficient > to have > the znode recreated. > > On Fri, Oct 7, 2016 at 10:01 AM, Josh Elser > > >> wrote: > > I had pulled up 1.7.2 and I thought /tracers was at the > root of ZooKeeper > > (not within the /accumulo/$instance.id > znode). Maybe I looked at the wrong > > code though? > > > > Michael Wall wrote: > > > > > > Maybe this is already known, so apologies in advance. > But don't you > > > need to do > > > > > > $ $ZOOKEEPER_HOME/bin/zkCli.sh -server > m4:2181,m5:2181,m6:2181 > > >> > > >> rmr accumulo/WHATEVER-INSTANCE-ID/tracers > > > > > > > > > instead of rmr /tracers > > > > > > If you don't know the instance id, I you can do the > following in zookeeper > > > > > > get /accumulo/instances/INSTANCE_NAME > > > > > > > > > > > > On Thu, Oct 6, 2016 at 6:26 PM, Josh Elser > > > > >> > >>> wrote: > >> > >> Uh, I am confused now. /tracers/ is the default > parent znode that > >> the Accumulo Tracer process registers itself in. We > can also see > >> this is what was happening with your snippet. > >> > >> I don't understand how that would not exist. Have > you properly > >> configured ZooKeeper to act as a quorom? (e.g. if > you zkCli.sh > >> -server to your ZK servers individually, do you see > a consistent > >> view of ZK?) > >> > >> You can try to remove the directory in HDFS you > configured Accumulo > >> to use, and re `accumulo init` to get back to an > initial state. I'm > >> not sure how you got into this situation to begin with. > >> > >> Yamini Joshi wrote: > >> > >> 1.7.2 > >> > >> > >> Best regards, > >> Yamini Joshi > >> > >> On Thu, Oct 6, 2016 at 4:17 PM, Josh Elser > > > > >> > >> > >> > > > > >>>> > >> wrote: > >> > >> Hrm, maybe I am looking at a newer version > of Accumulo than > >> what > >> you're using. What version are you on? > >> > >> Yamini Joshi wrote: > >> > >> Thank you for replying Josh. > >> I am getting this error: > >> Node does not exist: /tracers > >> > >> I did ls and saw accumulo there. Should > I delete that? > >> When I try to delete accumulo, it gives > me a > >> Authentication is > >> not valid > >> error. > >> > >> Best regards, > >> Yamini Joshi > >> > >> On Thu, Oct 6, 2016 at 2:57 PM, Josh Elser > >> > > > > >> > >> > > > > >>> > >> > > > > >> > >> > > > > >>>>> > >> wrote: > >> > >> Hi Yamini, > >> > >> The /tracers node in ZooKeeper was > likely > >> initialized > >> previously > >> using an Accumulo configuration > that has a > >> different value for > >> instance.secret. You can delete > this znode to move > >> forward > >> if you > >> have no other Accumulo instance > you intend to run > >> on this > >> ZK instance. > >> > >> $ $ZOOKEEPER_HOME/bin/zkCli.sh -server > >> m4:2181,m5:2181,m6:2181 > >> > rmr /tracers > >> > >> You can also set a different value for > >> trace.zookeeper.path in > >> accumulo-site.xml. After doing > this, you can try > >> running a > >> start-all.sh again to start the > tracer. > >> > >> You also mentioned that the > Monitor did not start > >> but did not > >> include an exception for that > service. The error you > >> included only > >> shows that the Accumulo > Master/TabletServer did not > >> correctly start > >> and assign the system tables > (accumulo.root and > >> accumulo.metadata). > >> > >> > >> Yamini Joshi wrote: > >> > >> Hello all > >> > >> I am trying to configure a > multinode cluster > >> with > >> accumulo. I am > >> using 3 > >> machines with the config as > follows: > >> > >> M4: Hadoop Master/Acc Slave > >> M5: Accumulo Master/Monitor/Gc > >> M6: Slave > >> > >> I have configured zookeeper > ensemble on the > >> cluster > >> with all the 3 > >> nodes. The Hadoop part seems > to work fine, I > >> can see > >> the console > >> and run > >> MR jobs easily. I can also see > the zookeeper > >> cluster > >> with M2 as the > >> leader. My problem is with > accumulo, after > >> accumulo init: > >> bin/accumulo init > >> which seems to run without > any error, after > >> I isuue > >> the command > >> bin/start-all.sh > >> the Monitor process can't > start. I am > >> getting this > >> error in > >> my tracer log: > >> [start.Main] ERROR: Thread > 'tracer' died. > >> > >> > org.apache.zookeeper.KeeperException$NoAuthException: > >> KeeperErrorCode = > >> NoAuth for /tracers/trace- > >> at > >> > >> > >> > >> > > org.apache.zookeeper.KeeperException.create(KeeperException.java:113) > >> at > >> > >> > >> > >> > > org.apache.zookeeper.KeeperException.create(KeeperException.java:51) > >> at > >> > > org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) > >> at > >> > >> > >> > >> > > org.apache.accumulo.fate.zookeeper.ZooUtil.putEphemeralSequential(ZooUtil.java:464) > >> at > >> > >> > >> > >> > > org.apache.accumulo.fate.zookeeper.ZooReaderWriter.putEphemeralSequential(ZooReaderWriter.java:99) > >> at > >> > >> > >> > >> > > org.apache.accumulo.tracer.TraceServer.registerInZooKeeper(TraceServer.java:304) > >> at > >> > >> > >> > >> > > org.apache.accumulo.tracer.TraceServer.(TraceServer.java:241) > >> at > >> > >> > >> org.apache.accumulo.tracer.Tr > > >aceServer.main(TraceServer.java:346) > > >> at > >> > >> > >> > >> > > org.apache.accumulo.tracer.TracerExecutable.execute(TracerExecutable.java:33) > >> at > >> > org.apache.accumulo.start.Main$1.run(Main.java:120) > >> at > java.lang.Thread.run(Thread.java:745) > >> > >> And this in my monitor debug log: > >> Failed to locate tablet for > table : !0 row : > >> ~err_\100 > >> > >> I can see that the accumulo > dir has been > >> created in the > >> HDFS. > >> Can anyone > >> please guide me set this up? I > am attaching my > >> config > >> files here > >> (Rest > >> all the same generated as a > result of > >> bin_config file). > >> > >> Best regards, > >> Yamini Joshi > >> > >> > >> > >> > > > > > > -- > busbey > > > >