accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yamini Joshi <yamini.1...@gmail.com>
Subject Re: Installing Accumulo in multinode setup
Date Fri, 07 Oct 2016 15:33:48 GMT
I don't understand why the tracer node is not generated at all.

Best regards,
Yamini Joshi

On Fri, Oct 7, 2016 at 10:19 AM, Yamini Joshi <yamini.1691@gmail.com> wrote:

> So the file structure inside zookeeper(now after formatting zookeepers) is:
> Accumulo
>
>    - d61d7dd5-0f11-437b-9152-d3f171f9af33
>       - users
>       - monitor
>       - problems
>       - root_tablet
>       - gc
>       - hdfs_reservations
>       - table_locks
>       - namespaces
>       - recovery
>       - fate
>       - tservers
>       - tables
>       - replication
>       - next_file
>       - config
>       - bulk_failed_copyq
>       - dead
>       - masters
>    - instances
>       - test
>
> test is the name of my new instance. Yes I reinitialized accumulo using
> /bin/accumulo init
>
> Best regards,
> Yamini Joshi
>
> On Fri, Oct 7, 2016 at 10:12 AM, Michael Wall <mjwall@gmail.com> wrote:
>
>> Yep, I was running 1.6
>>
>> On Fri, Oct 7, 2016 at 11:08 AM Sean Busbey <busbey@cloudera.com> wrote:
>>
>>> tracers used to be under the instance id in 1.6. I can confirm that in
>>> 1.7.2 it is definitely at /tracers. I just ran into this issue last
>>> week.
>>>
>>> @Yamini where do you get the Node does not exist error? Could you
>>> copy/paste the whole stacktrace? When I followed the same workaround
>>> Josh mentioned, restarting the Trace servers was sufficient to have
>>> the znode recreated.
>>>
>>> On Fri, Oct 7, 2016 at 10:01 AM, Josh Elser <josh.elser@gmail.com>
>>> wrote:
>>> > I had pulled up 1.7.2 and I thought /tracers was at the root of
>>> ZooKeeper
>>> > (not within the /accumulo/$instance.id znode). Maybe I looked at the
>>> wrong
>>> > code though?
>>> >
>>> > Michael Wall wrote:
>>> >>
>>> >> Maybe this is already known, so apologies in advance.  But don't you
>>> >> need to do
>>> >>
>>> >> $ $ZOOKEEPER_HOME/bin/zkCli.sh -server m4:2181,m5:2181,m6:2181
>>> >>>
>>> >>>  rmr accumulo/WHATEVER-INSTANCE-ID/tracers
>>> >>
>>> >>
>>> >> instead of rmr /tracers
>>> >>
>>> >> If you don't know the instance id, I you can do the following in
>>> zookeeper
>>> >>
>>> >> get /accumulo/instances/INSTANCE_NAME
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Oct 6, 2016 at 6:26 PM, Josh Elser <josh.elser@gmail.com
>>> >> <mailto:josh.elser@gmail.com>> wrote:
>>> >>
>>> >>     Uh, I am confused now. /tracers/ is the default parent znode that
>>> >>     the Accumulo Tracer process registers itself in. We can also see
>>> >>     this is what was happening with your snippet.
>>> >>
>>> >>     I don't understand how that would not exist. Have you properly
>>> >>     configured ZooKeeper to act as a quorom? (e.g. if you zkCli.sh
>>> >>     -server to your ZK servers individually, do you see a consistent
>>> >>     view of ZK?)
>>> >>
>>> >>     You can try to remove the directory in HDFS you configured
>>> Accumulo
>>> >>     to use, and re `accumulo init` to get back to an initial state.
>>> I'm
>>> >>     not sure how you got into this situation to begin with.
>>> >>
>>> >>     Yamini Joshi wrote:
>>> >>
>>> >>         1.7.2
>>> >>
>>> >>
>>> >>         Best regards,
>>> >>         Yamini Joshi
>>> >>
>>> >>         On Thu, Oct 6, 2016 at 4:17 PM, Josh Elser <
>>> josh.elser@gmail.com
>>> >>         <mailto:josh.elser@gmail.com>
>>> >>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>>> >> wrote:
>>> >>
>>> >>              Hrm, maybe I am looking at a newer version of Accumulo
>>> than
>>> >>         what
>>> >>              you're using. What version are you on?
>>> >>
>>> >>              Yamini Joshi wrote:
>>> >>
>>> >>                  Thank you for replying Josh.
>>> >>                  I am getting this error:
>>> >>                  Node does not exist: /tracers
>>> >>
>>> >>                  I did ls and saw accumulo there. Should I delete
>>> that?
>>> >>                  When I try to delete accumulo, it gives me a
>>> >>         Authentication is
>>> >>                  not valid
>>> >>                  error.
>>> >>
>>> >>                  Best regards,
>>> >>                  Yamini Joshi
>>> >>
>>> >>                  On Thu, Oct 6, 2016 at 2:57 PM, Josh Elser
>>> >>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>> >>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>> >>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>> >>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>
>>> >> wrote:
>>> >>
>>> >>                       Hi Yamini,
>>> >>
>>> >>                       The /tracers node in ZooKeeper was likely
>>> >> initialized
>>> >>                  previously
>>> >>                       using an Accumulo configuration that has a
>>> >>         different value for
>>> >>                       instance.secret. You can delete this znode to
>>> move
>>> >>         forward
>>> >>                  if you
>>> >>                       have no other Accumulo instance you intend to
>>> run
>>> >>         on this
>>> >>                  ZK instance.
>>> >>
>>> >>                       $ $ZOOKEEPER_HOME/bin/zkCli.sh -server
>>> >>         m4:2181,m5:2181,m6:2181
>>> >>          > rmr /tracers
>>> >>
>>> >>                       You can also set a different value for
>>> >>         trace.zookeeper.path in
>>> >>                       accumulo-site.xml. After doing this, you can try
>>> >>         running a
>>> >>                       start-all.sh again to start the tracer.
>>> >>
>>> >>                       You also mentioned that the Monitor did not
>>> start
>>> >>         but did not
>>> >>                       include an exception for that service. The
>>> error you
>>> >>                  included only
>>> >>                       shows that the Accumulo Master/TabletServer did
>>> not
>>> >>                  correctly start
>>> >>                       and assign the system tables (accumulo.root and
>>> >>                  accumulo.metadata).
>>> >>
>>> >>
>>> >>                       Yamini Joshi wrote:
>>> >>
>>> >>                           Hello all
>>> >>
>>> >>                           I am trying to configure a multinode cluster
>>> >> with
>>> >>                  accumulo. I am
>>> >>                           using 3
>>> >>                           machines with the config as follows:
>>> >>
>>> >>                           M4: Hadoop Master/Acc Slave
>>> >>                           M5: Accumulo Master/Monitor/Gc
>>> >>                           M6: Slave
>>> >>
>>> >>                           I have configured zookeeper ensemble on the
>>> >>         cluster
>>> >>                  with all the 3
>>> >>                           nodes. The Hadoop part seems to work fine,
I
>>> >>         can see
>>> >>                  the console
>>> >>                           and run
>>> >>                           MR jobs easily. I can also see the zookeeper
>>> >>         cluster
>>> >>                  with M2 as the
>>> >>                           leader. My problem is with accumulo, after
>>> >>         accumulo init:
>>> >>                           bin/accumulo init
>>> >>                              which seems to run without any error,
>>> after
>>> >>         I isuue
>>> >>                  the command
>>> >>                           bin/start-all.sh
>>> >>                              the Monitor process can't start. I am
>>> >>         getting this
>>> >>                  error in
>>> >>                           my tracer log:
>>> >>                           [start.Main] ERROR: Thread 'tracer' died.
>>> >>
>>> >>           org.apache.zookeeper.KeeperException$NoAuthException:
>>> >>                           KeeperErrorCode =
>>> >>                           NoAuth for /tracers/trace-
>>> >>                                 at
>>> >>
>>> >>
>>> >>
>>> >> org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
>>> >>                                 at
>>> >>
>>> >>
>>> >>
>>> >> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>>> >>                                 at
>>> >>                  org.apache.zookeeper.ZooKeeper
>>> .create(ZooKeeper.java:783)
>>> >>                                 at
>>> >>
>>> >>
>>> >>
>>> >> org.apache.accumulo.fate.zookeeper.ZooUtil.putEphemeralSeque
>>> ntial(ZooUtil.java:464)
>>> >>                                 at
>>> >>
>>> >>
>>> >>
>>> >> org.apache.accumulo.fate.zookeeper.ZooReaderWriter.putEpheme
>>> ralSequential(ZooReaderWriter.java:99)
>>> >>                                 at
>>> >>
>>> >>
>>> >>
>>> >> org.apache.accumulo.tracer.TraceServer.registerInZooKeeper(T
>>> raceServer.java:304)
>>> >>                                 at
>>> >>
>>> >>
>>> >>
>>> >> org.apache.accumulo.tracer.TraceServer.<init>(TraceServer.java:241)
>>> >>                                 at
>>> >>
>>> >>
>>> >>         org.apache.accumulo.tracer.TraceServer.main(TraceServer.jav
>>> a:346)
>>> >>                                 at
>>> >>
>>> >>
>>> >>
>>> >> org.apache.accumulo.tracer.TracerExecutable.execute(TracerEx
>>> ecutable.java:33)
>>> >>                                 at
>>> >>                  org.apache.accumulo.start.Main$1.run(Main.java:120)
>>> >>                                 at java.lang.Thread.run(Thread.ja
>>> va:745)
>>> >>
>>> >>                           And this in my monitor debug log:
>>> >>                           Failed to locate tablet for table : !0 row
:
>>> >>         ~err_\100
>>> >>
>>> >>                           I can see that the accumulo dir has been
>>> >>         created in the
>>> >>                  HDFS.
>>> >>                           Can anyone
>>> >>                           please guide me set this up? I am attaching
>>> my
>>> >>         config
>>> >>                  files here
>>> >>                           (Rest
>>> >>                           all the same generated as a result of
>>> >>         bin_config file).
>>> >>
>>> >>                           Best regards,
>>> >>                           Yamini Joshi
>>> >>
>>> >>
>>> >>
>>> >>
>>> >
>>>
>>>
>>>
>>> --
>>> busbey
>>>
>>
>

Mime
View raw message