accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <josh.el...@gmail.com>
Subject Re: Installing Accumulo in multinode setup
Date Fri, 07 Oct 2016 17:12:22 GMT
I would verify that you set up ZooKeeper correctly. Make sure that the 
my_id files are created and have the correct contents.

Yamini Joshi wrote:
> I can see that in my local setup in my laptop. But, I can't see it here
> somehow. Idk what exactly is wrong.
>
> Best regards,
> Yamini Joshi
>
> On Fri, Oct 7, 2016 at 11:00 AM, Josh Elser <josh.elser@gmail.com
> <mailto:josh.elser@gmail.com>> wrote:
>
>     It should be generated at /tracers when the Accumulo Tracer is
>     started for the first time because you are using 1.7.2.
>
>     Yamini Joshi wrote:
>
>         I don't understand why the tracer node is not generated at all.
>
>         Best regards,
>         Yamini Joshi
>
>         On Fri, Oct 7, 2016 at 10:19 AM, Yamini Joshi
>         <yamini.1691@gmail.com <mailto:yamini.1691@gmail.com>
>         <mailto:yamini.1691@gmail.com <mailto:yamini.1691@gmail.com>>>
>         wrote:
>
>              So the file structure inside zookeeper(now after formatting
>              zookeepers) is:
>              Accumulo
>
>                * d61d7dd5-0f11-437b-9152-d3f171f9af33
>                    o users
>                    o monitor
>                    o problems
>                    o root_tablet
>                    o gc
>                    o hdfs_reservations
>                    o table_locks
>                    o namespaces
>                    o recovery
>                    o fate
>                    o tservers
>                    o tables
>                    o replication
>                    o next_file
>                    o config
>                    o bulk_failed_copyq
>                    o dead
>                    o masters
>                * instances
>                    o test
>
>              test is the name of my new instance. Yes I reinitialized
>         accumulo
>              using /bin/accumulo init
>
>
>              Best regards,
>              Yamini Joshi
>
>              On Fri, Oct 7, 2016 at 10:12 AM, Michael Wall
>         <mjwall@gmail.com <mailto:mjwall@gmail.com>
>         <mailto:mjwall@gmail.com <mailto:mjwall@gmail.com>>> wrote:
>
>                  Yep, I was running 1.6
>
>                  On Fri, Oct 7, 2016 at 11:08 AM Sean Busbey
>         <busbey@cloudera.com <mailto:busbey@cloudera.com>
>         <mailto:busbey@cloudera.com <mailto:busbey@cloudera.com>>> wrote:
>
>                      tracers used to be under the instance id in 1.6. I can
>                      confirm that in
>                      1.7.2 it is definitely at /tracers. I just ran into
>         this
>                      issue last
>                      week.
>
>                      @Yamini where do you get the Node does not exist error?
>                      Could you
>                      copy/paste the whole stacktrace? When I followed
>         the same
>                      workaround
>                      Josh mentioned, restarting the Trace servers was
>         sufficient
>                      to have
>                      the znode recreated.
>
>                      On Fri, Oct 7, 2016 at 10:01 AM, Josh Elser
>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>> wrote:
>         >  I had pulled up 1.7.2 and I thought /tracers was at the
>                      root of ZooKeeper
>         >  (not within the /accumulo/$instance.id <http://instance.id>
>         <http://instance.id> znode). Maybe I looked at the wrong
>         >  code though?
>         >
>         >  Michael Wall wrote:
>         > >
>         > > Maybe this is already known, so apologies in advance.
>                      But don't you
>         > > need to do
>         > >
>         > > $ $ZOOKEEPER_HOME/bin/zkCli.sh -server
>                      m4:2181,m5:2181,m6:2181
>         > >>
>         > >>  rmr accumulo/WHATEVER-INSTANCE-ID/tracers
>         > >
>         > >
>         > > instead of rmr /tracers
>         > >
>         > > If you don't know the instance id, I you can do the
>                      following in zookeeper
>         > >
>         > > get /accumulo/instances/INSTANCE_NAME
>         > >
>         > >
>         > >
>         > > On Thu, Oct 6, 2016 at 6:26 PM, Josh Elser
>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>
wrote:
>          >>
>          >>     Uh, I am confused now. /tracers/ is the default
>                      parent znode that
>          >>     the Accumulo Tracer process registers itself in. We
>                      can also see
>          >>     this is what was happening with your snippet.
>          >>
>          >>     I don't understand how that would not exist. Have
>                      you properly
>          >>     configured ZooKeeper to act as a quorom? (e.g. if
>                      you zkCli.sh
>          >>     -server to your ZK servers individually, do you see
>                      a consistent
>          >>     view of ZK?)
>          >>
>          >>     You can try to remove the directory in HDFS you
>                      configured Accumulo
>          >>     to use, and re `accumulo init` to get back to an
>                      initial state. I'm
>          >>     not sure how you got into this situation to begin with.
>          >>
>          >>     Yamini Joshi wrote:
>          >>
>          >>         1.7.2
>          >>
>          >>
>          >>         Best regards,
>          >>         Yamini Joshi
>          >>
>          >>         On Thu, Oct 6, 2016 at 4:17 PM, Josh Elser
>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>>
>          >> wrote:
>          >>
>          >>              Hrm, maybe I am looking at a newer version
>                      of Accumulo than
>          >>         what
>          >>              you're using. What version are you on?
>          >>
>          >>              Yamini Joshi wrote:
>          >>
>          >>                  Thank you for replying Josh.
>          >>                  I am getting this error:
>          >>                  Node does not exist: /tracers
>          >>
>          >>                  I did ls and saw accumulo there. Should
>                      I delete that?
>          >>                  When I try to delete accumulo, it gives
>                      me a
>          >>         Authentication is
>          >>                  not valid
>          >>                  error.
>          >>
>          >>                  Best regards,
>          >>                  Yamini Joshi
>          >>
>          >>                  On Thu, Oct 6, 2016 at 2:57 PM, Josh Elser
>          >> <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>
>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>>>
>          >> wrote:
>          >>
>          >>                       Hi Yamini,
>          >>
>          >>                       The /tracers node in ZooKeeper was
>                      likely
>          >> initialized
>          >>                  previously
>          >>                       using an Accumulo configuration
>                      that has a
>          >>         different value for
>          >>                       instance.secret. You can delete
>                      this znode to move
>          >>         forward
>          >>                  if you
>          >>                       have no other Accumulo instance
>                      you intend to run
>          >>         on this
>          >>                  ZK instance.
>          >>
>          >>                       $ $ZOOKEEPER_HOME/bin/zkCli.sh -server
>          >>         m4:2181,m5:2181,m6:2181
>          >> > rmr /tracers
>          >>
>          >>                       You can also set a different value for
>          >>         trace.zookeeper.path in
>          >>                       accumulo-site.xml. After doing
>                      this, you can try
>          >>         running a
>          >>                       start-all.sh again to start the
>                      tracer.
>          >>
>          >>                       You also mentioned that the
>                      Monitor did not start
>          >>         but did not
>          >>                       include an exception for that
>                      service. The error you
>          >>                  included only
>          >>                       shows that the Accumulo
>                      Master/TabletServer did not
>          >>                  correctly start
>          >>                       and assign the system tables
>                      (accumulo.root and
>          >>                  accumulo.metadata).
>          >>
>          >>
>          >>                       Yamini Joshi wrote:
>          >>
>          >>                           Hello all
>          >>
>          >>                           I am trying to configure a
>                      multinode cluster
>          >> with
>          >>                  accumulo. I am
>          >>                           using 3
>          >>                           machines with the config as
>                      follows:
>          >>
>          >>                           M4: Hadoop Master/Acc Slave
>          >>                           M5: Accumulo Master/Monitor/Gc
>          >>                           M6: Slave
>          >>
>          >>                           I have configured zookeeper
>                      ensemble on the
>          >>         cluster
>          >>                  with all the 3
>          >>                           nodes. The Hadoop part seems
>                      to work fine, I
>          >>         can see
>          >>                  the console
>          >>                           and run
>          >>                           MR jobs easily. I can also see
>                      the zookeeper
>          >>         cluster
>          >>                  with M2 as the
>          >>                           leader. My problem is with
>                      accumulo, after
>          >>         accumulo init:
>          >>                           bin/accumulo init
>          >>                              which seems to run without
>                      any error, after
>          >>         I isuue
>          >>                  the command
>          >>                           bin/start-all.sh
>          >>                              the Monitor process can't
>                      start. I am
>          >>         getting this
>          >>                  error in
>          >>                           my tracer log:
>          >>                           [start.Main] ERROR: Thread
>         'tracer' died.
>          >>
>          >>
>                        org.apache.zookeeper.KeeperException$NoAuthException:
>          >>                           KeeperErrorCode =
>          >>                           NoAuth for /tracers/trace-
>          >>                                 at
>          >>
>          >>
>          >>
>          >>
>
>         org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
>          >>                                 at
>          >>
>          >>
>          >>
>          >>
>
>         org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>          >>                                 at
>          >>
>
>         org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
>          >>                                 at
>          >>
>          >>
>          >>
>          >>
>
>         org.apache.accumulo.fate.zookeeper.ZooUtil.putEphemeralSequential(ZooUtil.java:464)
>          >>                                 at
>          >>
>          >>
>          >>
>          >>
>
>         org.apache.accumulo.fate.zookeeper.ZooReaderWriter.putEphemeralSequential(ZooReaderWriter.java:99)
>          >>                                 at
>          >>
>          >>
>          >>
>          >>
>
>         org.apache.accumulo.tracer.TraceServer.registerInZooKeeper(TraceServer.java:304)
>          >>                                 at
>          >>
>          >>
>          >>
>          >>
>
>         org.apache.accumulo.tracer.TraceServer.<init>(TraceServer.java:241)
>          >>                                 at
>          >>
>          >>
>          >> org.apache.accumulo.tracer.Tr
>         <http://org.apache.accumulo.tracer.Tr>
>         <http://org.apache.accumulo.tracer.Tr
>         <http://org.apache.accumulo.tracer.Tr>>aceServer.main(TraceServer.java:346)
>
>          >>                                 at
>          >>
>          >>
>          >>
>          >>
>
>         org.apache.accumulo.tracer.TracerExecutable.execute(TracerExecutable.java:33)
>          >>                                 at
>          >>
>                      org.apache.accumulo.start.Main$1.run(Main.java:120)
>          >>                                 at
>                      java.lang.Thread.run(Thread.java:745)
>          >>
>          >>                           And this in my monitor debug log:
>          >>                           Failed to locate tablet for
>                      table : !0 row :
>          >>         ~err_\100
>          >>
>          >>                           I can see that the accumulo
>                      dir has been
>          >>         created in the
>          >>                  HDFS.
>          >>                           Can anyone
>          >>                           please guide me set this up? I
>                      am attaching my
>          >>         config
>          >>                  files here
>          >>                           (Rest
>          >>                           all the same generated as a
>                      result of
>          >>         bin_config file).
>          >>
>          >>                           Best regards,
>          >>                           Yamini Joshi
>          >>
>          >>
>          >>
>          >>
>          >
>
>
>
>                      --
>                      busbey
>
>
>
>

Mime
View raw message