accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yamini Joshi <yamini.1...@gmail.com>
Subject Re: Installing Accumulo in multinode setup
Date Mon, 10 Oct 2016 15:03:05 GMT
Thanks everyone for help. It is working now. I had to edit some memory
confs and do a clean install. Also, the /tracers znode is created after the
acccumulo is started (i.e. start-all.sh) and not init.

Best regards,
Yamini Joshi

On Fri, Oct 7, 2016 at 12:12 PM, Josh Elser <josh.elser@gmail.com> wrote:

> I would verify that you set up ZooKeeper correctly. Make sure that the
> my_id files are created and have the correct contents.
>
> Yamini Joshi wrote:
>
>> I can see that in my local setup in my laptop. But, I can't see it here
>> somehow. Idk what exactly is wrong.
>>
>> Best regards,
>> Yamini Joshi
>>
>> On Fri, Oct 7, 2016 at 11:00 AM, Josh Elser <josh.elser@gmail.com
>> <mailto:josh.elser@gmail.com>> wrote:
>>
>>     It should be generated at /tracers when the Accumulo Tracer is
>>     started for the first time because you are using 1.7.2.
>>
>>     Yamini Joshi wrote:
>>
>>         I don't understand why the tracer node is not generated at all.
>>
>>         Best regards,
>>         Yamini Joshi
>>
>>         On Fri, Oct 7, 2016 at 10:19 AM, Yamini Joshi
>>         <yamini.1691@gmail.com <mailto:yamini.1691@gmail.com>
>>         <mailto:yamini.1691@gmail.com <mailto:yamini.1691@gmail.com>>>
>>
>>         wrote:
>>
>>              So the file structure inside zookeeper(now after formatting
>>              zookeepers) is:
>>              Accumulo
>>
>>                * d61d7dd5-0f11-437b-9152-d3f171f9af33
>>                    o users
>>                    o monitor
>>                    o problems
>>                    o root_tablet
>>                    o gc
>>                    o hdfs_reservations
>>                    o table_locks
>>                    o namespaces
>>                    o recovery
>>                    o fate
>>                    o tservers
>>                    o tables
>>                    o replication
>>                    o next_file
>>                    o config
>>                    o bulk_failed_copyq
>>                    o dead
>>                    o masters
>>                * instances
>>                    o test
>>
>>              test is the name of my new instance. Yes I reinitialized
>>         accumulo
>>              using /bin/accumulo init
>>
>>
>>              Best regards,
>>              Yamini Joshi
>>
>>              On Fri, Oct 7, 2016 at 10:12 AM, Michael Wall
>>         <mjwall@gmail.com <mailto:mjwall@gmail.com>
>>         <mailto:mjwall@gmail.com <mailto:mjwall@gmail.com>>> wrote:
>>
>>                  Yep, I was running 1.6
>>
>>                  On Fri, Oct 7, 2016 at 11:08 AM Sean Busbey
>>         <busbey@cloudera.com <mailto:busbey@cloudera.com>
>>         <mailto:busbey@cloudera.com <mailto:busbey@cloudera.com>>>
wrote:
>>
>>                      tracers used to be under the instance id in 1.6. I
>> can
>>                      confirm that in
>>                      1.7.2 it is definitely at /tracers. I just ran into
>>         this
>>                      issue last
>>                      week.
>>
>>                      @Yamini where do you get the Node does not exist
>> error?
>>                      Could you
>>                      copy/paste the whole stacktrace? When I followed
>>         the same
>>                      workaround
>>                      Josh mentioned, restarting the Trace servers was
>>         sufficient
>>                      to have
>>                      the znode recreated.
>>
>>                      On Fri, Oct 7, 2016 at 10:01 AM, Josh Elser
>>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>> wrote:
>>         >  I had pulled up 1.7.2 and I thought /tracers was at the
>>                      root of ZooKeeper
>>         >  (not within the /accumulo/$instance.id <http://instance.id>
>>         <http://instance.id> znode). Maybe I looked at the wrong
>>         >  code though?
>>         >
>>         >  Michael Wall wrote:
>>         > >
>>         > > Maybe this is already known, so apologies in advance.
>>                      But don't you
>>         > > need to do
>>         > >
>>         > > $ $ZOOKEEPER_HOME/bin/zkCli.sh -server
>>                      m4:2181,m5:2181,m6:2181
>>         > >>
>>         > >>  rmr accumulo/WHATEVER-INSTANCE-ID/tracers
>>         > >
>>         > >
>>         > > instead of rmr /tracers
>>         > >
>>         > > If you don't know the instance id, I you can do the
>>                      following in zookeeper
>>         > >
>>         > > get /accumulo/instances/INSTANCE_NAME
>>         > >
>>         > >
>>         > >
>>         > > On Thu, Oct 6, 2016 at 6:26 PM, Josh Elser
>>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>
>> wrote:
>>          >>
>>          >>     Uh, I am confused now. /tracers/ is the default
>>                      parent znode that
>>          >>     the Accumulo Tracer process registers itself in. We
>>                      can also see
>>          >>     this is what was happening with your snippet.
>>          >>
>>          >>     I don't understand how that would not exist. Have
>>                      you properly
>>          >>     configured ZooKeeper to act as a quorom? (e.g. if
>>                      you zkCli.sh
>>          >>     -server to your ZK servers individually, do you see
>>                      a consistent
>>          >>     view of ZK?)
>>          >>
>>          >>     You can try to remove the directory in HDFS you
>>                      configured Accumulo
>>          >>     to use, and re `accumulo init` to get back to an
>>                      initial state. I'm
>>          >>     not sure how you got into this situation to begin with.
>>          >>
>>          >>     Yamini Joshi wrote:
>>          >>
>>          >>         1.7.2
>>          >>
>>          >>
>>          >>         Best regards,
>>          >>         Yamini Joshi
>>          >>
>>          >>         On Thu, Oct 6, 2016 at 4:17 PM, Josh Elser
>>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>>
>>          >> wrote:
>>          >>
>>          >>              Hrm, maybe I am looking at a newer version
>>                      of Accumulo than
>>          >>         what
>>          >>              you're using. What version are you on?
>>          >>
>>          >>              Yamini Joshi wrote:
>>          >>
>>          >>                  Thank you for replying Josh.
>>          >>                  I am getting this error:
>>          >>                  Node does not exist: /tracers
>>          >>
>>          >>                  I did ls and saw accumulo there. Should
>>                      I delete that?
>>          >>                  When I try to delete accumulo, it gives
>>                      me a
>>          >>         Authentication is
>>          >>                  not valid
>>          >>                  error.
>>          >>
>>          >>                  Best regards,
>>          >>                  Yamini Joshi
>>          >>
>>          >>                  On Thu, Oct 6, 2016 at 2:57 PM, Josh Elser
>>          >> <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>
>>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>>          >> <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>>>>
>>
>>          >> wrote:
>>          >>
>>          >>                       Hi Yamini,
>>          >>
>>          >>                       The /tracers node in ZooKeeper was
>>                      likely
>>          >> initialized
>>          >>                  previously
>>          >>                       using an Accumulo configuration
>>                      that has a
>>          >>         different value for
>>          >>                       instance.secret. You can delete
>>                      this znode to move
>>          >>         forward
>>          >>                  if you
>>          >>                       have no other Accumulo instance
>>                      you intend to run
>>          >>         on this
>>          >>                  ZK instance.
>>          >>
>>          >>                       $ $ZOOKEEPER_HOME/bin/zkCli.sh -server
>>          >>         m4:2181,m5:2181,m6:2181
>>          >> > rmr /tracers
>>          >>
>>          >>                       You can also set a different value for
>>          >>         trace.zookeeper.path in
>>          >>                       accumulo-site.xml. After doing
>>                      this, you can try
>>          >>         running a
>>          >>                       start-all.sh again to start the
>>                      tracer.
>>          >>
>>          >>                       You also mentioned that the
>>                      Monitor did not start
>>          >>         but did not
>>          >>                       include an exception for that
>>                      service. The error you
>>          >>                  included only
>>          >>                       shows that the Accumulo
>>                      Master/TabletServer did not
>>          >>                  correctly start
>>          >>                       and assign the system tables
>>                      (accumulo.root and
>>          >>                  accumulo.metadata).
>>          >>
>>          >>
>>          >>                       Yamini Joshi wrote:
>>          >>
>>          >>                           Hello all
>>          >>
>>          >>                           I am trying to configure a
>>                      multinode cluster
>>          >> with
>>          >>                  accumulo. I am
>>          >>                           using 3
>>          >>                           machines with the config as
>>                      follows:
>>          >>
>>          >>                           M4: Hadoop Master/Acc Slave
>>          >>                           M5: Accumulo Master/Monitor/Gc
>>          >>                           M6: Slave
>>          >>
>>          >>                           I have configured zookeeper
>>                      ensemble on the
>>          >>         cluster
>>          >>                  with all the 3
>>          >>                           nodes. The Hadoop part seems
>>                      to work fine, I
>>          >>         can see
>>          >>                  the console
>>          >>                           and run
>>          >>                           MR jobs easily. I can also see
>>                      the zookeeper
>>          >>         cluster
>>          >>                  with M2 as the
>>          >>                           leader. My problem is with
>>                      accumulo, after
>>          >>         accumulo init:
>>          >>                           bin/accumulo init
>>          >>                              which seems to run without
>>                      any error, after
>>          >>         I isuue
>>          >>                  the command
>>          >>                           bin/start-all.sh
>>          >>                              the Monitor process can't
>>                      start. I am
>>          >>         getting this
>>          >>                  error in
>>          >>                           my tracer log:
>>          >>                           [start.Main] ERROR: Thread
>>         'tracer' died.
>>          >>
>>          >>
>>                        org.apache.zookeeper.KeeperEx
>> ception$NoAuthException:
>>          >>                           KeeperErrorCode =
>>          >>                           NoAuth for /tracers/trace-
>>          >>                                 at
>>          >>
>>          >>
>>          >>
>>          >>
>>
>>         org.apache.zookeeper.KeeperException.create(KeeperException.
>> java:113)
>>          >>                                 at
>>          >>
>>          >>
>>          >>
>>          >>
>>
>>         org.apache.zookeeper.KeeperException.create(KeeperException.
>> java:51)
>>          >>                                 at
>>          >>
>>
>>         org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
>>          >>                                 at
>>          >>
>>          >>
>>          >>
>>          >>
>>
>>         org.apache.accumulo.fate.zookeeper.ZooUtil.putEphemeralSeque
>> ntial(ZooUtil.java:464)
>>          >>                                 at
>>          >>
>>          >>
>>          >>
>>          >>
>>
>>         org.apache.accumulo.fate.zookeeper.ZooReaderWriter.putEpheme
>> ralSequential(ZooReaderWriter.java:99)
>>          >>                                 at
>>          >>
>>          >>
>>          >>
>>          >>
>>
>>         org.apache.accumulo.tracer.TraceServer.registerInZooKeeper(T
>> raceServer.java:304)
>>          >>                                 at
>>          >>
>>          >>
>>          >>
>>          >>
>>
>>         org.apache.accumulo.tracer.TraceServer.<init>(TraceServer.
>> java:241)
>>          >>                                 at
>>          >>
>>          >>
>>          >> org.apache.accumulo.tracer.Tr
>>         <http://org.apache.accumulo.tracer.Tr>
>>         <http://org.apache.accumulo.tracer.Tr
>>
>>         <http://org.apache.accumulo.tracer.Tr>>aceServer.main(TraceS
>> erver.java:346)
>>
>>          >>                                 at
>>          >>
>>          >>
>>          >>
>>          >>
>>
>>         org.apache.accumulo.tracer.TracerExecutable.execute(TracerEx
>> ecutable.java:33)
>>          >>                                 at
>>          >>
>>                      org.apache.accumulo.start.Main$1.run(Main.java:120)
>>          >>                                 at
>>                      java.lang.Thread.run(Thread.java:745)
>>          >>
>>          >>                           And this in my monitor debug log:
>>          >>                           Failed to locate tablet for
>>                      table : !0 row :
>>          >>         ~err_\100
>>          >>
>>          >>                           I can see that the accumulo
>>                      dir has been
>>          >>         created in the
>>          >>                  HDFS.
>>          >>                           Can anyone
>>          >>                           please guide me set this up? I
>>                      am attaching my
>>          >>         config
>>          >>                  files here
>>          >>                           (Rest
>>          >>                           all the same generated as a
>>                      result of
>>          >>         bin_config file).
>>          >>
>>          >>                           Best regards,
>>          >>                           Yamini Joshi
>>          >>
>>          >>
>>          >>
>>          >>
>>          >
>>
>>
>>
>>                      --
>>                      busbey
>>
>>
>>
>>
>>

Mime
View raw message