Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@accumulo.apache.org
Received-SPF: pass (athena.apache.org: domain of josh.elser@gmail.com
 designates 209.85.192.46 as permitted sender)
Message-ID: <546CB868.1090301@gmail.com>
Date: Wed, 19 Nov 2014 10:34:00 -0500
From: Josh Elser <josh.elser@gmail.com>
User-Agent: Postbox 3.0.11 (Macintosh/20140602)
MIME-Version: 1.0
To: user@accumulo.apache.org
Subject: Re: Tablet server and tracer could get started since they cannot
 see initialized accumulo instance
References: 
 <CAF+udknSoM=6ay7wTk=-mS2QOkJZWX7=5ZWtKjjfj=SQiB3TEw@mail.gmail.com>
In-Reply-To: 
 <CAF+udknSoM=6ay7wTk=-mS2QOkJZWX7=5ZWtKjjfj=SQiB3TEw@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Hi Salih,

It looks like the Accumulo processes are trying to communicate with the 
local filesystem instead of HDFS. Do you still have the output from 
`accumulo init`?

Also, is it possible to share your accumulo-env.sh, accumulo-site.xml 
and the output from `accumulo classpath`?

Thanks.

Salih Kardan wrote:
> Hello everyone,
>
> Sorry in the previous mail, I forgot to fill out subject line of mail.
> Please ignore previous mail.
>
> Currently I am testing Accumulo 1.6.1 with Hadoop 1.2.1 and Zookeeper
> 3.4.5 with 4 hadoop nodes. I gave a role to each node in hadoop cluster;
> specifically
> assume my hadoop nodes like this: hadoop1, hadoop2, hadoop3 and hadoop4.
>
> The accumulo roles are distributed to hadoop nodes;
> hadoop1 = accumulo master ( single zookeeper instance is also running on
> this node)
> hadoop2 = gc
> hadoop3 = monitor
> hadoop4 = tablet server + tracer
>
> After I initialize accumulo with *"accumulo init"* command, I invoked
> start_all.sh script from master machine. All services except tracer and
> tablet server started working.
> However on tablet server machine I see these logs :
>
> 2014-11-19 11:20:32,327 [zookeeper.ZooUtil] ERROR: unable obtain
> instance id at file:/accumulo/instance_id
> 2014-11-19 11:20:32,328 [tserver.TabletServer] ERROR: Uncaught exception
> in TabletServer.main, exiting
> java.lang.RuntimeException: Accumulo not initialized, there is no
> instance id at file:/accumulo/instance_id
>      at
> org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:62)
>      at
> org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:132)
>      at
> org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:116)
>      at
> org.apache.accumulo.server.conf.ServerConfigurationFactory.<init>(ServerConfigurationFactory.java:113)
>      at
> org.apache.accumulo.server.conf.ServerConfiguration.<init>(ServerConfiguration.java:79)
>      at
> org.apache.accumulo.tserver.TabletServer.main(TabletServer.java:3668)
>      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>      at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>      at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>      at java.lang.reflect.Method.invoke(Method.java:606)
>      at org.apache.accumulo.start.Main$1.run(Main.java:141)
>      at java.lang.Thread.run(Thread.java:745)
>
> And the logs I see in tracer log file:
>
> Thread "tracer" died Accumulo not initialized, there is no instance id
> at file:/accumulo/instance_id
> java.lang.RuntimeException: Accumulo not initialized, there is no
> instance id at file:/accumulo/instance_id
>      at
> org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:62)
>      at
> org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:132)
>      at
> org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:116)
>      at
> org.apache.accumulo.server.conf.ServerConfigurationFactory.<init>(ServerConfigurationFactory.java:113)
>      at
> org.apache.accumulo.server.conf.ServerConfiguration.<init>(ServerConfiguration.java:79)
>      at org.apache.accumulo.tracer.TraceServer.main(TraceServer.java:290)
>      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>      at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>      at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>      at java.lang.reflect.Method.invoke(Method.java:606)
>      at org.apache.accumulo.start.Main$1.run(Main.java:141)
>      at java.lang.Thread.run(Thread.java:745)
>
>
> I checked hdfs and it seems accumulo is initialized. Here is the output
> of *"hadoop dfs -ls /accumulo/instance_id" *command*, *
>
> Found 1 items
> -rw-r--r--   1 root supergroup          0 2014-11-19 11:19
> /accumulo/instance_id/268acc40-e20b-4a35-8d8a-0e46e7859a0d
>
> I googled the problem, some comments stating that the problem may occur
> due to missing hadoop libs in classpath, but I checked classpath of
> with *"accumulo classpath"*  command, it also seems correct, both hadoop
> and zookeeper libs listed in classspath.
>
>
> Then I tried single node accumulo installation, that way all services
> including tablet server seems working.
> What can be the problem when I use multiple nodes? Any help is appreciated.
>
> Thanks
>