accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christopher <ctubb...@apache.org>
Subject Re: Accumulo not initializing
Date Tue, 19 Apr 2016 17:36:35 GMT
The warning about the ZooKeeper version is probably due to a trailing slash
at the end of your environment variable for ZOOKEEPER_HOME.

The max open files warning is regarding what is being discussed here:
http://askubuntu.com/questions/162229/how-do-i-increase-the-open-files-limit-for-a-non-root-user
(this
is just the first link I found that covered the topic... but there might be
better discussions of system security limits and ulimit elsewhere)

The synconclose warning can be addressed by setting the recommended value
to true in your hadoop configuration (hdfs-site.xml)

As for the initialization problem, it sounds like you're trying to
re-initialize Accumulo in the same location that it was previously
initialized. You only need to do initialization once, but you do need to
make sure that wherever Hadoop and ZooKeeper are storing their data in the
local filesystem, that they aren't in a temporary directory or something
like that.

If you actually do wish to re-initialize Accumulo, you can delete the
previous contents of Hadoop's /accumulo directory first (make sure you want
to do this... existing data will be deleted), using something like `hadoop
fs -rmr /accumulo` (exact command may depend on your version of Hadoop).

On Tue, Apr 19, 2016 at 1:10 PM Amila Wijayarathna <amwijayarathna@gmail.com>
wrote:

> Hi all,
>
> I'm trying to work with RYA in my Ubuntu laptop. And it needs Hadoop,
> Zookeeper and Accumulo servers As prerequisites.
>
> After a shutdown, I need to restart hadoop, zookeeper and accumulo. When I
> do, Hadoop and Zookeeper servers are starting successfully but when I start
> Accumulo I get the following,
>
> WARN : Using Zookeeper
> /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use version 3.3.0 or
> greater to avoid zookeeper deadlock bug.
>
> Starting monitor on localhost
>
> WARN : Max open files on localhost is 1024, recommend 32768
>
> Starting tablet servers .... done
>
> 2016-04-19 17:40:43,303 [fs.VolumeManagerImpl] WARN :
> dfs.datanode.synconclose set to false in hdfs-site.xml: data loss is
> possible on hard system reset or power loss
>
> 2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to talk to
> zookeeper
>
> 2016-04-19 17:40:43,522 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:44,534 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:45,536 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:47,541 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:48,543 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:49,545 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:51,549 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:52,550 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> Starting tablet server on localhost
>
> WARN : Max open files on localhost is 1024, recommend 32768
>
> 2016-04-19 17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:54,552 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:55,554 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:56,555 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:58,558 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:40:59,559 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> 2016-04-19 17:41:00,561 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized
>
> Then I tried to initialize Accumulo and I got following,
>
> 2016-04-19 16:56:06,984 [fs.VolumeManagerImpl] WARN :
> dfs.datanode.synconclose set to false in hdfs-site.xml: data loss is
> possible on hard system reset or power loss
>
> 2016-04-19 16:56:06,985 [init.Initialize] INFO : Hadoop Filesystem is
> hdfs://localhost:9000
>
> 2016-04-19 16:56:06,986 [init.Initialize] INFO : Accumulo data dirs are
> [hdfs://localhost:9000/accumulo]
>
> 2016-04-19 16:56:06,986 [init.Initialize] INFO : Zookeeper server is
> localhost:2181
>
> 2016-04-19 16:56:06,986 [init.Initialize] INFO : Checking if Zookeeper is
> available. If this hangs, then you need to make sure zookeeper is running
>
> 2016-04-19 16:56:07,250 [init.Initialize] FATAL: It appears the directories
> [hdfs://localhost:9000/accumulo] were previously initialized.
>
> 2016-04-19 16:56:07,250 [init.Initialize] FATAL: Change the property
> instance.volumes to use different filesystems,
>
> 2016-04-19 16:56:07,250 [init.Initialize] FATAL: or change the property
> instance.dfs.dir to use a different directory.
>
> 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current value of
> instance.dfs.uri is ||
>
> 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current value of
> instance.dfs.dir is |/accumulo|
>
> 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current value of
> instance.volumes is |hdfs://localhost:9000/accumulo|
>
>
> Can anyone point me how to do this correctly?
>
> Thank you!
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message