Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: <4FF33234.9090703@bnl.gov>
References: <4FF33234.9090703@bnl.gov>
Date: Tue, 3 Jul 2012 13:22:43 -0700
Message-ID: 
 <CAKg1z2OsbnotS5=6qmBd0vnLFh9td2wNU798QiUH-RrAm9WAAg@mail.gmail.com>
Subject: Re: 'Cannot roll edit log'
From: Brandon Li <brandon@hortonworks.com>
To: hdfs-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015174c41c846661c04c3f2adbd

--0015174c41c846661c04c3f2adbd
Content-Type: text/plain; charset=ISO-8859-1

With 1.0.2, only one checkpoint process is executed at a time. When the
namenode gets an overlapping checkpointing request, it checks edit.new in
its storage directories. If all of them have this file, namenode concludes
the previous checkpoint process is not done yet and prints the warning
message you've seen.

Brandon

On Tue, Jul 3, 2012 at 10:56 AM, Terry Healy <thealy@bnl.gov> wrote:

> Running Apache 1.0.2.
>
> The NN log is reporting that it cannot "roll the edit log" from the
> secondary NN. The SecondaryNameNode is running on the system referred to
> as xxx.yyy.254.238 in the log snippet below.
>
> From the NN, I can connect to the Secondary via ssh as the user. Any
> suggestions what have I got wrong here?
>
> thanks,
>
> Terry
>
> INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log
> from xxx.yyy.254.238
> WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Cannot roll
> edit log, edits.new files already exists in all healthy directories:
>   /home/[user]/hdfs/name/current/edits.new
>
> ERROR org.apache.hadoop.security.UserGroupInformation:
> PriviledgedActionException as:[user] cause:java.net.ConnectException:
> Connection refused
> ERROR org.apache.hadoop.security.UserGroupInformation:
> PriviledgedActionException as:[user] cause:java.net.ConnectException:
> Connection refused
>
> WARN org.mortbay.log: /getimage: java.io.IOException: GetImage failed.
> java.net.ConnectException: Connection refused
>         at java.net.PlainSocketImpl.socketConnect(Native Method)
>         at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> ....
>
>
> --
> Terry Healy / thealy@bnl.gov
> Cyber Security Operations
> Brookhaven National Laboratory
> Building 515, Upton N.Y. 11973
>
>

--0015174c41c846661c04c3f2adbd
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

With 1.0.2, only one checkpoint process is executed at a time. When the nam=
enode gets an overlapping checkpointing request, it checks edit.new in its =
storage directories. If all of them have this file, namenode concludes the =
previous checkpoint process is not done yet and prints the warning message =
you&#39;ve seen. <br>
<br>Brandon<br><br><div class=3D"gmail_quote">On Tue, Jul 3, 2012 at 10:56 =
AM, Terry Healy <span dir=3D"ltr">&lt;<a href=3D"mailto:thealy@bnl.gov" tar=
get=3D"_blank">thealy@bnl.gov</a>&gt;</span> wrote:<br><blockquote class=3D=
"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding=
-left:1ex">
Running Apache 1.0.2.<br>
<br>
The NN log is reporting that it cannot &quot;roll the edit log&quot; from t=
he<br>
secondary NN. The SecondaryNameNode is running on the system referred to<br=
>
as xxx.yyy.254.238 in the log snippet below.<br>
<br>
>From the NN, I can connect to the Secondary via ssh as the user. Any<br>
suggestions what have I got wrong here?<br>
<br>
thanks,<br>
<br>
Terry<br>
<br>
INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log<br>
from xxx.yyy.254.238<br>
WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Cannot roll<br>
edit log, edits.new files already exists in all healthy directories:<br>
=A0 /home/[user]/hdfs/name/current/edits.new<br>
<br>
ERROR org.apache.hadoop.security.UserGroupInformation:<br>
PriviledgedActionException as:[user] cause:java.net.ConnectException:<br>
Connection refused<br>
ERROR org.apache.hadoop.security.UserGroupInformation:<br>
PriviledgedActionException as:[user] cause:java.net.ConnectException:<br>
Connection refused<br>
<br>
WARN org.mortbay.log: /getimage: java.io.IOException: GetImage failed.<br>
java.net.ConnectException: Connection refused<br>
=A0 =A0 =A0 =A0 at java.net.PlainSocketImpl.socketConnect(Native Method)<br=
>
=A0 =A0 =A0 =A0 at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:=
351)<br>
....<br>
<span class=3D"HOEnZb"><font color=3D"#888888"><br>
<br>
--<br>
Terry Healy / <a href=3D"mailto:thealy@bnl.gov">thealy@bnl.gov</a><br>
Cyber Security Operations<br>
Brookhaven National Laboratory<br>
Building 515, Upton N.Y. 11973<br>
<br>
</font></span></blockquote></div><br>

--0015174c41c846661c04c3f2adbd--