Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
From: Arun C Murthy <acm@hortonworks.com>
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-15--314032792
Subject: Re: hadoop-1.0.0 and errors with log.index
Date: Tue, 31 Jan 2012 10:03:21 -0800
In-Reply-To: <4F27CEC8.6020907@touk.pl>
To: mapreduce-user@hadoop.apache.org
References: <4F27CEC8.6020907@touk.pl>
Message-Id: <73454F93-051E-4334-AC1F-2F1DC8087C9C@hortonworks.com>


--Apple-Mail-15--314032792
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

Actually, all that is telling you is that the task failed and the =
job-client couldn't display the logs.

Can you check the JT web-ui and see why the task failed ?

If you don't see anything there, you can try see the TaskTracker logs on =
the node on which the task ran.

Arun

On Jan 31, 2012, at 3:21 AM, Marcin Cylke wrote:

> Hi
>=20
> I've upgraded my hadoop cluster to version 1.0.0. The upgrade process
> went relatively smoothly but it rendered the cluster inoperable due to
> errors in jobtrackers operation:
>=20
> # in job output
> Error reading task
> =
outputhttp://hadoop4:50060/tasklog?plaintext=3Dtrue&attemptid=3Dattempt_20=
1201311241_0003_m_000004_2&filter=3Dstdout
>=20
> # in each of the jobtrackers' logs
> WARN org.apache.hadoop.mapred.TaskLog: Failed to retrieve stderr log =
for
> task: attempt_201201311241_0003_r_000000_1
> java.io.FileNotFoundException:
> =
/usr/lib/hadoop-1.0.0/libexec/../logs/userlogs/job_201201311241_0003/attem=
pt_201201311241_0003_r_000000_1/log.index=20
> (No such file or directory)
>         at java.io.FileInputStream.open(Native Method)
>=20
>=20
> These errors seem related to this two problems:
>=20
> =
http://grokbase.com/t/hadoop.apache.org/mapreduce-user/2012/01/error-readi=
ng-task-output-and-log-filenotfoundexceptions/03mjwctewcnxlgp2jkcrhvsgep4e=

>=20
> https://issues.apache.org/jira/browse/MAPREDUCE-2846
>=20
> But I've looked into the source code and the fix from MAPREDUCE-2846 =
is
> there. Perhaps there is some other reason?
>=20
> Regards
> Marcin

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/


--Apple-Mail-15--314032792
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=us-ascii

<html><head></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space; =
">Actually, all that is telling you is that the task failed and the =
job-client couldn't display the logs.<div><br></div><div>Can you check =
the JT web-ui and see why the task failed ?</div><div><br></div><div>If =
you don't see anything there, you can try see the TaskTracker logs on =
the node on which the task =
ran.</div><div><br></div><div>Arun</div><div><br><div><div>On Jan 31, =
2012, at 3:21 AM, Marcin Cylke wrote:</div><br =
class=3D"Apple-interchange-newline"><blockquote =
type=3D"cite"><div>Hi<br><br>I've upgraded my hadoop cluster to version =
1.0.0. The upgrade process<br>went relatively smoothly but it rendered =
the cluster inoperable due to<br>errors in jobtrackers =
operation:<br><br># in job output<br>Error reading task<br><a =
href=3D"outputhttp://hadoop4:50060/tasklog?plaintext=3Dtrue&amp;attemptid=3D=
attempt_201201311241_0003_m_000004_2&amp;filter=3Dstdout">outputhttp://had=
oop4:50060/tasklog?plaintext=3Dtrue&amp;attemptid=3Dattempt_201201311241_0=
003_m_000004_2&amp;filter=3Dstdout</a><br><br># in each of the =
jobtrackers' logs<br>WARN org.apache.hadoop.mapred.TaskLog: Failed to =
retrieve stderr log for<br>task: =
attempt_201201311241_0003_r_000000_1<br>java.io.FileNotFoundException:<br>=
/usr/lib/hadoop-1.0.0/libexec/../logs/userlogs/job_201201311241_0003/attem=
pt_201201311241_0003_r_000000_1/log.index <br>(No such file or =
directory)<br> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at =
java.io.FileInputStream.open(Native Method)<br><br><br>These errors seem =
related to this two =
problems:<br><br>http://grokbase.com/t/hadoop.apache.org/mapreduce-user/20=
12/01/error-reading-task-output-and-log-filenotfoundexceptions/03mjwctewcn=
xlgp2jkcrhvsgep4e<br><br>https://issues.apache.org/jira/browse/MAPREDUCE-2=
846<br><br>But I've looked into the source code and the fix from =
MAPREDUCE-2846 is<br>there. Perhaps there is some other =
reason?<br><br>Regards<br>Marcin<br></div></blockquote></div><br><div>
<span class=3D"Apple-style-span" style=3D"border-collapse: separate; =
color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; =
font-variant: normal; font-weight: normal; letter-spacing: normal; =
line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: =
0px; text-transform: none; white-space: normal; widows: 2; word-spacing: =
0px; -webkit-border-horizontal-spacing: 0px; =
-webkit-border-vertical-spacing: 0px; =
-webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span =
class=3D"Apple-style-span" style=3D"border-collapse: separate; color: =
rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: =
normal; font-weight: normal; letter-spacing: normal; line-height: =
normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; =
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; =
-webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: =
0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div =
style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; =
-webkit-line-break: after-white-space; "><span class=3D"Apple-style-span" =
style=3D"border-collapse: separate; color: rgb(0, 0, 0); font-family: =
Helvetica; font-style: normal; font-variant: normal; font-weight: =
normal; letter-spacing: normal; line-height: normal; orphans: 2; =
text-align: -webkit-auto; text-indent: 0px; text-transform: none; =
white-space: normal; widows: 2; word-spacing: 0px; =
-webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: =
0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div =
style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; =
-webkit-line-break: after-white-space; ">--</div><div style=3D"word-wrap: =
break-word; -webkit-nbsp-mode: space; -webkit-line-break: =
after-white-space; ">Arun C. Murthy</div><div style=3D"word-wrap: =
break-word; -webkit-nbsp-mode: space; -webkit-line-break: =
after-white-space; ">Hortonworks Inc.<br><a =
href=3D"http://hortonworks.com/">http://hortonworks.com/</a><br><br></div>=
</span></div></span></span>
</div>
<br></div></body></html>=

--Apple-Mail-15--314032792--