Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of danielkrahn@gmail.com
 designates 209.85.217.179 as permitted sender)
MIME-Version: 1.0
From: Daniel Krahn <danielkrahn@gmail.com>
Date: Fri, 5 Jul 2013 23:25:26 -0300
Message-ID: 
 <CAORg+X1qf-+ujSDvU_WxPySH7SpcxicQPMG0xhYg_msZxAmLnw@mail.gmail.com>
Subject: Debugging Hadoop Environment
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c26a306fc39904e0ce8713

--001a11c26a306fc39904e0ce8713
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I would like to ask a few questions on how to debug Hadoop.
First I'll explain what I'm trying to do.

I'm doing my graduation thesis.
Are group is starting an implementation on a voluntary environment. For
this it is very important to have all the results signed so that we can
guarantee that the information has not been altered by someone in the
middle. But for this we could just cipher the channel, but we need to be
able to verify that the user is giving the correct answer. If he does not,
we have to be able to blame the right node.
So for this, I'm signing the results of each phase. I'm starting by the
intermediate files between the MAP and REDUCE.
But I'm having trouble in debugging the part that implements this. I'm
using YARN. So I was able to debug remotely each node. I also was able to
debug the NodeManager inside Eclipse IDE from source code. But I was not
able to run the WordCount application with the NodeManager being debugged
from source inside Eclipse IDE. I gives me an error that it doesn't find
MRAppMaster. So I went to find it and wasn't able to debug the MRAppMaster,
for it doesn't find the AM_CONTAINER_ID_ENV in the environment.

What could I be doing wrong?

Note: I got the project from GIT and it is version 2.0.4

Sincerely,
Daniel Krahn

--001a11c26a306fc39904e0ce8713
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><span style=3D"font-family:arial,sans-serif;font-size:13px=
">Hi,</span><div style=3D"font-family:arial,sans-serif;font-size:13px"><br>=
</div><div style=3D"font-family:arial,sans-serif;font-size:13px">I would li=
ke to ask a few questions on how to debug Hadoop.</div>

<div style=3D"font-family:arial,sans-serif;font-size:13px">First I&#39;ll e=
xplain what I&#39;m trying to do.</div><div style=3D"font-family:arial,sans=
-serif;font-size:13px"><br></div><div style=3D"font-family:arial,sans-serif=
;font-size:13px">

I&#39;m doing my graduation thesis.=A0</div><div style=3D"font-family:arial=
,sans-serif;font-size:13px">Are group is starting an implementation on a vo=
luntary environment. For this it is very important to have all the results =
signed so that we can guarantee that the information has not been altered b=
y someone in the middle. But for this we could just cipher the channel, but=
 we need to be able to verify that the user is giving the correct answer. I=
f he does not, we have to be able to blame the right node.</div>

<div style=3D"font-family:arial,sans-serif;font-size:13px">So for this, I&#=
39;m signing the results of each phase. I&#39;m starting by the intermediat=
e files between the MAP and REDUCE.</div><div style=3D"font-family:arial,sa=
ns-serif;font-size:13px">

But I&#39;m having trouble in debugging the part that implements this. I=
9;m using YARN. So I was able to debug remotely each node. I also was able =
to debug the NodeManager inside Eclipse IDE from source code. But I was not=
 able to run the WordCount application with the NodeManager being debugged =
from source inside Eclipse IDE. I gives me an error that it doesn&#39;t fin=
d MRAppMaster. So I went to find it and wasn&#39;t able to debug the=A0MRAp=
pMaster, for it doesn&#39;t find the=A0AM_CONTAINER_ID_ENV in the environme=
nt.</div>

<div style=3D"font-family:arial,sans-serif;font-size:13px"><br></div><div s=
tyle=3D"font-family:arial,sans-serif;font-size:13px">What could I be doing =
wrong?</div><div style=3D"font-family:arial,sans-serif;font-size:13px"><br>=
</div>

<div style=3D"font-family:arial,sans-serif;font-size:13px">Note: I got the =
project from GIT and it is version 2.0.4</div><div style=3D"font-family:ari=
al,sans-serif;font-size:13px"><br clear=3D"all"><div><div dir=3D"ltr"><div>=
Sincerely,</div>

Daniel Krahn</div></div></div>
</div>

--001a11c26a306fc39904e0ce8713--