Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of jayunit100@gmail.com
 designates 209.85.219.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAHqL09r60_hrcmqxz_6Jibh==YJ2MzuT6P9WmoJ-THpJibg9Hg@mail.gmail.com>
References: 
 <CAHqL09r60_hrcmqxz_6Jibh==YJ2MzuT6P9WmoJ-THpJibg9Hg@mail.gmail.com>
Date: Mon, 16 Dec 2013 09:57:00 -0500
Message-ID: 
 <CAAu13zFG2td+Khey-zn2Ok0cDOwOFJtMid4bNiiT0jD5ZuRt4Q@mail.gmail.com>
Subject: Re: Debug Hadoop Junit Test in Eclipse
From: Jay Vyas <jayunit100@gmail.com>
To: "common-user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=047d7b2e4d522ecb6d04eda80699

--047d7b2e4d522ecb6d04eda80699
Content-Type: text/plain; charset=ISO-8859-1

Excellent question.  its not trivial to debug a distributed app in eclipse,
but it is totally doable using javaagents .   We've written it up here:

http://jayunit100.blogspot.com/2013/07/deep-dive-into-hadoop-with-bigtop-and.html

FYI cc Brad childs (https://github.com/childsb) at red hat has helped me
with the tutorial, he might have some extra advice also (cc'd on this
email), I've written up one way to do this using the bigtop VMs here.


On Mon, Dec 16, 2013 at 8:07 AM, Karim Awara <karim.awara@kaust.edu.sa>wrote:

> Hi,
>
> I want to trace how a file upload (-put) happens in hadoop. So Im junit
> testing TestDFSShell.java. When I try to debug the test, It fails due to
> test timed out exception. I believe this is because I am trying to stop one
> thread while the rest are working. I have changed the breakpoint property
> to suspend VM, but still same problem.
>
>
> How can I trace calls made by datanode/namenode when running
> TestDFSShell.java Junit test through eclipse?
>
> I am using hadoop 2.2.0
>
> --
> Best Regards,
> Karim Ahmed Awara
>
> ------------------------------
> This message and its contents, including attachments are intended solely
> for the original recipient. If you are not the intended recipient or have
> received this message in error, please notify me immediately and delete
> this message from your computer system. Any unauthorized use or
> distribution is prohibited. Please consider the environment before printing
> this email.


-- 
Jay Vyas
http://jayunit100.blogspot.com

--047d7b2e4d522ecb6d04eda80699
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Excellent question.=A0 its not trivial to debug a distribu=
ted app in eclipse, but it is totally doable using javaagents .=A0=A0 We=
9;ve written it up here:<br><br><a href=3D"http://jayunit100.blogspot.com/2=
013/07/deep-dive-into-hadoop-with-bigtop-and.html">http://jayunit100.blogsp=
ot.com/2013/07/deep-dive-into-hadoop-with-bigtop-and.html</a><br>
<br>FYI cc Brad childs (<a href=3D"https://github.com/childsb">https://gith=
ub.com/childsb</a>) at red hat has helped me with the tutorial, he might ha=
ve some extra advice also (cc&#39;d on this email), I&#39;ve written up one=
 way to do this using the bigtop VMs here.<br>
<br><br></div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote"=
>On Mon, Dec 16, 2013 at 8:07 AM, Karim Awara <span dir=3D"ltr">&lt;<a href=
=3D"mailto:karim.awara@kaust.edu.sa" target=3D"_blank">karim.awara@kaust.ed=
u.sa</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div><div>Hi, <br><br></div=
>I want to trace how a file upload (-put) happens in hadoop. So Im junit te=
sting TestDFSShell.java. When I try to debug the test, It fails due to test=
 timed out exception. I believe this is because I am trying to stop one thr=
ead while the rest are working. I have changed the breakpoint property to s=
uspend VM, but still same problem. <br>


<br><br></div><div>How can I trace calls made by datanode/namenode when run=
ning TestDFSShell.java Junit test through eclipse?<br><br></div><div>I am u=
sing hadoop 2.2.0<br></div><div><div><br clear=3D"all"><div><div><div dir=
=3D"ltr">


--<br>Best Regards,<br>Karim Ahmed Awara</div></div>
</div></div></div></div>

<br>
<div><hr></div><font face=3D"Arial" size=3D"1">This message and its content=
s, including attachments are intended solely for the original recipient. If=
 you are not the intended recipient or have received this message in error,=
 please notify me immediately and delete this message from your computer sy=
stem. Any unauthorized use or distribution is prohibited. Please consider t=
he environment before printing this email.</font></blockquote>
</div><br><br clear=3D"all"><br>-- <br>Jay Vyas<br><a href=3D"http://jayuni=
t100.blogspot.com" target=3D"_blank">http://jayunit100.blogspot.com</a>
</div>

--047d7b2e4d522ecb6d04eda80699--