Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of anilgupta84@gmail.com
 designates 209.85.213.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOZaVwmKREUB7xuN3x_wiEu2967+Bdru=yeirc5DvV7sSTeLuA@mail.gmail.com>
References: 
 <CAF1+Vs-ZMA-cG5C2SfpPATXwRC5syFWZn2uj98Rx1xtStksXVA@mail.gmail.com>
 <CADCZBhFAc=M9N7c4vNLpVEuGAPMi1B+V1Bs+68W=MOKipi24Cg@mail.gmail.com>
 <CAF1+Vs_3pdXAoZzgTHBp+bZWEf=MdO8QWkmFNL9tE_c87P_tDA@mail.gmail.com>
 <CAOZaVwkozwuufsmhWQ1V1X338oWtxXMxSM3e-urwjL0uQ6sKVg@mail.gmail.com>
 <CAF1+Vs9ND_qJ0CM_UHvxv7+8o+42kqs+8b5ojS_ksLpAZEyhgg@mail.gmail.com>
 <CAOZaVwkB8cP55V7M=S4BdF4p27DQDjYh9g23-kx_FVW9JkNUkA@mail.gmail.com>
 <CAF1+Vs_u9n5pd9p6e6tMVeDJjd2ar1Zj28LTdNVZ=k7hNsO=Rw@mail.gmail.com>
 <CAOZaVwmKREUB7xuN3x_wiEu2967+Bdru=yeirc5DvV7sSTeLuA@mail.gmail.com>
From: anil gupta <anilgupta84@gmail.com>
Date: Tue, 31 Jul 2012 11:26:42 -0700
Message-ID: 
 <CAF1+Vs-yKrrGwSKErztu9Eocmu-4Eb2unp=CkpxtG9NNnoiyMA@mail.gmail.com>
Subject: Re: YARN Pi example job stuck at 0%(No MR tasks are started by
 ResourceManager)
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=14dae9340a8d25db3a04c6245342

--14dae9340a8d25db3a04c6245342
Content-Type: text/plain; charset=ISO-8859-1

Hi Harsh and Others,

I was able to run the job when I login as user "hdfs". However, it fails if
i run it as "root". I was suspecting this as a problem before also and it
came out to be true.

Thanks,
Anil gupta

On Mon, Jul 30, 2012 at 9:21 PM, abhiTowson cal
<abhishek.dodda1@gmail.com>wrote:

> Hi anil,
>
> Was trying several things.I didn't hadoop-env.sh, so i created it.
>
> Regards
> Abhishek
>
> On Mon, Jul 30, 2012 at 11:51 PM, anil gupta <anilgupta84@gmail.com>
> wrote:
> > That's pretty interesting!! From where you figured out that you need to
> add
> > that property? Just trying to understand how adding that property fixed
> the
> > issue.
> >
> > On Mon, Jul 30, 2012 at 8:12 PM, abhiTowson cal
> > <abhishek.dodda1@gmail.com>wrote:
> >
> >> Hi anil,
> >>
> >> Adding property resolved issue for me, and i also made this change
> >>
> >> vim hadoop-env.sh
> >>
> >> export JAVA_HOME=/usr/lib/java-1.6.0/jdk1.6.0_33
> >> if [ "$JAVA_HOME" != "" ]; then
> >>   #echo "run java in $JAVA_HOME"
> >>   JAVA_HOME=$JAVA_HOME
> >> fi
> >>
> >> if [ "$JAVA_HOME" = "" ]; then
> >>   echo "Error: JAVA_HOME is not set."
> >>   exit 1
> >> fi
> >>
> >> JAVA=$JAVA_HOME/bin/java
> >> JAVA_HEAP_MAX=-Xmx1000m
> >>
> >> Regards
> >> Abhishek
> >>
> >>
> >> On Mon, Jul 30, 2012 at 10:47 PM, anil gupta <anilgupta84@gmail.com>
> >> wrote:
> >> > Hi Abhishek,
> >> >
> >> > Did you mean that adding yarn.resourcemanager.resource-tracker.address
> >> > along with yarn.log-aggregation-enable in my configuration will
> resolve
> >> the
> >> > problem in which map-reduce job fails at 0% with the following error:
> In
> >> > the web page of
> >> >
> >>
> http://data-node:8042/node/containerlogs/container_1343687008058_0003_01_000001/rootthe
> >> > page says:
> >> > Failed redirect for container_1343687008058_0003_01_000001  Failed
> while
> >> > trying to construct the redirect url to the log server. Log Server url
> >> may
> >> > not be configured. Unknown container. Container either has not
> started or
> >> > has already completed or doesn't belong to this node at all.
> >> > Please let me know.
> >> >
> >> > Thanks,
> >> > Anil Gupta
> >> >
> >> > On Mon, Jul 30, 2012 at 7:30 PM, abhiTowson cal
> >> > <abhishek.dodda1@gmail.com>wrote:
> >> >
> >> >> hi anil,
> >> >>
> >> >> Adding these help me resolve the issue for me
> >> >> yarn.resourcemanager.resource-tracker.address
> >> >>
> >> >> Regards
> >> >> Abhishek
> >> >>
> >> >> On Mon, Jul 30, 2012 at 7:56 PM, anil gupta <anilgupta84@gmail.com>
> >> wrote:
> >> >> > Hi Rahul,
> >> >> >
> >> >> > Thanks for your response. I can certainly enable the
> >> >> > yarn.log-aggregation-enable to true. But after enabling this what
> >> manual
> >> >> > steps i will have to take to run jobs. Could you please elaborate.
> >> >> >
> >> >> > Thanks,
> >> >> > Anil
> >> >> >
> >> >> > On Mon, Jul 30, 2012 at 4:26 PM, Rahul Jain <rjain7@gmail.com>
> wrote:
> >> >> >
> >> >> >> The inability to look at map-reduce logs for failed logs is due to
> >> >> number
> >> >> >> of open issues in yarn; see my recent comment here:
> >> >> >>
> >> >> >>
> >> >>
> >>
> https://issues.apache.org/jira/browse/MAPREDUCE-4428?focusedCommentId=13412995&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13412995
> >> >> >>
> >> >> >> You can workaround this by enabling log aggregation and manually
> >> copying
> >> >> >> job logs from HDFS log location. Of course that is a painful way
> till
> >> >> the
> >> >> >> yarn log collection and history bugs are resolved in an upcoming
> >> >> release.
> >> >> >>
> >> >> >> -Rahul
> >> >> >>
> >> >> >>
> >> >> >> > 12/07/27 09:38:27 INFO mapred.ResourceMgrDelegate: Submitted
> >> >> application
> >> >> >> > application_1343365114818_0002 to ResourceManager at ihub-an-l1/
> >> >> >> > 172.31.192.151:8040
> >> >> >> > 12/07/27 09:38:27 INFO mapreduce.Job: The url to track the job:
> >> >> >> > http://ihub-an-l1:9999/proxy/application_1343365114818_0002/
> >> >> >> > 12/07/27 09:38:27 INFO mapreduce.Job: Running job:
> >> >> job_1343365114818_0002
> >> >> >> >
> >> >> >> > No Map-Reduce task are started by the cluster. I dont see any
> >> errors
> >> >> >> > anywhere in the application. Please help me in resolving this
> >> problem.
> >> >> >> >
> >> >> >> > Thanks,
> >> >> >> > Anil Gupta
> >> >> >> >
> >> >> >>
> >> >> >
> >> >> >
> >> >> >
> >> >> > --
> >> >> > Thanks & Regards,
> >> >> > Anil Gupta
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Thanks & Regards,
> >> > Anil Gupta
> >>
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
>


-- 
Thanks & Regards,
Anil Gupta

--14dae9340a8d25db3a04c6245342--