Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-dev@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of arinto@gmail.com designates
 209.85.223.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <50970f76.044d420a.5346.225bSMTPIN_ADDED@mx.google.com>
References: 
 <CAHg+FCJigebHMRca3FKr63umHiLnRWJrJFTEgF565T-O9maM_w@mail.gmail.com>
 <AFCB1967-DCBC-4859-A7E1-34A3749120E6@hortonworks.com>
 <CAHg+FCKyp=oMbpDrfdQV-NSc3pM-dOSj0TkR0ayUtYEqb3XFgw@mail.gmail.com>
 <50970f76.044d420a.5346.225bSMTPIN_ADDED@mx.google.com>
From: Arinto Murdopo <arinto@gmail.com>
Date: Thu, 8 Nov 2012 19:38:14 +0100
Message-ID: 
 <CAHg+FC+sF3BYrHM9Rxyn3F95nbHPsh0xHXBc4s5y=RQNxVtPpA@mail.gmail.com>
Subject: Re: CONTAINER_FINISHED event when RMAppAttemptImpl is RECOVERING
To: yarn-dev@hadoop.apache.org, devaraj.k@huawei.com
Content-Type: multipart/alternative; boundary=e89a8f3baff780436a04ce00241b

--e89a8f3baff780436a04ce00241b
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

We're using default scheduler, which is CapacityScheduler according to
YarnConfiguration.java

Arinto Murdopo
European Master in Distributed Computing (EMDC)
Universitat Polit=E8cnica de Catalunya =B7 BarcelonaTech, Barcelona, Spain
KTH Royal Institute of Technology, Stockholm, Sweden
Phone: +46 725 548 759


On Mon, Nov 5, 2012 at 1:58 AM, Devaraj K <devaraj.k@huawei.com> wrote:

> Hi Arinto,
>
>
>      Could you please confirm, what is the scheduler configured here?
>
> Thanks & Regards
>     Devaraj K
>
> -----Original Message-----
> From: Arinto Murdopo [mailto:arinto@gmail.com]
> Sent: Sunday, November 04, 2012 11:46 AM
> To: yarn-dev@hadoop.apache.org
> Subject: Re: CONTAINER_FINISHED event when RMAppAttemptImpl is RECOVERING
>
> Hi Arun,
>
> Thanks for the prompt reply. We need to test it for our school project
> which scheduled to end in early December. So, we still need  to continue.
>
> The YARN-128 discussion (https://issues.apache.org/jira/browse/YARN-128)
> mentions that Devaraj is successfully test the RM resurrection. So in thi=
s
> case, how do test is? Do you kill and resurrect RM at random time?
>
> We are doing the resurrection using these following steps:
>
> 1. Run example MR jobs (such as the Pi computation)
> 2. After the mapping and reducing process started, we kill the RM using
> linux's kill command
> 3. Then, we wait for 3 seconds before we resurrect it.
> 4. We noticed that the mapping process is able to continue, and the job
> stuck when the mapping process reaches 100%. At that time reduce process =
is
> still 0%.
>
> We also modified TestMRJobs.java to use ZKStore, and use
> ResourceManagerWrapper to start and stop the ResourceManager
>
> regards,
>
> Arinto Murdopo
> European Master in Distributed Computing (EMDC)
> Universitat Polit=E8cnica de Catalunya =B7 BarcelonaTech, Barcelona, Spai=
n
> KTH Royal Institute of Technology, Stockholm, Sweden
> Phone: +46 725 548 759
>
>
>
> On Sat, Nov 3, 2012 at 7:04 PM, Arun C Murthy <acm@hortonworks.com> wrote=
:
>
> > Arinto,
> >
> >  Unfortunately, it's too early to try it yet, I'd wait for a little
> longer
> > to for it to stabilize - should be soon.
> >
> >  Thanks for trying it and the feedback though! Much appreciated.
> >
> > Arun
> >
> > On Nov 3, 2012, at 6:55 AM, Arinto Murdopo wrote:
> >
> > > Hi all,
> > >
> > > We have this exception when we tried to resurrect ResourceManager usi=
ng
> > > ZKStore. We are using Hadoop version 2.0.2 Alpha RC2, with patch from
> > > #YARN-128 issue (https://issues.apache.org/jira/browse/YARN-128).
> > >
> > > org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid
> > event:
> > > CONTAINER_FINISHED at RECOVERING
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachin=
eFa
> ctory.java:301)
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineF=
act
> ory.java:43)
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doT=
ran
> sition(StateMachineFactory.java:443)
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptI=
mpl
> .handle(RMAppAttemptImpl.java:510)
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptI=
mpl
> .handle(RMAppAttemptImpl.java:83)
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$Application=
Att
> emptEventDispatcher.handle(ResourceManager.java:442)
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$Application=
Att
> emptEventDispatcher.handle(ResourceManager.java:423)
> > > at
> > >
> >
>
> org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.jav=
a:1
> 26)
> > > at
> > >
> >
> org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:7=
5)
> > > at java.lang.Thread.run(Thread.java:662)
> > >
> > > Inspecting RMAppAttemptImpl, we noticed that the state transition
> doesn't
> > > handle CONTAINER_FINISHED event when it is in the RECOVERING state. S=
o
> in
> > > this case, what is the correct transition to handle CONTAINER_FINISHE=
D
> > > event when we are in RECOVERING state?
> > >
> > > regards,
> > >
> > > Arinto Murdopo
> > > European Master in Distributed Computing (EMDC)
> > > Universitat Polit=E8cnica de Catalunya =B7 BarcelonaTech, Barcelona, =
Spain
> > > KTH Royal Institute of Technology, Stockholm, Sweden
> >
> > --
> > Arun C. Murthy
> > Hortonworks Inc.
> > http://hortonworks.com/
> >
> >
> >
>
>

--e89a8f3baff780436a04ce00241b--