hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hyunsik Choi <hyunsik.c...@gmail.com>
Subject Re: Adaptive resource assignment is possible in MRv2?
Date Wed, 10 Aug 2011 06:12:51 GMT
Thank you for helpful reply :)

Cheers,
--
Hyunsik Choi


On Wed, Aug 10, 2011 at 2:23 PM, Arun C Murthy <acm@hortonworks.com> wrote:

>
> On Aug 9, 2011, at 9:28 PM, Hyunsik Choi wrote:
>
> > Hi guys,
> >
> > MRv2 looks very promising for various applications. We have considered
> > an application based on Yarn, but this app is required the adaptive
> > resource assignment. In other words, this app may need additional
> > resources while this app is running. Is it possible?
> >
>
> Absolutely.
>
> > After I look at some code, especially YARNRunner, ResourceMgrDelegate,
> > and ClientRMProtocol. In these classes, an application seems to be
> > submitted with necessary resource capacity description. So, it is
> > impossible?
>
> Typically, MR applications present resource requirements for maps upfront
> (after split calculation), but submit reduce resource requirements later.
>
> So, yes - applications can change their resource requests at any point
> during their lifecycle.
>
> hth,
> Arun
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message