hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: Adaptive resource assignment is possible in MRv2?
Date Wed, 10 Aug 2011 05:23:46 GMT

On Aug 9, 2011, at 9:28 PM, Hyunsik Choi wrote:

> Hi guys,
> 
> MRv2 looks very promising for various applications. We have considered
> an application based on Yarn, but this app is required the adaptive
> resource assignment. In other words, this app may need additional
> resources while this app is running. Is it possible?
> 

Absolutely. 

> After I look at some code, especially YARNRunner, ResourceMgrDelegate,
> and ClientRMProtocol. In these classes, an application seems to be
> submitted with necessary resource capacity description. So, it is
> impossible?

Typically, MR applications present resource requirements for maps upfront (after split calculation),
but submit reduce resource requirements later.

So, yes - applications can change their resource requests at any point during their lifecycle.

hth,
Arun


Mime
View raw message