hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: Multiple resource requests for a given node (or all nodes)?
Date Mon, 12 Dec 2011 21:27:18 GMT
Use priorities to ask for different resource types.

Arun

On Dec 10, 2011, at 12:23 PM, Patrick Wendell wrote:

> If you look at how resource requests are stored now, they use a map
> keyed on the node hostname.
> 
> == AppSchedulingInfo.java ==
> 
>  final Map<Priority, Map<String, ResourceRequest>> requests =
>    new HashMap<Priority, Map<String, ResourceRequest>>();
> 
> ========
> 
> What happens if an application wants to request multiple container
> types on a given node. E.g. say I need 10 2GB containers and 10 1GB
> containers, and I don't care which node they are on (i.e. RMNode.ANY).
> I really want to store 2 resource requests under RMNode.ANY in this
> case... don't I?
> 
> Is the model just that an AM would ask for these in series?
> 
> - Patrick


Mime
View raw message