hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2723) MR-279: port MAPREDUCE-2324 to mrv2
Date Fri, 22 Jul 2011 19:50:58 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069695#comment-13069695
] 

Arun C Murthy commented on MAPREDUCE-2723:
------------------------------------------

I think this is the right direction...

The AM should request for disk in addition to memory via ResourceRequest.

In terms of timelines, I think it's a little early to right *now*. I'd rather wait for a .1
release to get this feature in to ensure we spend enough time stabilizing the core of the
RM right now.

Does that make sense? Thanks.

> MR-279: port MAPREDUCE-2324 to mrv2
> -----------------------------------
>
>                 Key: MAPREDUCE-2723
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2723
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>             Fix For: 0.23.0
>
>
> MRV2 currently does not take reduce disk usage into account when trying to schedule a
container.  For feature parity with the original map reduce it should be extended to allow
for disk space requests within containers along with RAM requests.  We then also need to port
MAPREDUCE-2324 to the scheduler to allow it to avoid starvation of containers that might never
get the resources that they need.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message