hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gera Shegalov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6209) Implement a heuristic to auto-size Java heap of MRAppMaster container proportional to the job size
Date Fri, 16 Jan 2015 20:33:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gera Shegalov updated MAPREDUCE-6209:
-------------------------------------
    Summary: Implement a heuristic to auto-size Java heap of MRAppMaster container proportional
to the job size  (was: Implement a heuristic to auto-size Java heap of MRAppMaster container)

> Implement a heuristic to auto-size Java heap of MRAppMaster container proportional to
the job size
> --------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6209
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6209
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: applicationmaster
>            Reporter: Gera Shegalov
>
> The size of Java heap required by the AM is linearly proportional to the size of the
MR job (number of mappers/splits and reducers). it would be nice if users did not have to
adjust the AM container size when transitioning from testing job on a small sample to a production
job on a full-scale dataset. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message