hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Tang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1687) Stress submission policy does not always stress the cluster.
Date Fri, 23 Apr 2010 07:19:50 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hong Tang updated MAPREDUCE-1687:
---------------------------------

    Attachment: mr-1687-yhadoop-20.1xx-20100423.patch

Patch that fine tunes the overload determination heuristics. 

> Stress submission policy does not always stress the cluster.
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-1687
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1687
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>            Reporter: Hong Tang
>         Attachments: mr-1687-yhadoop-20.1xx-20100416.patch, mr-1687-yhadoop-20.1xx-20100423.patch
>
>
> Currently, the rough idea of stress submission policy is to continue submitting jobs
until the pending map tasks reach 2x of the cluster capacity. This proves to be inadequate
and we saw a large job could monopolize the whole cluster.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message