hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Tang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1687) Stress submission policy does not always stress the cluster.
Date Fri, 23 Apr 2010 18:12:50 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hong Tang updated MAPREDUCE-1687:
---------------------------------

    Attachment: mr-1687-yhadoop-20.1xx-20100423-2.patch

Fixed a minor bug in StressReaderThread.run() where the condition of the while loop waiting
for cluster to be underloaded is incorrect.

> Stress submission policy does not always stress the cluster.
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-1687
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1687
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>            Reporter: Hong Tang
>         Attachments: mr-1687-yhadoop-20.1xx-20100416.patch, mr-1687-yhadoop-20.1xx-20100423-2.patch,
mr-1687-yhadoop-20.1xx-20100423.patch
>
>
> Currently, the rough idea of stress submission policy is to continue submitting jobs
until the pending map tasks reach 2x of the cluster capacity. This proves to be inadequate
and we saw a large job could monopolize the whole cluster.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message