hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xing Shi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1333) Parallel running tasks on one single node may slow down the performance
Date Wed, 10 Feb 2010 06:04:28 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831884#action_12831884
] 

Xing Shi commented on MAPREDUCE-1333:
-------------------------------------

The purpose of the distribute system is high utility.

If you want to analysis running tasks performance, you can just set one node with one map
and no reduce, Vice-versa.

> Parallel running tasks on one single node may slow down the performance
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1333
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1333
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker, task, tasktracker
>    Affects Versions: 0.20.1
>            Reporter: Zhaoning Zhang
>
> When I analysis running tasks performance, I found that parallel running tasks on one
single node will not be better performance than the serialized ones.
> We can set mapred.tasktracker.{map|reduce}.tasks.maximum = 1 individually, but there
will be parallel map AND reduce tasks.
> And I wonder it's true in the real commercial clusters?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message