hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lianhui Wang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-279) Map-Reduce 2.0
Date Sat, 05 Mar 2011 07:45:46 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002947#comment-13002947

Lianhui Wang commented on MAPREDUCE-279:

i think that the MR2.0 may resolve the thing:
JT doesnot monitor the status of the every job and tasks,because many TT must RPC to the one
JT every few seconds.
and many clients get the job's status through rpc the one JT every few seconds.
so the majority nodes of the cluster connect to the JT discontinuously,that lead to degrade
the performance of the JT.especially the number of cluster increase,example 10K.
like hdfs's Federation Branch´╝î the MR project must create a new branch for the 2.0. 

> Map-Reduce 2.0
> --------------
>                 Key: MAPREDUCE-279
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-279
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker, tasktracker
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.0
> Re-factor MapReduce into a generic resource scheduler and a per-job, user-defined component
that manages the application execution. 

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message