hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5945) Support running multiple DataNodes/TaskTrackers simultaneously in a single node
Date Wed, 03 Jun 2009 07:14:07 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715842#action_12715842
] 

He Yongqiang commented on HADOOP-5945:
--------------------------------------

>>The big issue is what do you gain by running >1 TT and DN per node, except on testing,
where you want to give the master nodes more of a workload?
Talked with one friend. And he said hdfs is used in the production environment as a catoon
video store. And only one datanode server per node can not fully utilize the node's resources.
>>virtual machines
Good suggestions. One datanode server per vm, i guess it need special care to avoid all replicas
of one file block be put on the same physical machine.
I think letting mutiple tasktrackers running on a same node is not a good desicion due to
the memory problem. But if only the hdfs is used, why not supporting multiple datanodes on
a single node? 
>>DataNodeCluster
Hairong, thanks. I will try it. Agreed with Jakob, we should put it in the documentation.
But it seems DataNodeCluster is only used for test?

> Support running multiple DataNodes/TaskTrackers simultaneously in a single node
> -------------------------------------------------------------------------------
>
>                 Key: HADOOP-5945
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5945
>             Project: Hadoop Core
>          Issue Type: New Feature
>            Reporter: He Yongqiang
>
> We should support multiple datanodes/tasktrackers running at a same node, only if they
do not share same port/local fs dir etc. I think Hadoop can be easily adapted to meet this.
 
> I guess at first and the major step is that we should modify the script to let it support
startting multiple datanode/tasktracker daemons in a same node.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message