hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ken Nakagama (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-6961) Integration of Virtualization (such as Xen) with Hadoop tools
Date Tue, 28 Feb 2012 12:33:48 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218094#comment-13218094

Ken Nakagama commented on HADOOP-6961:

Has any of this ever been resolved ?
> Integration of Virtualization (such as Xen) with Hadoop tools
> -------------------------------------------------------------
>                 Key: HADOOP-6961
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6961
>             Project: Hadoop Common
>          Issue Type: New Feature
>         Environment: All
>            Reporter: Saikat Kanjilal
>            Priority: Minor
> How does one integrate sandboxing of arbitrary user code in C++ and other languages in
a VM such as Xen with the Hadoop framework? How does this interact with SGE, Torque, Condor?
> As each individual machine has more and more cores/cpus, it makes sense to partition
each machine into multiple virtual machines. That gives us a number of benefits:
> By assigning a virtual machine to a datanode, we effectively isolate the datanode from
the load on the machine caused by other processes, making the datanode more responsive/reliable.
> With multiple virtual machines on each machine, we can lower the granularity of hod scheduling
units, making it possible to schedule multiple tasktrackers on the same machine, improving
the overall utilization of the whole clusters.
> With virtualization, we can easily snapshot a virtual cluster before releasing it, making
it possible to re-activate the same cluster in the future and start to work from the snapshot.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message