hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1044) Ability to automatically move machines from one MR compute cluster to another
Date Mon, 28 Sep 2009 19:07:16 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12760346#action_12760346

dhruba borthakur commented on MAPREDUCE-1044:

Thanks Allen. We will try Solaris ZFS when the disk quotas become reality. In the meantime,
the only way for us to get real job isolation is to move machines from one cluster to another

> Ability to automatically move machines from one MR compute cluster to another
> -----------------------------------------------------------------------------
>                 Key: MAPREDUCE-1044
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1044
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: dhruba borthakur
>            Assignee: Dmytro Molkov
> We have multiple map-reduce clusters that provide different service and support levels
for their users. We have seen that utilization of hardware resources are not optimized if
we have a static partition of existing hardware resources into these separate MR clusters.
It would be nice to have a automatic way to move nodes from one MR cluster to another based
on load characteristics and configured policies. This JIRA will discuss some of the ideas
and possible implementations of those ideas.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message