hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1044) Ability to automatically move machines from one MR compute cluster to another
Date Mon, 28 Sep 2009 19:03:16 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12760343#action_12760343

Allen Wittenauer commented on MAPREDUCE-1044:

Using Solaris projects, it theoretically possible to limit mem, cpu and network resources
(Solaris IPQoS settings can take a projid).  It looks like Solaris will get real disk quotas
for ZFS in 10u8.  We haven't tried doing this in practice, but it sure looks feasible on paper.

> Ability to automatically move machines from one MR compute cluster to another
> -----------------------------------------------------------------------------
>                 Key: MAPREDUCE-1044
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1044
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: dhruba borthakur
>            Assignee: Dmytro Molkov
> We have multiple map-reduce clusters that provide different service and support levels
for their users. We have seen that utilization of hardware resources are not optimized if
we have a static partition of existing hardware resources into these separate MR clusters.
It would be nice to have a automatic way to move nodes from one MR cluster to another based
on load characteristics and configured policies. This JIRA will discuss some of the ideas
and possible implementations of those ideas.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message