hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmytro Molkov (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1044) Ability to automatically move machines from one MR compute cluster to another
Date Fri, 20 Nov 2009 02:48:39 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dmytro Molkov updated MAPREDUCE-1044:
-------------------------------------

    Attachment: DCD.pdf

I am attaching the initial proposal of the way to do this.

I would love to hear your thoughts on this document, I am currently experimenting with the
design described.

> Ability to automatically move machines from one MR compute cluster to another
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1044
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1044
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: dhruba borthakur
>            Assignee: Dmytro Molkov
>         Attachments: DCD.pdf
>
>
> We have multiple map-reduce clusters that provide different service and support levels
for their users. We have seen that utilization of hardware resources are not optimized if
we have a static partition of existing hardware resources into these separate MR clusters.
It would be nice to have a automatic way to move nodes from one MR cluster to another based
on load characteristics and configured policies. This JIRA will discuss some of the ideas
and possible implementations of those ideas.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message