hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nan Zhu <zhunans...@gmail.com>
Subject Re: dynamically resizing Hadoop cluster on AWS?
Date Thu, 24 Oct 2013 03:15:51 GMT
Oh, I’m not running HDFS in the instances, I use S3 to save data

--  
Nan Zhu
School of Computer Science,
McGill University



On Wednesday, October 23, 2013 at 11:11 PM, Nan Zhu wrote:

> Hi, all  
>  
> I’m running a Hadoop cluster on AWS EC2,  
>  
> I would like to dynamically resizing the cluster so as to reduce the cost, is there any
solution to achieve this?  
>  
> E.g. I would like to cut the cluster size with a half, is it safe to just shutdown the
instances (if some tasks are just running on them, can I rely on the speculative execution
to re-run them on other nodes?)
>  
> I cannot use EMR, since I’m running a customized version of Hadoop  
>  
> Best,  
>  
> --  
> Nan Zhu
> School of Computer Science,
> McGill University
>  


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message