hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Balaji Narayanan (பாலாஜி நாராயணன்) <li...@balajin.net>
Subject Re: HDFS disk space requirement
Date Fri, 11 Jan 2013 03:08:32 GMT
If the replication factor is   5 you will need at least 5x the space if the
file. So this is not going tobe enough.

On Thursday, January 10, 2013, Panshul Whisper wrote:

> Hello,
>
> I have a hadoop cluster of 5 nodes with a total of available HDFS space
> 130 GB with replication set to 5.
> I have a file of 115 GB, which needs to be copied to the HDFS and
> processed.
> Do I need to have anymore HDFS space for performing all processing without
> running into any problems? or is this space sufficient?
>
> --
> Regards,
> Ouch Whisper
> 010101010101
>


-- 
http://balajin.net/blog
http://flic.kr/balajijegan

Mime
View raw message