hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: hdfs system crashes when loading files bigger than local space left
Date Wed, 14 Jul 2010 15:23:33 GMT

On Jul 14, 2010, at 4:16 AM, Vitaliy Semochkin wrote:
> Sometimes hadoop allows to load amount of data bigger than local space on the node.
> Sometimes hadoop crashes and I have to reformat hdfs.

a) Have you set a reserved size for hdfs?

b) Are you loading data from the datanode?  

View raw message