hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johan Oskarson (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-296) Do not assign blocks to a datanode with < x mb free
Date Tue, 13 Jun 2006 10:59:29 GMT
Do not assign blocks to a datanode with < x mb free

         Key: HADOOP-296
         URL: http://issues.apache.org/jira/browse/HADOOP-296
     Project: Hadoop
        Type: New Feature

  Components: dfs  
    Versions: 0.3.2    
    Reporter: Johan Oskarson

We're running a smallish cluster with very different machines, some with only 60 gb harddrives
This creates a problem when inserting files into the dfs, these machines run out of space
quickly and then they cannot run any map reduce operations

A solution would be to not assign any new blocks once the space is below a certain user configurable
This free space could then be used by the map reduce operations instead (if that's on the
same disk)

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message