hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-27) MapRed tries to allocate tasks to nodes that have no available disk space
Date Tue, 27 Jun 2006 18:50:30 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-27?page=comments#action_12418085 ] 

Doug Cutting commented on HADOOP-27:

I think this is a good change to make, but the patch still has a few issues.

I don't think it is sufficient to check if any device has enough room, but rather, one should
check that all devices have enough room.  Local file names are hashed to determine which device
to store a file on.  Unless that algorithm changes (Configuration.getLocalPath()), we should
make sure that all local devices have a minimum amount of space.

Also, the indentation and formatting of the patch is non-standard, using tabs instead of spaces,
and one chunk of the patch fails to apply cleanly.


> MapRed tries to allocate tasks to nodes that have no available disk space
> -------------------------------------------------------------------------
>          Key: HADOOP-27
>          URL: http://issues.apache.org/jira/browse/HADOOP-27
>      Project: Hadoop
>         Type: Bug

>   Components: mapred
>     Reporter: Mike Cafarella
>  Attachments: minspace_mapredtask.patch
>   What it says above.  MapRed TaskTrackers should not offer task service if the local
> space is too constrained.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message