hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sameer Paranjpye (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-66) dfs client writes all data for a chunk to /tmp
Date Mon, 06 Mar 2006 23:57:29 GMT
dfs client writes all data for a chunk to /tmp

         Key: HADOOP-66
         URL: http://issues.apache.org/jira/browse/HADOOP-66
     Project: Hadoop
        Type: Bug
  Components: dfs  
    Versions: 0.1    
    Reporter: Sameer Paranjpye
     Fix For: 0.1

The dfs client writes all the data for the current chunk to a file in /tmp, when the chunk
is complete it is shipped out to the Datanodes. This can cause /tmp to fill up fast when a
lot of files are being written. A potentially better scheme is to buffer the written data
in RAM (application code can set the buffer size) and flush it to the Datanodes when the buffer
fills up.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message