hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-582) Block reports should be processed offline
Date Fri, 06 Oct 2006 21:08:19 GMT
Block reports should be processed offline

                 Key: HADOOP-582
                 URL: http://issues.apache.org/jira/browse/HADOOP-582
             Project: Hadoop
          Issue Type: Bug
          Components: dfs
    Affects Versions: 0.7.0
            Reporter: Owen O'Malley
         Assigned To: Sameer Paranjpye

The namenode's handling of block reports should be done from a batch queue instead of while
the rpc call from the client is waiting. I'd propose:

 void blockReport(DataNodeRegistration, Block[]) throws IOException;

instead of passing back obsolete blocks they can be handed back on later heartbeat.

The blockReport calls should just queue the registration and list of blocks and there should
be a thread that processes the block reports when possible. 

The goal is to prevent rpc timeouts and therefore retransmissions of the block lists.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message