hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liyin Liang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1583) Improve backup-node sync performance by wrapping RPC parameters
Date Thu, 13 Jan 2011 05:48:46 GMT
Improve backup-node sync performance by wrapping RPC parameters
---------------------------------------------------------------

                 Key: HDFS-1583
                 URL: https://issues.apache.org/jira/browse/HDFS-1583
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: name-node
            Reporter: Liyin Liang


The journal edit records are sent by the active name-node to the backup-node with RPC:
{code:}
  public void journal(NamenodeRegistration registration,
                      int jAction,
                      int length,
                      byte[] records) throws IOException;
{code}
During the name-node throughput benchmark, the size of byte array _records_ is around *8000*.
 Then the serialization and deserialization is time-consuming. I wrote a simple application
to test RPC with byte array parameter. When the size got to 8000, each RPC call need about
6 ms. While name-node sync 8k byte to local disk only need  0.3~0.4ms.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message