hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liyin Liang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1583) Improve backup-node sync performance by wrapping RPC parameters
Date Thu, 13 Jan 2011 05:48:45 GMT
Improve backup-node sync performance by wrapping RPC parameters

                 Key: HDFS-1583
                 URL: https://issues.apache.org/jira/browse/HDFS-1583
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: name-node
            Reporter: Liyin Liang

The journal edit records are sent by the active name-node to the backup-node with RPC:
  public void journal(NamenodeRegistration registration,
                      int jAction,
                      int length,
                      byte[] records) throws IOException;
During the name-node throughput benchmark, the size of byte array _records_ is around *8000*.
 Then the serialization and deserialization is time-consuming. I wrote a simple application
to test RPC with byte array parameter. When the size got to 8000, each RPC call need about
6 ms. While name-node sync 8k byte to local disk only need  0.3~0.4ms.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message