hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (Issue Comment Edited) (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (HDFS-1623) High Availability Framework for HDFS NN
Date Thu, 16 Feb 2012 00:57:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209027#comment-13209027
] 

Suresh Srinivas edited comment on HDFS-1623 at 2/16/12 12:55 AM:
-----------------------------------------------------------------

I just ran some benchmark(TestDFSIO) tests on for HA branch and trunk. 

The following is the configuration and initial test results.

h3. Test configuration

# 5 nodes in total: 2 namenodes(non-HA config uses just one) and 3 datanodes.
# The edits log is NFS mounted for both HA and non HA setup
# TestDFSIO is started on one datanode. Resource manager and nodemanager are also on the same
datanode.
 
h3. Using TestDFSIO write/read 10 files with filesize as 1MB
||HA (w/r  mb/sec)||trunk (w/r mb/sec)||
|9.2/26.5|8.8/25.6|
|8.4/26.4|8.3/25.4|

h3. Using TestDFSIO write/read 10 files with filesize as 1000MB
||HA (w/r  mb/sec)||trunk (w/r mb/sec)|
|15.3/206.4|16.5/205.5|
|15.9/209.4|14.2/204.9|
|15.6/207.2|14.9/209.5|
                
      was (Author: brandonli):
    I just ran some benchmark(TestDFSIO) tests on Yahoo cluster for HA branch and trunk. The
following is the configuration and initial test results.

h3. Test configuration

# 5 nodes in total: 2 namenodes(non-HA config uses just one) and 3 datanodes.
# The edits log is NFS mounted for both HA and non HA setup
# TestDFSIO is started on one datanode. Resource manager and nodemanager are also on the same
datanode.
 
h3. Using TestDFSIO write/read 10 files with filesize as 1MB:

||HA (w/r  mb/sec)||trunk (w/r mb/sec)||
|9.2/26.5|8.8/25.6|
|8.4/26.4|8.3/25.4|

h3. Using TestDFSIO write/read 10 files with filesize as 1000MB:

||HA (w/r  mb/sec)||trunk (w/r mb/sec)|
|15.3/206.4|16.5/205.5|
|15.9/209.4|14.2/204.9|
|15.6/207.2|14.9/209.5|
                  
> High Availability Framework for HDFS NN
> ---------------------------------------
>
>                 Key: HDFS-1623
>                 URL: https://issues.apache.org/jira/browse/HDFS-1623
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Sanjay Radia
>            Assignee: Sanjay Radia
>         Attachments: HA-tests.pdf, HDFS-High-Availability.pdf, NameNode HA_v2.pdf, NameNode
HA_v2_1.pdf, Namenode HA Framework.pdf, ha-testplan.pdf, ha-testplan.tex
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message