hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brandon Li (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1623) High Availability Framework for HDFS NN
Date Thu, 16 Feb 2012 00:51:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209027#comment-13209027
] 

Brandon Li commented on HDFS-1623:
----------------------------------

I just ran some benchmark(TestDFSIO) tests on Yahoo cluster for HA branch and trunk. The following
is the configuration and initial test results.

h3. Test configuration

# 5 nodes in total: 2 namenodes(non-HA config uses just one) and 3 datanodes.
# The edits log is NFS mounted for both HA and non HA setup
# TestDFSIO is started on one datanode. Resource manager and nodemanager are also on the same
datanode.
 
h3. Using TestDFSIO write/read 10 files with filesize as 1MB:

||HA (w/r  mb/sec)||trunk (w/r mb/sec)||
|9.2/26.5|8.8/25.6|
|8.4/26.4|8.3/25.4|

h3. Using TestDFSIO write/read 10 files with filesize as 1000MB:

||HA (w/r  mb/sec)||trunk (w/r mb/sec)|
|15.3/206.4|16.5/205.5|
|15.9/209.4|14.2/204.9|
|15.6/207.2|14.9/209.5|
                
> High Availability Framework for HDFS NN
> ---------------------------------------
>
>                 Key: HDFS-1623
>                 URL: https://issues.apache.org/jira/browse/HDFS-1623
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Sanjay Radia
>            Assignee: Sanjay Radia
>         Attachments: HA-tests.pdf, HDFS-High-Availability.pdf, NameNode HA_v2.pdf, NameNode
HA_v2_1.pdf, Namenode HA Framework.pdf, ha-testplan.pdf, ha-testplan.tex
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message