hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12967) NNBench should support multi-cluster access
Date Sat, 06 Jan 2018 20:37:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16314899#comment-16314899
] 

Konstantin Shvachko commented on HDFS-12967:
--------------------------------------------

Did you try {{TestDFSIO}} instead. Should be the right tool for scale testing.
Also NNBench has {{-baseDir}} option.

> NNBench should support multi-cluster access
> -------------------------------------------
>
>                 Key: HDFS-12967
>                 URL: https://issues.apache.org/jira/browse/HDFS-12967
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: benchmarks
>            Reporter: Chen Zhang
>            Assignee: Chen Zhang
>         Attachments: HDFS-12967-001.patch
>
>
> Sometimes we need to run NNBench for some scaling tests after made some improvements
on NameNode, so we have to deploy a new HDFS cluster and a new Yarn cluster.
> If NNBench support multi-cluster access, we only need to deploy a new HDFS test cluster
and add it to existing YARN cluster, it'll make the scaling test easier.
> Even more, if we want to do some A-B test, we have to run NNBench on different HDFS clusters,
this patch will be helpful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message