hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei-Chiu Chuang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12967) NNBench should support multi-cluster access
Date Tue, 18 Jun 2019 07:12:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866312#comment-16866312
] 

Wei-Chiu Chuang commented on HDFS-12967:
----------------------------------------

{quote}./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/hdfs/NNBench.java:196:
     "Supports cross-cluster access by using full path with schema and cluster. " +: '"Supports
cross-cluster access by using full path with schema and cluster. "' has incorrect indentation
level 6, expected level should be 8. [Indentation]
./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/hdfs/NNBench.java:196:
     "Supports cross-cluster access by using full path with schema and cluster. " +: Line
is longer than 80 characters (found 84). [LineLength]
./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/hdfs/TestNNBench.java:94:
   String[] genArgs = { "-operation", operation, "-baseDir", baseDir,:24: '{' is followed
by whitespace. [NoWhitespaceAfter]
./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/hdfs/TestNNBench.java:95:
       "-startTime", "" + (Time.now() / 1000 + 3) , "-blockSize", "1024"};:52: ',' is preceded
with whitespace. [NoWhitespaceBefore]
./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/hdfs/TestNNBench.java:100:
 private void runNNBench(Configuration conf, String operation) throws Exception {: Line is
longer than 80 characters (found 82). [LineLength]{quote}

> NNBench should support multi-cluster access
> -------------------------------------------
>
>                 Key: HDFS-12967
>                 URL: https://issues.apache.org/jira/browse/HDFS-12967
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: benchmarks
>            Reporter: Chen Zhang
>            Assignee: Chen Zhang
>            Priority: Major
>         Attachments: HDFS-12967-001.patch, HDFS-12967-002.patch, HDFS-12967-003.patch
>
>
> Sometimes we need to run NNBench for some scaling tests after made some improvements
on NameNode, so we have to deploy a new HDFS cluster and a new Yarn cluster.
> If NNBench support multi-cluster access, we only need to deploy a new HDFS test cluster
and add it to existing YARN cluster, it'll make the scaling test easier.
> Even more, if we want to do some A-B test, we have to run NNBench on different HDFS clusters,
this patch will be helpful.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message