Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 3C4F7200CAA for ; Fri, 2 Jun 2017 17:00:08 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3B31E160BE6; Fri, 2 Jun 2017 15:00:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CAE89160BDD for ; Fri, 2 Jun 2017 17:00:05 +0200 (CEST) Received: (qmail 83953 invoked by uid 500); 2 Jun 2017 15:00:04 -0000 Mailing-List: contact commits-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list commits@hbase.apache.org Received: (qmail 83701 invoked by uid 99); 2 Jun 2017 15:00:03 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Jun 2017 15:00:03 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 053A6DFF81; Fri, 2 Jun 2017 15:00:03 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: git-site-role@apache.org To: commits@hbase.apache.org Date: Fri, 02 Jun 2017 15:00:05 -0000 Message-Id: In-Reply-To: <286a7c4d3f7c4d88b7ebfc3c326dec94@git.apache.org> References: <286a7c4d3f7c4d88b7ebfc3c326dec94@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [04/32] hbase-site git commit: Published site at 82d554e3783372cc6b05489452c815b57c06f6cd. archived-at: Fri, 02 Jun 2017 15:00:08 -0000 http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableHFileOutputFormat.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableHFileOutputFormat.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableHFileOutputFormat.html new file mode 100644 index 0000000..c776fe3 --- /dev/null +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableHFileOutputFormat.html @@ -0,0 +1,599 @@ + + + + + + +TestMultiTableHFileOutputFormat (Apache HBase 2.0.0-SNAPSHOT Test API) + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+ + +
+ + +
+ + +
+
org.apache.hadoop.hbase.mapreduce
+

Class TestMultiTableHFileOutputFormat

+
+
+
    +
  • java.lang.Object
    • +
  • +
      +
    • org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat
      • +
    +
    • +
+
+
    +
  • +
    +
    +
    public class TestMultiTableHFileOutputFormat
+extends Object
    +
    Test forMultiTableHFileOutputFormat. Sets up and runs a mapreduce job that output directories and + writes hfiles.
    +
    • +
+
+
+ +
+
+
    +
  • + + + + + +
      +
    • + + +

      Method Detail

      + + + +
        +
      • +

        testWritingDataIntoHFiles

        +
        public void testWritingDataIntoHFiles()
+                               throws Exception
        +
        Run small MR job. this MR job will write HFile into + testWritingDataIntoHFiles/tableNames/columnFamilies/
        +
        +
        Throws:
        +
        Exception
        +
        +
        • +
      + + + +
        +
      • +

        testMultiHFilePartitioner

        +
        public void testMultiHFilePartitioner()
+                               throws Exception
        +
        check whether create directory and hfiles as format designed in MultiHFilePartitioner + and also check whether the output file has same related configuration as created table
        +
        +
        Throws:
        +
        Exception
        +
        +
        • +
      + + + +
        +
      • +

        checkFileConfAndSplitKeys

        +
        private boolean checkFileConfAndSplitKeys(org.apache.hadoop.conf.Configuration conf,
+                                          org.apache.hadoop.fs.FileSystem fs,
+                                          org.apache.hadoop.fs.Path testDir,
+                                          byte[][] splitKeys)
+                                   throws IOException
        +
        check the output hfile has same configuration as created test table + and also check whether hfiles get split correctly + only check TABLES[0]
        +
        +
        Throws:
        +
        IOException
        +
        +
        • +
      + + + +
        +
      • +

        checkFileSplit

        +
        private boolean checkFileSplit(byte[][] splitKeys,
+                               List<byte[]> firstKeys,
+                               List<byte[]> lastKeys)
        +
        Check whether the Hfile has been split by region boundaries
        +
        +
        Parameters:
        +
        splitKeys - split keys for that table
        +
        firstKeys - first rowKey for hfiles
        +
        lastKeys - last rowKey for hfiles
        +
        +
        • +
      + + + +
        +
      • +

        checkMROutput

        +
        private boolean checkMROutput(org.apache.hadoop.fs.FileSystem fs,
+                              org.apache.hadoop.fs.Path testDir,
+                              int level)
+                       throws IOException
        +
        MR will output a 3 level directory, tableName->ColumnFamilyName->HFile this method to check the + created directory is correct or not A recursion method, the testDir had better be small size
        +
        +
        Throws:
        +
        IOException
        +
        +
        • +
      + + + + +
      • +
    +
    • +
+
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+ + +
+ + +
+ +

Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableInputFormat.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableInputFormat.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableInputFormat.html index 3b15f39..3961c25 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableInputFormat.html +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/TestMultiTableInputFormat.html @@ -49,7 +49,7 @@ var activeTableTab = "activeTableTab";
    @@ -293,7 +293,7 @@ extends
      http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper.html deleted file mode 100644 index 0d449d7..0000000 --- a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper.html +++ /dev/null @@ -1,125 +0,0 @@ - - - - - - -Uses of Class org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper (Apache HBase 2.0.0-SNAPSHOT Test API) - - - - - - - -
      - - -
      Skip navigation links
      - - - - -
      -
      -
        -
      • Prev
        • -
      • Next
        • -
      - - -
      - -
      - - -
      - -
      -

      Uses of Class
      org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper

      -
      -
      No usage of org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper
      - -
      - - -
      Skip navigation links
      - - - - -
      -
      -
        -
      • Prev
        • -
      • Next
        • -
      - - -
      - -
      - - -
      - -

      Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.

      - - http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Table_KeyValueSortReducer.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Table_KeyValueSortReducer.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Table_KeyValueSortReducer.html deleted file mode 100644 index 2a932d4..0000000 --- a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.Table_KeyValueSortReducer.html +++ /dev/null @@ -1,125 +0,0 @@ - - - - - - -Uses of Class org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat.Table_KeyValueSortReducer (Apache HBase 2.0.0-SNAPSHOT Test API) - - - - - - - -
      - - -
      Skip navigation links
      - - - - -
      -
      -
        -
      • Prev
        • -
      • Next
        • -
      - - -
      - -
      - - -
      - -
      -

      Uses of Class
      org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat.Table_KeyValueSortReducer

      -
      -
      No usage of org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat.Table_KeyValueSortReducer
      - -
      - - -
      Skip navigation links
      - - - - -
      -
      -
        -
      • Prev
        • -
      • Next
        • -
      - - -
      - -
      - - -
      - -

      Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.

      - - http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.html deleted file mode 100644 index 4e96d90..0000000 --- a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiHFileOutputFormat.html +++ /dev/null @@ -1,125 +0,0 @@ - - - - - - -Uses of Class org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat (Apache HBase 2.0.0-SNAPSHOT Test API) - - - - - - - -
      - - -
      Skip navigation links
      - - - - -
      -
      -
        -
      • Prev
        • -
      • Next
        • -
      - - -
      - -
      - - -
      - -
      -

      Uses of Class
      org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat

      -
      -
      No usage of org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat
      - -
      - - -
      Skip navigation links
      - - - - -
      -
      -
        -
      • Prev
        • -
      • Next
        • -
      - - -
      - -
      - - -
      - -

      Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.

      - - http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper.html new file mode 100644 index 0000000..da479b5 --- /dev/null +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper.html @@ -0,0 +1,125 @@ + + + + + + +Uses of Class org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper (Apache HBase 2.0.0-SNAPSHOT Test API) + + + + + + + +
      + + +
      Skip navigation links
      + + + + +
      +
      +
        +
      • Prev
        • +
      • Next
        • +
      + + +
      + +
      + + +
      + +
      +

      Uses of Class
      org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper

      +
      +
      No usage of org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper
      + +
      + + +
      Skip navigation links
      + + + + +
      +
      +
        +
      • Prev
        • +
      • Next
        • +
      + + +
      + +
      + + +
      + +

      Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.

      + + http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer.html new file mode 100644 index 0000000..910f4f3 --- /dev/null +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer.html @@ -0,0 +1,125 @@ + + + + + + +Uses of Class org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer (Apache HBase 2.0.0-SNAPSHOT Test API) + + + + + + + +
      + + +
      Skip navigation links
      + + + + +
      +
      +
        +
      • Prev
        • +
      • Next
        • +
      + + +
      + +
      + + +
      + +
      +

      Uses of Class
      org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer

      +
      +
      No usage of org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer
      + +
      + + +
      Skip navigation links
      + + + + +
      +
      +
        +
      • Prev
        • +
      • Next
        • +
      + + +
      + +
      + + +
      + +

      Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.

      + + http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.html new file mode 100644 index 0000000..e9870a2 --- /dev/null +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/class-use/TestMultiTableHFileOutputFormat.html @@ -0,0 +1,125 @@ + + + + + + +Uses of Class org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat (Apache HBase 2.0.0-SNAPSHOT Test API) + + + + + + + +
      + + +
      Skip navigation links
      + + + + +
      +
      +
        +
      • Prev
        • +
      • Next
        • +
      + + +
      + +
      + + +
      + +
      +

      Uses of Class
      org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat

      +
      +
      No usage of org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat
      + +
      + + +
      Skip navigation links
      + + + + +
      +
      +
        +
      • Prev
        • +
      • Next
        • +
      + + +
      + +
      + + +
      + +

      Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.

      + + http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-frame.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-frame.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-frame.html index fb300e4..252535a 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-frame.html +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-frame.html @@ -61,9 +61,9 @@
    • TestLoadIncrementalHFiles
    • TestLoadIncrementalHFilesSplitRecovery
    • TestMapReduceExamples
      • -
    • TestMultiHFileOutputFormat
      • -
    • TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper
      • -
    • TestMultiHFileOutputFormat.Table_KeyValueSortReducer
      • +
    • TestMultiTableHFileOutputFormat
      • +
    • TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper
      • +
    • TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer
    • TestMultiTableInputFormat
    • TestMultiTableSnapshotInputFormat
    • TestMultiTableSnapshotInputFormatImpl
      • http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html index c5b6a0a..7cbbe1a 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html @@ -339,19 +339,19 @@   -TestMultiHFileOutputFormat +TestMultiTableHFileOutputFormat -
      Test forMultiHFileOutputFormat.
      +
      Test forMultiTableHFileOutputFormat.
      -TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper +TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper
      Simple mapper that makes output.
      -TestMultiHFileOutputFormat.Table_KeyValueSortReducer +TestMultiTableHFileOutputFormat.Table_KeyValueSortReducer
      Simple Reducer that have input , with KeyValues have no order.
      http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-tree.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-tree.html index 9bc3d55..c145114 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/mapreduce/package-tree.html @@ -145,7 +145,7 @@
    • org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2.RandomKVGeneratingMapper
    • org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2.RandomPutGeneratingMapper
      • -
    • org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat.Random_TableKV_GeneratingMapper
      • +
    • org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat.Random_TableKV_GeneratingMapper
    • org.apache.hadoop.hbase.mapreduce.TsvImporterMapper
    • org.apache.hadoop.hbase.mapreduce.TestMapReduceExamples
      • -
    • org.apache.hadoop.hbase.mapreduce.TestMultiHFileOutputFormat
      • +
    • org.apache.hadoop.hbase.mapreduce.TestMultiTableHFileOutputFormat
    • org.apache.hadoop.hbase.mapreduce.TestMultiTableSnapshotInputFormatImpl
    • org.apache.hadoop.hbase.mapreduce.TestMultiTableSnapshotInputFormatImpl.ScanWithEquals
    • org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper
      • http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/package-tree.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/package-tree.html index 5f40799..b5e9cb6 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/package-tree.html @@ -541,15 +541,15 @@ http://git-wip-us.apache.org/repos/asf/hbase-site/blob/7e7efd3e/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html ---------------------------------------------------------------------- diff --git a/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html index d5c6f92..fcf095f 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html @@ -205,9 +205,9 @@