Return-Path: X-Original-To: apmail-hbase-commits-archive@www.apache.org Delivered-To: apmail-hbase-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B5E25191E7 for ; Thu, 21 Apr 2016 17:24:53 +0000 (UTC) Received: (qmail 72253 invoked by uid 500); 21 Apr 2016 17:24:52 -0000 Delivered-To: apmail-hbase-commits-archive@hbase.apache.org Received: (qmail 72153 invoked by uid 500); 21 Apr 2016 17:24:52 -0000 Mailing-List: contact commits-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list commits@hbase.apache.org Received: (qmail 71878 invoked by uid 99); 21 Apr 2016 17:24:52 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Apr 2016 17:24:52 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 2D7ACDFC6E; Thu, 21 Apr 2016 17:24:52 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: misty@apache.org To: commits@hbase.apache.org Date: Thu, 21 Apr 2016 17:24:58 -0000 Message-Id: In-Reply-To: <7f3320e536864a77b8d7b616adbffaf0@git.apache.org> References: <7f3320e536864a77b8d7b616adbffaf0@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [08/51] [partial] hbase-site git commit: Published site at 03f3c392a3ae940f26ddef56e6991a07f2c993f7. http://git-wip-us.apache.org/repos/asf/hbase-site/blob/c4be37af/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/DataBlockEncoding.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/DataBlockEncoding.html b/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/DataBlockEncoding.html index 3642429..463f9bf 100644 --- a/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/DataBlockEncoding.html +++ b/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/DataBlockEncoding.html @@ -233,18 +233,18 @@ the order they are declared. HFileBlockEncodingContext +BufferedDataBlockEncoder.newDataBlockEncodingContext(DataBlockEncoding encoding, + byte[] header, + HFileContext meta)  + + +HFileBlockEncodingContext DataBlockEncoder.newDataBlockEncodingContext(DataBlockEncoding encoding, byte[] headerBytes, HFileContext meta)
Creates a encoder specific encoding context
- -HFileBlockEncodingContext -BufferedDataBlockEncoder.newDataBlockEncodingContext(DataBlockEncoding encoding, - byte[] header, - HFileContext meta)  - @@ -307,27 +307,27 @@ the order they are declared. - + - + - + - + - + - + @@ -335,23 +335,23 @@ the order they are declared. - + - + - + - + - +
DataBlockEncodingHFileDataBlockEncoder.getDataBlockEncoding() HFileBlock.getDataBlockEncoding() 
DataBlockEncodingNoOpDataBlockEncoder.getDataBlockEncoding() HFile.Reader.getDataBlockEncoding() 
DataBlockEncodingHFileReaderImpl.getDataBlockEncoding() HFileDataBlockEncoder.getDataBlockEncoding() 
DataBlockEncodingHFile.Reader.getDataBlockEncoding() HFileDataBlockEncoderImpl.getDataBlockEncoding() 
DataBlockEncodingHFileBlock.getDataBlockEncoding() HFileReaderImpl.getDataBlockEncoding() 
DataBlockEncodingHFileDataBlockEncoderImpl.getDataBlockEncoding() NoOpDataBlockEncoder.getDataBlockEncoding() 
DataBlockEncoding
DataBlockEncodingHFileDataBlockEncoder.getEffectiveEncodingInCache(boolean isCompaction) HFile.Reader.getEffectiveEncodingInCache(boolean isCompaction) 
DataBlockEncodingNoOpDataBlockEncoder.getEffectiveEncodingInCache(boolean isCompaction) HFileDataBlockEncoder.getEffectiveEncodingInCache(boolean isCompaction) 
DataBlockEncodingHFileReaderImpl.getEffectiveEncodingInCache(boolean isCompaction) HFileDataBlockEncoderImpl.getEffectiveEncodingInCache(boolean isCompaction) 
DataBlockEncodingHFile.Reader.getEffectiveEncodingInCache(boolean isCompaction) HFileReaderImpl.getEffectiveEncodingInCache(boolean isCompaction) 
DataBlockEncodingHFileDataBlockEncoderImpl.getEffectiveEncodingInCache(boolean isCompaction) NoOpDataBlockEncoder.getEffectiveEncodingInCache(boolean isCompaction) 
@@ -419,27 +419,27 @@ the order they are declared. HFileBlock -HFileReaderImpl.readBlock(long dataBlockOffset, +HFile.CachingBlockReader.readBlock(long offset, long onDiskBlockSize, boolean cacheBlock, boolean pread, boolean isCompaction, boolean updateCacheMetrics, BlockType expectedBlockType, - DataBlockEncoding expectedDataBlockEncoding)  + DataBlockEncoding expectedDataBlockEncoding) +
Read in a file block.
+ HFileBlock -HFile.CachingBlockReader.readBlock(long offset, +HFileReaderImpl.readBlock(long dataBlockOffset, long onDiskBlockSize, boolean cacheBlock, boolean pread, boolean isCompaction, boolean updateCacheMetrics, BlockType expectedBlockType, - DataBlockEncoding expectedDataBlockEncoding) -
Read in a file block.
- + DataBlockEncoding expectedDataBlockEncoding)  HFileBlock http://git-wip-us.apache.org/repos/asf/hbase-site/blob/c4be37af/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockDecodingContext.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockDecodingContext.html b/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockDecodingContext.html index 21194c9..0f71c96 100644 --- a/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockDecodingContext.html +++ b/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockDecodingContext.html @@ -185,15 +185,15 @@ HFileBlockDecodingContext +BufferedDataBlockEncoder.newDataBlockDecodingContext(HFileContext meta)  + + +HFileBlockDecodingContext DataBlockEncoder.newDataBlockDecodingContext(HFileContext meta)
Creates an encoder specific decoding context, which will prepare the data before actual decoding
- -HFileBlockDecodingContext -BufferedDataBlockEncoder.newDataBlockDecodingContext(HFileContext meta)  - @@ -210,38 +210,38 @@ - + - - - + + + + + - - - -
DataBlockEncoder.EncodedSeekerDataBlockEncoder.createSeeker(CellComparator comparator, - HFileBlockDecodingContext decodingCtx) -
Create a HFileBlock seeker which find KeyValues within a block.
-		FastDiffDeltaEncoder.createSeeker(CellComparator comparator, + HFileBlockDecodingContext decodingCtx) 
DataBlockEncoder.EncodedSeekerFastDiffDeltaEncoder.createSeeker(CellComparator comparator, +PrefixKeyDeltaEncoder.createSeeker(CellComparator comparator, HFileBlockDecodingContext decodingCtx) 
DataBlockEncoder.EncodedSeekerPrefixKeyDeltaEncoder.createSeeker(CellComparator comparator, +DiffKeyDeltaEncoder.createSeeker(CellComparator comparator, HFileBlockDecodingContext decodingCtx) 
DataBlockEncoder.EncodedSeekerDiffKeyDeltaEncoder.createSeeker(CellComparator comparator, - HFileBlockDecodingContext decodingCtx) DataBlockEncoder.createSeeker(CellComparator comparator, + HFileBlockDecodingContext decodingCtx) +
Create a HFileBlock seeker which find KeyValues within a block.
+
ByteBufferBufferedDataBlockEncoder.decodeKeyValues(DataInputStream source, + HFileBlockDecodingContext blkDecodingCtx) 
ByteBuffer DataBlockEncoder.decodeKeyValues(DataInputStream source, HFileBlockDecodingContext decodingCtx)
Decode.
ByteBufferBufferedDataBlockEncoder.decodeKeyValues(DataInputStream source, - HFileBlockDecodingContext blkDecodingCtx) 
@@ -313,11 +313,11 @@ - + - +
HFileBlockDecodingContextNoOpDataBlockEncoder.newDataBlockDecodingContext(HFileContext meta) HFileDataBlockEncoderImpl.newDataBlockDecodingContext(HFileContext fileContext) 
HFileBlockDecodingContextHFileDataBlockEncoderImpl.newDataBlockDecodingContext(HFileContext fileContext) NoOpDataBlockEncoder.newDataBlockDecodingContext(HFileContext meta) 
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/c4be37af/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockEncodingContext.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockEncodingContext.html b/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockEncodingContext.html index 820e8fe..c02e778 100644 --- a/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockEncodingContext.html +++ b/devapidocs/org/apache/hadoop/hbase/io/encoding/class-use/HFileBlockEncodingContext.html @@ -181,18 +181,18 @@ HFileBlockEncodingContext +BufferedDataBlockEncoder.newDataBlockEncodingContext(DataBlockEncoding encoding, + byte[] header, + HFileContext meta)  + + +HFileBlockEncodingContext DataBlockEncoder.newDataBlockEncodingContext(DataBlockEncoding encoding, byte[] headerBytes, HFileContext meta)
Creates a encoder specific encoding context
- -HFileBlockEncodingContext -BufferedDataBlockEncoder.newDataBlockEncodingContext(DataBlockEncoding encoding, - byte[] header, - HFileContext meta)  - @@ -204,44 +204,44 @@ - + DataOutputStream out)  - + DataOutputStream out) +
Encodes a KeyValue.
+ + + + + - + - + - + - - - -
intDataBlockEncoder.encode(Cell cell, +BufferedDataBlockEncoder.encode(Cell cell, HFileBlockEncodingContext encodingCtx, - DataOutputStream out) -
Encodes a KeyValue.
-
intBufferedDataBlockEncoder.encode(Cell cell, +DataBlockEncoder.encode(Cell cell, HFileBlockEncodingContext encodingCtx, - DataOutputStream out) 
voidBufferedDataBlockEncoder.endBlockEncoding(HFileBlockEncodingContext encodingCtx, + DataOutputStream out, + byte[] uncompressedBytesWithHeader) 
void DataBlockEncoder.endBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out, byte[] uncompressedBytesWithHeader)
Ends encoding for a block of KeyValues.
voidBufferedDataBlockEncoder.endBlockEncoding(HFileBlockEncodingContext encodingCtx, - DataOutputStream out, - byte[] uncompressedBytesWithHeader) BufferedDataBlockEncoder.startBlockEncoding(HFileBlockEncodingContext blkEncodingCtx, + DataOutputStream out) 
void DataBlockEncoder.startBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out)
Starts encoding for a block of KeyValues.
voidBufferedDataBlockEncoder.startBlockEncoding(HFileBlockEncodingContext blkEncodingCtx, - DataOutputStream out) 
@@ -278,13 +278,13 @@ HFileBlockEncodingContext -NoOpDataBlockEncoder.newDataBlockEncodingContext(byte[] dummyHeader, - HFileContext meta)  +HFileDataBlockEncoderImpl.newDataBlockEncodingContext(byte[] dummyHeader, + HFileContext fileContext)  HFileBlockEncodingContext -HFileDataBlockEncoderImpl.newDataBlockEncodingContext(byte[] dummyHeader, - HFileContext fileContext)  +NoOpDataBlockEncoder.newDataBlockEncodingContext(byte[] dummyHeader, + HFileContext meta)  @@ -305,13 +305,13 @@ int -NoOpDataBlockEncoder.encode(Cell cell, +HFileDataBlockEncoderImpl.encode(Cell cell, HFileBlockEncodingContext encodingCtx, DataOutputStream out)  int -HFileDataBlockEncoderImpl.encode(Cell cell, +NoOpDataBlockEncoder.encode(Cell cell, HFileBlockEncodingContext encodingCtx, DataOutputStream out)  @@ -326,14 +326,14 @@ void -NoOpDataBlockEncoder.endBlockEncoding(HFileBlockEncodingContext encodingCtx, +HFileDataBlockEncoderImpl.endBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out, byte[] uncompressedBytesWithHeader, BlockType blockType)  void -HFileDataBlockEncoderImpl.endBlockEncoding(HFileBlockEncodingContext encodingCtx, +NoOpDataBlockEncoder.endBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out, byte[] uncompressedBytesWithHeader, BlockType blockType)  @@ -347,12 +347,12 @@ void -NoOpDataBlockEncoder.startBlockEncoding(HFileBlockEncodingContext encodingCtx, +HFileDataBlockEncoderImpl.startBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out)  void -HFileDataBlockEncoderImpl.startBlockEncoding(HFileBlockEncodingContext encodingCtx, +NoOpDataBlockEncoder.startBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out)  http://git-wip-us.apache.org/repos/asf/hbase-site/blob/c4be37af/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.CachedBlocksByFile.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.CachedBlocksByFile.html b/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.CachedBlocksByFile.html index dfe0b29..9058068 100644 --- a/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.CachedBlocksByFile.html +++ b/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.CachedBlocksByFile.html @@ -150,7 +150,9 @@ extends private int -max  +max +
How many blocks to look at before we give up.
+ private long @@ -304,7 +306,12 @@ extends

  • max

    -
    private final int max
    +
    private final int max
    +
    How many blocks to look at before we give up. + There could be many millions of blocks. We don't want the + ui to freeze while we run through 1B blocks... users will + think hbase dead. UI displays warning in red when stats + are incomplete.
    • @@ -313,7 +320,7 @@ extends

  • DEFAULT_MAX

    -
    public static final int DEFAULT_MAX
    +
    public static final int DEFAULT_MAX
    See Also:
    Constant Field Values
    • @@ -323,7 +330,7 @@ extends

  • cachedBlockByFile

    -
    private NavigableMap<String,NavigableSet<CachedBlock>> cachedBlockByFile
    +
    private NavigableMap<String,NavigableSet<CachedBlock>> cachedBlockByFile
    Map by filename. use concurent utils because we want our Map and contained blocks sorted.
    • @@ -333,7 +340,7 @@ extends

  • hist

    -
    FastLongHistogram hist
    +
    FastLongHistogram hist
    • @@ -350,7 +357,7 @@ extends

  • BlockCacheUtil.CachedBlocksByFile

    -
    BlockCacheUtil.CachedBlocksByFile()
    +
    BlockCacheUtil.CachedBlocksByFile()
    • @@ -359,7 +366,7 @@ extends

  • BlockCacheUtil.CachedBlocksByFile

    -
    BlockCacheUtil.CachedBlocksByFile(org.apache.hadoop.conf.Configuration c)
    +
    BlockCacheUtil.CachedBlocksByFile(org.apache.hadoop.conf.Configuration c)
    • @@ -376,7 +383,7 @@ extends

  • update

    -
    public boolean update(CachedBlock cb)
    +
    public boolean update(CachedBlock cb)
    Parameters:
    cb -
    Returns:
    True if full.... if we won't be adding any more.
    • @@ -387,7 +394,7 @@ extends

  • isFull

    -
    public boolean isFull()
    +
    public boolean isFull()
    Returns:
    True if full; i.e. there are more items in the cache but we only loaded up the maximum set in configuration hbase.ui.blockcache.by.file.max (Default: DEFAULT_MAX).
    @@ -399,7 +406,7 @@ extends

  • getCachedBlockStatsByFile

    -
    public NavigableMap<String,NavigableSet<CachedBlock>> getCachedBlockStatsByFile()
    +
    public NavigableMap<String,NavigableSet<CachedBlock>> getCachedBlockStatsByFile()
    • @@ -408,7 +415,7 @@ extends

  • getCount

    -
    public int getCount()
    +
    public int getCount()
    Returns:
    count of blocks in the cache
    • @@ -418,7 +425,7 @@ extends

  • getDataCount

    -
    public int getDataCount()
    +
    public int getDataCount()
    • @@ -427,7 +434,7 @@ extends

  • getSize

    -
    public long getSize()
    +
    public long getSize()
    Returns:
    size of blocks in the cache
    • @@ -437,7 +444,7 @@ extends

  • getDataSize

    -
    public long getDataSize()
    +
    public long getDataSize()
    Returns:
    Size of data.
    • @@ -447,7 +454,7 @@ extends

  • getAgeInCacheSnapshot

    -
    public AgeSnapshot getAgeInCacheSnapshot()
    +
    public AgeSnapshot getAgeInCacheSnapshot()
    • @@ -456,7 +463,7 @@ extends

  • toString

    -
    public String toString()
    +
    public String toString()
    Overrides:
    toString in class Object
    http://git-wip-us.apache.org/repos/asf/hbase-site/blob/c4be37af/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockPriority.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockPriority.html b/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockPriority.html index 1b9e63d..617c352 100644 --- a/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockPriority.html +++ b/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockPriority.html @@ -239,7 +239,7 @@ the order they are declared.

    • values

      -
      public static BlockPriority[] values()
      +
      public static BlockPriority[] values()
      Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows: @@ -256,7 +256,7 @@ for (BlockPriority c : BlockPriority.values())

      • valueOf

        -
        public static BlockPriority valueOf(String name)
        +
        public static BlockPriority valueOf(String name)
        Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are http://git-wip-us.apache.org/repos/asf/hbase-site/blob/c4be37af/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockType.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockType.html b/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockType.html index 2838e37..1d04a69 100644 --- a/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockType.html +++ b/devapidocs/org/apache/hadoop/hbase/io/hfile/BlockType.html @@ -524,7 +524,7 @@ the order they are declared.

        • values

          -
          public static BlockType[] values()
          +
          public static BlockType[] values()
          Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows: @@ -541,7 +541,7 @@ for (BlockType c : BlockType.values())

          • valueOf

            -
            public static BlockType valueOf(String name)
            +
            public static BlockType valueOf(String name)
            Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are