hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12213) HFileBlock backed by Array of ByteBuffers
Date Fri, 17 Jul 2015 09:06:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14631061#comment-14631061
] 

Hudson commented on HBASE-12213:
--------------------------------

FAILURE: Integrated in HBase-TRUNK #6660 (See [https://builds.apache.org/job/HBase-TRUNK/6660/])
HBASE-12213 HFileBlock backed by Array of ByteBuffers (Ram) (ramkrishna: rev 834f87b23de533783ba5f5b858327a6164f17f55)
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockCompatibility.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/PrefixKeyDeltaEncoder.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/bucket/TestByteBufferIOEngine.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CompoundBloomFilter.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/ByteBufferIOEngine.java
* hbase-common/src/test/java/org/apache/hadoop/hbase/nio/TestMultiByteBuff.java
* hbase-common/src/test/java/org/apache/hadoop/hbase/io/TestByteBufferInputStream.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileWriterV3.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/FileIOEngine.java
* hbase-common/src/test/java/org/apache/hadoop/hbase/io/TestMultiByteBuffInputStream.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileWriterV2.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/encoding/TestDataBlockEncoders.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/BufferedDataBlockEncoder.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/IOEngine.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java
* hbase-prefix-tree/src/main/java/org/apache/hadoop/hbase/codec/prefixtree/PrefixTreeSeeker.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestChecksum.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/CacheTestUtils.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/util/UnsafeAccess.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlock.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferArray.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/DiffKeyDeltaEncoder.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/nio/MultiByteBuffer.java
* hbase-common/src/test/java/org/apache/hadoop/hbase/nio/TestMultiByteBuffer.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValue.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/CopyKeyDataBlockEncoder.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestBloomFilterChunk.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/hbck/TableLockChecker.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/nio/SingleByteBuff.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/ByteBufferInputStream.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheableDeserializer.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestByteBuffUtils.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/util/Hash.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/BloomFilter.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlockIndex.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/MemcachedBlockCache.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/nio/MultiByteBuff.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestByteBufferUtils.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/BloomFilterChunk.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/BloomFilterUtil.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/FastDiffDeltaEncoder.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/DataBlockEncoder.java
* hbase-prefix-tree/src/main/java/org/apache/hadoop/hbase/codec/prefixtree/PrefixTreeCodec.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/ByteBuffInputStream.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/HFileBlockDefaultDecodingContext.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/HFileBlockDecodingContext.java


> HFileBlock backed by Array of ByteBuffers
> -----------------------------------------
>
>                 Key: HBASE-12213
>                 URL: https://issues.apache.org/jira/browse/HBASE-12213
>             Project: HBase
>          Issue Type: Sub-task
>          Components: regionserver, Scanners
>            Reporter: Anoop Sam John
>            Assignee: ramkrishna.s.vasudevan
>         Attachments: HBASE-12213_1.patch, HBASE-12213_10_withBBI.patch, HBASE-12213_11_withBBI.patch,
HBASE-12213_12_withBBI.patch, HBASE-12213_12_withBBI.patch, HBASE-12213_13_withBBI.patch,
HBASE-12213_14_withBBI.patch, HBASE-12213_2.patch, HBASE-12213_4.patch, HBASE-12213_8_withBBI.patch,
HBASE-12213_9_withBBI.patch, HBASE-12213_final.patch, HBASE-12213_jmh.zip
>
>
> In L2 cache (offheap) an HFile block might have been cached into multiple chunks of buffers.
If HFileBlock need single BB, we will end up in recreation of bigger BB and copying. Instead
we can make HFileBlock to serve data from an array of BBs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message