hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15786) Create DBB backed MSLAB pool
Date Thu, 24 Nov 2016 19:34:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15694081#comment-15694081
] 

Hudson commented on HBASE-15786:
--------------------------------

SUCCESS: Integrated in Jenkins build HBase-Trunk_matrix #2012 (See [https://builds.apache.org/job/HBase-Trunk_matrix/2012/])
HBASE-15786 Create DBB backed MSLAB pool. (anoopsamjohn: rev 86e17858f73e742970e59936d34bfdb31fa286e1)
* (edit) hbase-client/src/test/java/org/apache/hadoop/hbase/filter/TestComparators.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Chunk.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/OffheapChunk.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreLABImpl.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemStoreChunkPool.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
* (edit) hbase-prefix-tree/src/main/java/org/apache/hadoop/hbase/codec/prefixtree/decode/PrefixTreeCell.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/KeyOnlyFilter.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMemStoreLAB.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingMemStore.java
* (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/TestCellUtil.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/PrefixFilter.java
* (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HeapMemStoreLAB.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHeapMemoryManager.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HeapMemoryManager.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ExtendedCell.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/BufferedDataBlockEncoder.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/OnheapChunk.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreChunkPool.java
* (delete) hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/OffheapKeyValue.java
* (delete) hbase-common/src/main/java/org/apache/hadoop/hbase/ByteBufferedCell.java
* (delete) hbase-common/src/main/java/org/apache/hadoop/hbase/ByteBufferedKeyOnlyKeyValue.java
* (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/TestCellComparator.java
* (edit) hbase-client/src/test/java/org/apache/hadoop/hbase/filter/TestKeyOnlyFilter.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SegmentFactory.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValueUtil.java
* (add) hbase-common/src/main/java/org/apache/hadoop/hbase/ByteBufferKeyOnlyKeyValue.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/CellComparator.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCellFlatSet.java
* (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/io/TestTagCompressionContext.java
* (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/TestOffheapKeyValue.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestSingleColumnValueFilter.java
* (edit) hbase-prefix-tree/src/main/java/org/apache/hadoop/hbase/codec/prefixtree/PrefixTreeSeeker.java
* (add) hbase-common/src/main/java/org/apache/hadoop/hbase/ByteBufferCell.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultHeapMemoryTuner.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/AbstractDataBlockEncoder.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/filter/ColumnPrefixFilter.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/HBaseConfiguration.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValue.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlockIndex.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreLAB.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/io/util/MemorySizeUtil.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java


> Create DBB backed MSLAB pool
> ----------------------------
>
>                 Key: HBASE-15786
>                 URL: https://issues.apache.org/jira/browse/HBASE-15786
>             Project: HBase
>          Issue Type: Sub-task
>          Components: regionserver
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: Anoop Sam John
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15786.patch, HBASE-15786_V2.patch, HBASE-15786_V2.patch, HBASE-15786_V3.patch,
HBASE-15786_V4.patch, HBASE-15786_V5.patch, HBASE-15786_V6.patch
>
>
> We can make use of MSLAB pool for this off heap memstore. 
> Right now one can specify the global memstore size (heap size) as a % of max memory using
a config. We will add another config with which one can specify the global off heap memstore
size. This will be exact size not as %. When off heap memstore in use, we will give this entire
area for the MSLAB pool and that will create off heap chunks. So when cells are added to memstore,
the cell data gets copied into the off heap MSLAB chunk spaces. Note that when the pool size
is not really enough and we need additional chunk creation, we wont use off heap area for
that.  We dony want to create so many on demand DBBs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message