MemStoreChunkPool.StatisticsThread (Apache HBase 2.0.0-SNAPSHOT API)

Frames

Frames

+ + +

Skip navigation links

+ + + +

Prev Class
Next Class

Frames
No Frames

All Classes

+ +

Summary:
Nested |
Field |
Constr |
Method

Detail:
Field |
Constr |
Method

+ + +

java.lang.Object
+
- java.lang.Thread
- +
  - org.apache.hadoop.hbase.regionserver.MemStoreChunkPool.StatisticsThread
  +
+

+
+
All Implemented Interfaces:
+
Runnable
+
+
+
Enclosing class:
+
MemStoreChunkPool
+
+
+
+
```
private class MemStoreChunkPool.StatisticsThread
+extends Thread
```
+

+ +
- + + +
  Nested Class Summary
  +
  - + + +
    Nested classes/interfaces inherited from class java.lang.Thread
    +Thread.State, Thread.UncaughtExceptionHandler
  +
+ +
- + + +
  Field Summary
  +
  - + + +
    Fields inherited from class java.lang.Thread
    +MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY
  +
+ +
- + + +
  Constructor Summary
  + + + + + + + + +
  Constructors
  Constructor and Description
  StatisticsThread()
  +
+ +
- + + +
  Method Summary
  + + + + + + + + + + + + + + +
  All Methods Instance Methods Concrete Methods
  Modifier and Type Method and Description
  private void logStats()
  void run()
  +
  - + + +
    Methods inherited from class java.lang.Thread
    +activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHa ndler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield< /code>
  + + + + +Methods inherited from class java.lang.Object +equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait + +
+

Constructors
Constructor and Description
`StatisticsThread()`

All Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`private void`	`logStats()`
`void`	`run()`


+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
+StatisticsThread
+StatisticsThread()
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+run
+public void run()
+
+Specified by:
+run in interface Runnable
+Overrides:
+run in class Thread
+
+
+
+
+
+
+
+
+logStats
+private void logStats()
+
+
+
+
+
+
+
+


+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+Prev Class
+Next Class
+
+
+Frames
+No Frames
+
+
+All Classes
+
+
+
+
+
+
+Summary: 
+Nested | 
+Field | 
+Constr | 
+Method
+
+
+Detail: 
+Field | 
+Constr | 
+Method
+
+
+
+
+
+
+Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.
+
+

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/2fcc2ae0/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreChunkPool.html
----------------------------------------------------------------------
diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreChunkPool.html b/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreChunkPool.html
new file mode 100644
index 0000000..0013e31
--- /dev/null
+++ b/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreChunkPool.html
@@ -0,0 +1,688 @@
+
+
+
+
+
+
+MemStoreChunkPool (Apache HBase 2.0.0-SNAPSHOT API)
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+Prev Class
+Next Class
+
+
+Frames
+No Frames
+
+
+All Classes
+
+
+
+
+
+
+Summary: 
+Nested | 
+Field | 
+Constr | 
+Method
+
+
+Detail: 
+Field | 
+Constr | 
+Method
+
+
+
+
+
+
+
+
+org.apache.hadoop.hbase.regionserver
+Class MemStoreChunkPool
+
+
+
+java.lang.Object
+
+
+org.apache.hadoop.hbase.regionserver.MemStoreChunkPool
+
+
+
+
+
+
+
+All Implemented Interfaces:
+HeapMemoryManager.HeapMemoryTuneObserver
+
+
+

+@InterfaceAudience.Private
+public class MemStoreChunkPool
+extends Object
+implements HeapMemoryManager.HeapMemoryTuneObserver
+A pool of Chunk instances.
+ 
+ MemStoreChunkPool caches a number of retired chunks for reusing, it could
+ decrease allocating bytes when writing, thereby optimizing the garbage
+ collection on JVM.
+ 
+ The pool instance is globally unique and could be obtained through
+ initialize(long, float, float, int, boolean)
+ 
+ getChunk() is called when MemStoreLAB allocating
+ bytes, and putbackChunks(BlockingQueue) is called
+ when MemStore clearing snapshot for flush
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+
+
+
+
+
+
+Nested Classes Modifier and Type Class and Description
private class  MemStoreChunkPool.StatisticsThread 
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Fields Modifier and Type Field and Description
private AtomicLong chunkCount 
(package private) static boolean chunkPoolDisabled
+Boolean whether we have disabled the memstore chunk pool entirely.
+
private int chunkSize 
(package private) static MemStoreChunkPool GLOBAL_INSTANCE 
private static org.apache.commons.logging.Log LOG 
private int maxCount 
private boolean offheap 
private float poolSizePercentage 
private BlockingQueue<Chunk> reclaimedChunks 
private AtomicLong reusedChunkCount 
private ScheduledExecutorService scheduleThreadPool
+Statistics thread schedule pool
+
private static int statThreadPeriod
+Statistics thread
+
+
+
+
+
+
+
+
+Constructor Summary
+
+
+
+
+
+
+
+
+Constructors Constructor and Description
MemStoreChunkPool(int chunkSize,
+                 int maxCount,
+                 int initialCount,
+                 float poolSizePercentage,
+                 boolean offheap) 
+
+
+
+
+
+
+
+Method Summary
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method and Description
(package private) void clearChunks() 
(package private) static void clearDisableFlag() 
(package private) Chunk getChunk()
+Poll a chunk from the pool, reset it if not null, else create a new chunk to return if we have
+ not yet created max allowed chunks count.
+
(package private) int getMaxCount() 
(package private) static MemStoreChunkPool getPool() 
(package private) int getPoolSize() 
(package private) static MemStoreChunkPool initialize(long globalMemStoreSize,
+          float poolSizePercentage,
+          float initialCountPercentage,
+          int chunkSize,
+          boolean offheap) 
void onHeapMemoryTune(long newMemstoreSize,
+                long newBlockCacheSize)
+This method would be called by HeapMemoryManger when a heap memory tune action took place.
+
(package private) void putbackChunk(Chunk chunk)
+Add the chunk to the pool, if the pool has achieved the max size, it will
+ skip it
+
(package private) void putbackChunks(BlockingQueue<Chunk> chunks)
+Add the chunks to the pool, when the pool achieves the max size, it will
+ skip the remaining chunks
+
+
+
+
+
+Methods inherited from class java.lang.Object
+clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Field Detail
+
+
+
+
+
+LOG
+private static final org.apache.commons.logging.Log LOG
+
+
+
+
+
+
+
+GLOBAL_INSTANCE
+static MemStoreChunkPool GLOBAL_INSTANCE
+
+
+
+
+
+
+
+chunkPoolDisabled
+static boolean chunkPoolDisabled
+Boolean whether we have disabled the memstore chunk pool entirely.
+
+
+
+
+
+
+
+maxCount
+private int maxCount
+
+
+
+
+
+
+
+reclaimedChunks
+private final BlockingQueue<Chunk> reclaimedChunks
+
+
+
+
+
+
+
+chunkSize
+private final int chunkSize
+
+
+
+
+
+
+
+poolSizePercentage
+private final float poolSizePercentage
+
+
+
+
+
+
+
+scheduleThreadPool
+private final ScheduledExecutorService scheduleThreadPool
+Statistics thread schedule pool
+
+
+
+
+
+
+
+statThreadPeriod
+private static final int statThreadPeriod
+Statistics thread
+
+See Also:
+Constant Field Values
+
+
+
+
+
+
+
+
+chunkCount
+private final AtomicLong chunkCount
+
+
+
+
+
+
+
+reusedChunkCount
+private final AtomicLong reusedChunkCount
+
+
+
+
+
+
+
+offheap
+private final boolean offheap
+
+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
+MemStoreChunkPool
+MemStoreChunkPool(int chunkSize,
+                  int maxCount,
+                  int initialCount,
+                  float poolSizePercentage,
+                  boolean offheap)
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+getChunk
+Chunk getChunk()
+Poll a chunk from the pool, reset it if not null, else create a new chunk to return if we have
+ not yet created max allowed chunks count. When we have already created max allowed chunks and
+ no free chunks as of now, return null. It is the responsibility of the caller to make a chunk
+ then.
+ Note: Chunks returned by this pool must be put back to the pool after its use.
+
+Returns:
+a chunk
+See Also:
+putbackChunk(Chunk), 
+putbackChunks(BlockingQueue)
+
+
+
+
+
+
+
+
+putbackChunks
+void putbackChunks(BlockingQueue<Chunk> chunks)
+Add the chunks to the pool, when the pool achieves the max size, it will
+ skip the remaining chunks
+
+Parameters:
+chunks - 
+
+
+
+
+
+
+
+
+putbackChunk
+void putbackChunk(Chunk chunk)
+Add the chunk to the pool, if the pool has achieved the max size, it will
+ skip it
+
+Parameters:
+chunk - 
+
+
+
+
+
+
+
+
+getPoolSize
+int getPoolSize()
+
+
+
+
+
+
+
+clearChunks
+void clearChunks()
+
+
+
+
+
+
+
+initialize
+static MemStoreChunkPool initialize(long globalMemStoreSize,
+                                    float poolSizePercentage,
+                                    float initialCountPercentage,
+                                    int chunkSize,
+                                    boolean offheap)
+
+Returns:
+the global MemStoreChunkPool instance
+
+
+
+
+
+
+
+
+getPool
+static MemStoreChunkPool getPool()
+
+Returns:
+The singleton instance of this pool.
+
+
+
+
+
+
+
+
+getMaxCount
+int getMaxCount()
+
+
+
+
+
+
+
+clearDisableFlag
+static void clearDisableFlag()
+
+
+
+
+
+
+
+onHeapMemoryTune
+public void onHeapMemoryTune(long newMemstoreSize,
+                             long newBlockCacheSize)
+Description copied from interface: HeapMemoryManager.HeapMemoryTuneObserver
+This method would be called by HeapMemoryManger when a heap memory tune action took place.
+
+Specified by:
+onHeapMemoryTune in interface HeapMemoryManager.HeapMemoryTuneObserver
+Parameters:
+newMemstoreSize - The newly calculated global memstore size
+newBlockCacheSize - The newly calculated global blockcache size
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+Prev Class
+Next Class
+
+
+Frames
+No Frames
+
+
+All Classes
+
+
+
+
+
+
+Summary: 
+Nested | 
+Field | 
+Constr | 
+Method
+
+
+Detail: 
+Field | 
+Constr | 
+Method
+
+
+
+
+
+
+Copyright © 2007–2017 The Apache Software Foundation. All rights reserved.
+
+

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/2fcc2ae0/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreCompactor.html
----------------------------------------------------------------------
diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreCompactor.html b/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreCompactor.html
index 647ad94..0e303f4 100644
--- a/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreCompactor.html
+++ b/devapidocs/org/apache/hadoop/hbase/regionserver/MemStoreCompactor.html
@@ -49,7 +49,7 @@ var activeTableTab = "activeTableTab";

Modifier and Type	Field and Description
`private AtomicLong`	`chunkCount`
`(package private) static boolean`	`chunkPoolDisabled` + Boolean whether we have disabled the memstore chunk pool entirely. +
`private int`	`chunkSize`
`(package private) static MemStoreChunkPool`	`GLOBAL_INSTANCE`
`private static org.apache.commons.logging.Log`	`LOG`
`private int`	`maxCount`
`private boolean`	`offheap`
`private float`	`poolSizePercentage`
`private BlockingQueue<Chunk>`	`reclaimedChunks`
`private AtomicLong`	`reusedChunkCount`
`private ScheduledExecutorService`	`scheduleThreadPool` + Statistics thread schedule pool +
`private static int`	`statThreadPeriod` + Statistics thread +

Modifier and Type	Method and Description
`(package private) void`	`clearChunks()`
`(package private) static void`	`clearDisableFlag()`
`(package private) Chunk`	`getChunk()` + Poll a chunk from the pool, reset it if not null, else create a new chunk to return if we have + not yet created max allowed chunks count. +
`(package private) int`	`getMaxCount()`
`(package private) static MemStoreChunkPool`	`getPool()`
`(package private) int`	`getPoolSize()`
`(package private) static MemStoreChunkPool`	`initialize(long globalMemStoreSize, + float poolSizePercentage, + float initialCountPercentage, + int chunkSize, + boolean offheap)`
`void`	`onHeapMemoryTune(long newMemstoreSize, + long newBlockCacheSize)` + This method would be called by HeapMemoryManger when a heap memory tune action took place. +
`(package private) void`	`putbackChunk(Chunk chunk)` + Add the chunk to the pool, if the pool has achieved the max size, it will + skip it +
`(package private) void`	`putbackChunks(BlockingQueue<Chunk> chunks)` + Add the chunks to the pool, when the pool achieves the max size, it will + skip the remaining chunks +

Class MemStoreChunkPool.StatisticsThread

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

Field Summary

Fields inherited from class java.lang.Thread

Constructor Summary

Method Summary

Methods inherited from class java.lang.Thread

Methods inherited from class java.lang.Object

Constructor Detail

StatisticsThread

Method Detail

run

logStats

Class MemStoreChunkPool

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

LOG

GLOBAL_INSTANCE

chunkPoolDisabled

maxCount

reclaimedChunks

chunkSize

poolSizePercentage

scheduleThreadPool

statThreadPeriod

chunkCount

reusedChunkCount

offheap

Constructor Detail

MemStoreChunkPool

Method Detail

getChunk

putbackChunks

putbackChunk

getPoolSize

clearChunks

initialize

getPool

getMaxCount

clearDisableFlag

onHeapMemoryTune