ChunkCreator.MemStoreChunkPool (Apache HBase 2.0.0-SNAPSHOT API)

java.lang.Object
+
- org.apache.hadoop.hbase.regionserver.ChunkCreator.MemStoreChunkPool
+

+
+
All Implemented Interfaces:
+
HeapMemoryManager.HeapMemoryTuneObserver
+
+
+
Enclosing class:
+
ChunkCreator
+
+
+
+
```
private class ChunkCreator.MemStoreChunkPool
+extends Object
+implements HeapMemoryManager.HeapMemoryTuneObserver
```
+
A pool of Chunk instances. + + MemStoreChunkPool caches a number of retired chunks for reusing, it could + decrease allocating bytes when writing, thereby optimizing the garbage + collection on JVM.
+

+ +

+ + +
Nested Class Summary
+ + + + + + + + + + +
Nested Classes
Modifier and Type Class and Description
private class ChunkCreator.MemStoreChunkPool.StatisticsThread
+

Nested Classes
Modifier and Type	Class and Description
`private class`	`ChunkCreator.MemStoreChunkPool.StatisticsThread`

+ +

Field Summary

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Fields
Modifier and Type	Field and Description
`private AtomicLong`	`chunkCount`
`private int`	`maxCount`
`private float`	`poolSizePercentage`
`private BlockingQueue<Chunk>`	`reclaimedChunks`
`private AtomicLong`	`reusedChunkCount`
`private ScheduledExecutorService`	`scheduleThreadPool` + Statistics thread schedule pool +
`private static int`	`statThreadPeriod` + Statistics thread +

+ +

+ + +
Constructor Summary
+ + + + + + + + +
Constructors
Constructor and Description
MemStoreChunkPool(int maxCount, + int initialCount, + float poolSizePercentage)
+

Constructors
Constructor and Description
`MemStoreChunkPool(int maxCount, + int initialCount, + float poolSizePercentage)`

+ +

+ + +

Method Summary

+ + + + + + + + + + + + + + + + + + + + + + +

All Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`(package private) Chunk`	`getChunk()` + Poll a chunk from the pool, reset it if not null, else create a new chunk to return if we have + not yet created max allowed chunks count. +
`private int`	`getMaxCount()`
`void`	`onHeapMemoryTune(long newMemstoreSize, + long newBlockCacheSize)` + This method would be called by HeapMemoryManger when a heap memory tune action took place. +
`private void`	`putbackChunks(Set<Integer> chunks)` + Add the chunks to the pool, when the pool achieves the max size, it will skip the remaining + chunks +

+ + +
Methods inherited from class java.lang.Object
+clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

+ +
- + + +
  Field Detail
  + + + +
  - +
    maxCount
    +
```
private int maxCount
```
    +
  + + + +
  - +
    reclaimedChunks
    +
```
private final BlockingQueue<Chunk> reclaimedChunks
```
    +
  + + + +
  - +
    poolSizePercentage
    +
```
private final float poolSizePercentage
```
    +
  + + + +
  - +
    scheduleThreadPool
    +
```
private final ScheduledExecutorService scheduleThreadPool
```
    +
    Statistics thread schedule pool
    +
  + + + +
  - +
    statThreadPeriod
    +
```
private static final int statThreadPeriod
```
    +
    Statistics thread
    +
    +
    See Also:
    +
    Constant Field Values
    +
    +
  + + + +
  - +
    chunkCount
    +
```
private final AtomicLong chunkCount
```
    +
  + + + +
  - +
    reusedChunkCount
    +
```
private final AtomicLong reusedChunkCount
```
    +
  +
+ +
- + + +
  Constructor Detail
  + + + +
  - +
    MemStoreChunkPool
    +
```
MemStoreChunkPool(int maxCount,
+                  int initialCount,
+                  float poolSizePercentage)
```
    +
  +
+ +
- + + +
  Method Detail
  + + + +
  - +
    getChunk
    +
```
Chunk getChunk()
```
    +
    Poll a chunk from the pool, reset it if not null, else create a new chunk to return if we have + not yet created max allowed chunks count. When we have already created max allowed chunks and + no free chunks as of now, return null. It is the responsibility of the caller to make a chunk + then. + Note: Chunks returned by this pool must be put back to the pool after its use.
    +
    +
    Returns:
    +
    a chunk
    +
    See Also:
    +
    putbackChunks(Set)
    +
    +
  + + + +
  - +
    putbackChunks
    +
```
private void putbackChunks(Set<Integer> chunks)
```
    +
    Add the chunks to the pool, when the pool achieves the max size, it will skip the remaining + chunks
    +
    +
    Parameters:
    +
    chunks -
    +
    +
  + + + +
  - +
    getMaxCount
    +
```
private int getMaxCount()
```
    +
  + + + +
  - +
    onHeapMemoryTune
    +
```
public void onHeapMemoryTune(long newMemstoreSize,
+                             long newBlockCacheSize)
```
    +
    Description copied from interface: HeapMemoryManager.HeapMemoryTuneObserver
    +
    This method would be called by HeapMemoryManger when a heap memory tune action took place.
    +
    +
    Specified by:
    +
    onHeapMemoryTune in interface HeapMemoryManager.HeapMemoryTuneObserver
    +
    Parameters:
    +
    newMemstoreSize - The newly calculated global memstore size
    +
    newBlockCacheSize - The newly calculated global blockcache size
    +
    +
  +
+

java.lang.Object
+
- org.apache.hadoop.hbase.regionserver.ChunkCreator
+

+
+
+
```
@InterfaceAudience.Private
+public class ChunkCreator
+extends Object
```
+
Does the management of memstoreLAB chunk creations. A monotonically incrementing id is associated + with every chunk
+

+ +

+ + +
Nested Class Summary
+ + + + + + + + + + +
Nested Classes
Modifier and Type Class and Description
private class ChunkCreator.MemStoreChunkPool +
A pool of Chunk instances.
+
+

Nested Classes
Modifier and Type	Class and Description
`private class`	`ChunkCreator.MemStoreChunkPool` + A pool of `Chunk` instances. +

+ +

+ + +

Field Summary

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Fields
Modifier and Type	Field and Description
`private AtomicInteger`	`chunkID`
`private Map<Integer,SoftReference<Chunk>>`	`chunkIdMap`
`(package private) static boolean`	`chunkPoolDisabled`
`private int`	`chunkSize`
`(package private) static ChunkCreator`	`INSTANCE`
`private org.apache.commons.logging.Log`	`LOG`
`private boolean`	`offheap`
`private ChunkCreator.MemStoreChunkPool`	`pool`

+ +

+ + +

Constructor Summary

+ + + + + + + + +

Constructors
Constructor and Description
`ChunkCreator(int chunkSize, + boolean offheap, + long globalMemStoreSize, + float poolSizePercentage, + float initialCountPercentage, + HeapMemoryManager heapMemoryManager)`

+ +

+ + +

Method Summary

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

All Methods Static Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`(package private) void`	`clearChunkIds()`
`(package private) void`	`clearChunksInPool()`
`(package private) static void`	`clearDisableFlag()`
`private Chunk`	`createChunk()`
`private Chunk`	`createChunk(boolean pool)` + Creates the chunk either onheap or offheap +
`(package private) Chunk`	`getChunk()` + Creates and inits a chunk. +
`(package private) Chunk`	`getChunk(int id)`
`(package private) int`	`getChunkSize()`
`(package private) static ChunkCreator`	`getInstance()`
`(package private) int`	`getMaxCount()`
`(package private) int`	`getPoolSize()`
`static ChunkCreator`	`initialize(int chunkSize, + boolean offheap, + long globalMemStoreSize, + float poolSizePercentage, + float initialCountPercentage, + HeapMemoryManager heapMemoryManager)` + Initializes the instance of MSLABChunkCreator +
`private ChunkCreator.MemStoreChunkPool`	`initializePool(long globalMemStoreSize, + float poolSizePercentage, + float initialCountPercentage)`
`(package private) boolean`	`isOffheap()`
`(package private) void`	`putbackChunks(Set<Integer> chunks)`
`(package private) Chunk`	`removeChunk(int chunkId)`
`private void`	`removeChunks(Set<Integer> chunkIDs)`
`(package private) int`	`size()`

+ + +
Methods inherited from class java.lang.Object
+clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

+ +

+ + +

Field Detail

+ + + +

LOG

private final org.apache.commons.logging.Log LOG

+ + + +

+
chunkID
+
```
private AtomicInteger chunkID
```
+

+ + + +

chunkIdMap

private Map<Integer,SoftReference<Chunk>> chunkIdMap

+ + + +

+
chunkSize
+
```
private final int chunkSize
```
+

+ + + +

+
offheap
+
```
private final boolean offheap
```
+

+ + + +

+
INSTANCE
+
```
static ChunkCreator INSTANCE
```
+

+ + + +

+
chunkPoolDisabled
+
```
static boolean chunkPoolDisabled
```
+

+ + + +

pool

private ChunkCreator.MemStoreChunkPool pool

+ +

+ + +

Constructor Detail

+ + + +

ChunkCreator

ChunkCreator(int chunkSize,
+             boolean offheap,
+             long globalMemStoreSize,
+             float poolSizePercentage,
+             float initialCountPercentage,
+             HeapMemoryManager heapMemoryManager)

+ +

+ + +

Method Detail

+ + + +

initialize

public static ChunkCreator initialize(int chunkSize,
+                                      boolean offheap,
+                                      long globalMemStoreSize,
+                                      float poolSizePercentage,
+                                      float initialCountPercentage,
+                                      HeapMemoryManager heapMemoryManager)

Initializes the instance of MSLABChunkCreator

Parameters:: chunkSize - the chunkSize; offheap - indicates if the chunk is to be created offheap or not; globalMemStoreSize - the global memstore size; poolSizePercentage - pool size percentage; initialCountPercentage - the initial count of the chunk pool if any; heapMemoryManager - the heapmemory manager
Returns:: singleton MSLABChunkCreator

+ + + +

+
getInstance
+
```
static ChunkCreator getInstance()
```
+

+ + + +

+
getChunk
+
```
Chunk getChunk()
```
+
Creates and inits a chunk.
+
+
Returns:
+
the chunk that was initialized
+
+

+ + + +

+
createChunk
+
```
private Chunk createChunk()
```
+

+ + + +

+
createChunk
+
```
private Chunk createChunk(boolean pool)
```
+
Creates the chunk either onheap or offheap
+
+
Parameters:
+
pool - indicates if the chunks have to be created which will be used by the Pool
+
Returns:
+
the chunk
+
+

+ + + +

+
getChunk
+
```
Chunk getChunk(int id)
```
+

+ + + +

+
getChunkSize
+
```
int getChunkSize()
```
+

+ + + +

+
isOffheap
+
```
boolean isOffheap()
```
+

+ + + +

removeChunks

private void removeChunks(Set<Integer> chunkIDs)

+ + + +

+
removeChunk
+
```
Chunk removeChunk(int chunkId)
```
+

+ + + +

+
size
+
```
int size()
```
+

+ + + +

+
clearChunkIds
+
```
void clearChunkIds()
```
+

+ + + +

+
clearDisableFlag
+
```
static void clearDisableFlag()
```
+

+ + + +

initializePool

private ChunkCreator.MemStoreChunkPool initializePool(long globalMemStoreSize,
+                                                      float poolSizePercentage,
+                                                      float initialCountPercentage)

+ + + +

+
getMaxCount
+
```
int getMaxCount()
```
+

+ + + +

+
getPoolSize
+
```
int getPoolSize()
```
+

+ + + +

+
clearChunksInPool
+
```
void clearChunksInPool()
```
+

+ + + +

putbackChunks

void putbackChunks(Set<Integer> chunks)

private static class HRegionServer.CompactionChecker
+private static class HRegionServer.CompactionChecker
 extends ScheduledChore

instance
-
private final HRegionServer instance
+
private final HRegionServer instance

@@ -242,7 +242,7 @@ extends

majorCompactPriority

private final int majorCompactPriority

private final int majorCompactPriority

@@ -251,7 +251,7 @@ extends

DEFAULT_PRIORITY

private static final int DEFAULT_PRIORITY

private static final int DEFAULT_PRIORITY

See Also:: Constant Field Values

@@ -281,7 +281,7 @@ extends

CompactionChecker

CompactionChecker(HRegionServer h,
+CompactionChecker(HRegionServer h,
                   int sleepTime,
                   Stoppable stopper)

@@ -300,7 +300,7 @@ extends

chore

protected void chore()

protected void chore()

Description copied from class: ScheduledChore

The task to execute on each scheduled execution of the Chore

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/e4348f53/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionInfo.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionInfo.html b/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionInfo.html index f8732d8..1a5aaa3 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionInfo.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionInfo.html @@ -113,7 +113,7 @@ var activeTableTab = "activeTableTab";

private static class HRegionServer.MovedRegionInfo
+private static class HRegionServer.MovedRegionInfo
 extends Object

@@ -218,7 +218,7 @@ extends

serverName

private final ServerName serverName

private final ServerName serverName

@@ -227,7 +227,7 @@ extends

seqNum

private final long seqNum

private final long seqNum

@@ -236,7 +236,7 @@ extends

ts

private final long ts

private final long ts

@@ -253,7 +253,7 @@ extends

MovedRegionInfo

public MovedRegionInfo(ServerName serverName,
+public MovedRegionInfo(ServerName serverName,
                        long closeSeqNum)

@@ -271,7 +271,7 @@ extends

getServerName

public ServerName getServerName()

public ServerName getServerName()

@@ -280,7 +280,7 @@ extends

getSeqNum

public long getSeqNum()

public long getSeqNum()

@@ -289,7 +289,7 @@ extends

getMoveTime

public long getMoveTime()

public long getMoveTime()

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/e4348f53/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionsCleaner.html ---------------------------------------------------------------------- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionsCleaner.html b/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionsCleaner.html index a23ddcd..7c25c67 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionsCleaner.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/HRegionServer.MovedRegionsCleaner.html @@ -122,7 +122,7 @@ var activeTableTab = "activeTableTab";

protected static final class HRegionServer.MovedRegionsCleaner
+protected static final class HRegionServer.MovedRegionsCleaner
 extends ScheduledChore
 implements Stoppable
 Creates a Chore thread to clean the moved region cache.
@@ -242,7 +242,7 @@ implements 
 
 regionServer
-private HRegionServer regionServer
+private HRegionServer regionServer
 
 
 
@@ -251,7 +251,7 @@ implements 
 
 stoppable
-Stoppable stoppable
+Stoppable stoppable
 
 
 
@@ -268,7 +268,7 @@ implements 
 
 MovedRegionsCleaner
-private MovedRegionsCleaner(HRegionServer regionServer,
+private MovedRegionsCleaner(HRegionServer regionServer,
                             Stoppable stoppable)
 
 
@@ -286,7 +286,7 @@ implements 
 
 create
-static HRegionServer.MovedRegionsCleaner create(HRegionServer rs)
+static HRegionServer.MovedRegionsCleaner create(HRegionServer rs)
 
 
 
@@ -295,7 +295,7 @@ implements 
 
 chore
-protected void chore()
+protected void chore()
 Description copied from class: ScheduledChore
 The task to execute on each scheduled execution of the Chore
 
@@ -310,7 +310,7 @@ implements 
 
 stop
-public void stop(String why)
+public void stop(String why)
 Description copied from interface: Stoppable
 Stop this service.
  Implementers should favor logging errors over throwing RuntimeExceptions.
@@ -328,7 +328,7 @@ implements 
 

 isStopped
-public boolean isStopped()
+public boolean isStopped()
 
 Specified by:
 isStopped in interface Stoppable

Class ChunkCreator.MemStoreChunkPool

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

maxCount

reclaimedChunks

poolSizePercentage

scheduleThreadPool

statThreadPeriod

chunkCount

reusedChunkCount

Constructor Detail

MemStoreChunkPool

Method Detail

getChunk

putbackChunks

getMaxCount

onHeapMemoryTune

Class ChunkCreator

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

LOG

chunkID

chunkIdMap

chunkSize

offheap

INSTANCE

chunkPoolDisabled

pool

Constructor Detail

ChunkCreator

Method Detail

initialize

getInstance

getChunk

createChunk

createChunk

getChunk

getChunkSize

isOffheap

removeChunks

removeChunk

size

clearChunkIds

clearDisableFlag

initializePool

getMaxCount

getPoolSize

clearChunksInPool

putbackChunks

instance

majorCompactPriority

DEFAULT_PRIORITY

iteration

CompactionChecker

chore

serverName

seqNum

ts

MovedRegionInfo

getServerName

getSeqNum

getMoveTime

regionServer

stoppable

MovedRegionsCleaner

create

chore

stop

isStopped