hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Gruben <tgru...@gmail.com>
Subject Problems with dynamic loading a Coprocessor
Date Fri, 21 Mar 2014 16:38:28 GMT
I'm new to hbase and I'm trying to load my first region observer
coprocessor.  I working with cloudera's hbase 0.96.1.1-cdh5.0.0-beta-2

The basic steps i've tried.  Its's about as basic a process as you can get,
I'm hoping just to put some stuff in the log and prevent a row from going
into the table.

public class Exploader extends BaseRegionObserver {
 public static final Logger logger= Logger.getLogger(Exploader.class);
        public void start(CoprocessorEnvironment env) throws IOException {
                logger.info("Loaded Exploader");
        }

        public void prePut(ObserverContext<RegionCoprocessorEnvironment> e,
Put put, WALEdit edit, boolean writeToWAL)throws IOException {
//alright so the goal here is to build a jar file that can pluging
                logger.info("prePut Exploader");
                e.complete(); //ignore and not install

        }

}


I build the jar and put it into hdfs like so..

 home>hadoop fs -copyFromLocal Exploader-0.0.jar /

I then go to the hbase shell
hbase(main):037:0> disable 'events'

hbase(main):038:0>alter 'events', METHOD => 'table_att',
'coprocessor'=>'hdfs:///Exploader-0.0.jar|umbel.hbase.coprocessor.Exploader|1001|'

hbase(main):041:0>enable 'events'

I see it there..

hbase(main):039:0> describe 'events'
DESCRIPTION
                                           ENABLED
 'events', {TABLE_ATTRIBUTES => {coprocessor$1 =>
'hdfs:///Exploader-0.0.jar|umbel.hbase.coprocessor.Exploader|1001|'} false
 , {NAME => 'event', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW',
REPLICATION_SCOPE => '0', VERSIONS => '1', C
 OMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647',
KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536',
 IN_MEMORY => 'false', BLOCKCACHE => 'true'}

I do a put into events and I see the item  present, and no entry in the log
file.

It doesn't seem to be loaded when I look at the status 'details'

hbase(main):042:0> status 'detailed'
version 0.96.1.1-cdh5.0.0-beta-2
0 regionsInTransition
master coprocessors: []
2 live servers
    ch3.localdomain:60020 1395253537189
        requestsPerSecond=4.0, numberOfOnlineRegions=3, usedHeapMB=132,
maxHeapMB=1541, numberOfStores=3, numberOfStorefiles=3,
storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
storefileIndexSizeMB=0, readRequestsCount=230538, writeRequestsCount=28,
rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
totalCompactingKVs=39, currentCompactedKVs=39, compactionProgressPct=1.0,
coprocessors=[]
        "events,,1395417302442.275cd6d13fce89a2040dd394792ba86e."
            numberOfStores=1, numberOfStorefiles=0,
storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0,
rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
        "hbase:meta,,1"
            numberOfStores=1, numberOfStorefiles=2,
storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
storefileIndexSizeMB=0, readRequestsCount=230527, writeRequestsCount=28,
rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
totalCompactingKVs=39, currentCompactedKVs=39, compactionProgressPct=1.0
        "hbase:namespace,,1395245443099.1cc9f4eeda9c21b8d2bfcc3e63598224."
            numberOfStores=1, numberOfStorefiles=1,
storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
storefileIndexSizeMB=0, readRequestsCount=11, writeRequestsCount=0,
rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
    ch2.localdomain:60020 1395253551442
        requestsPerSecond=0.0, numberOfOnlineRegions=1, usedHeapMB=11,
maxHeapMB=1541, numberOfStores=1, numberOfStorefiles=2,
storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
storefileIndexSizeMB=0, readRequestsCount=186, writeRequestsCount=7,
rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN,
coprocessors=[]
        "demo,,1395257321355.c4e4b184ea117b6290d5f194a87642b0."
            numberOfStores=1, numberOfStorefiles=2,
storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
storefileIndexSizeMB=0, readRequestsCount=186, writeRequestsCount=7,
rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
0 dead servers



Anybody have any options to check?

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message