hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gary Helmling <ghelml...@gmail.com>
Subject Re: Problems with dynamic loading a Coprocessor
Date Fri, 21 Mar 2014 18:00:10 GMT
Todd,

Take a look at the regionserver log for the server hosting the "events"
table region.  If the server cannot load the coprocessor when opening the
region, you should see some errors in the log that will help pinpoint the
problem (like is the user running the regionserver process able to read the
file in HDFS?).


On Fri, Mar 21, 2014 at 10:38 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> HBASE-5258 dropped per-region coprocessor list from HServerLoad.
>
> Have you tried specifying namenode information in shell command. e.g.
> 'coprocessor'=>'hdfs://example0:8020...'
>
> Please also take a look at region server log around the time table was
> enabled.
>
> Cheers
>
>
> On Fri, Mar 21, 2014 at 9:38 AM, Todd Gruben <tgruben@gmail.com> wrote:
>
> > I'm new to hbase and I'm trying to load my first region observer
> > coprocessor.  I working with cloudera's hbase 0.96.1.1-cdh5.0.0-beta-2
> >
> > The basic steps i've tried.  Its's about as basic a process as you can
> get,
> > I'm hoping just to put some stuff in the log and prevent a row from going
> > into the table.
> >
> > public class Exploader extends BaseRegionObserver {
> >  public static final Logger logger= Logger.getLogger(Exploader.class);
> >         public void start(CoprocessorEnvironment env) throws IOException
> {
> >                 logger.info("Loaded Exploader");
> >         }
> >
> >         public void prePut(ObserverContext<RegionCoprocessorEnvironment>
> e,
> > Put put, WALEdit edit, boolean writeToWAL)throws IOException {
> > //alright so the goal here is to build a jar file that can pluging
> >                 logger.info("prePut Exploader");
> >                 e.complete(); //ignore and not install
> >
> >         }
> >
> > }
> >
> >
> > I build the jar and put it into hdfs like so..
> >
> >  home>hadoop fs -copyFromLocal Exploader-0.0.jar /
> >
> > I then go to the hbase shell
> > hbase(main):037:0> disable 'events'
> >
> > hbase(main):038:0>alter 'events', METHOD => 'table_att',
> >
> >
> 'coprocessor'=>'hdfs:///Exploader-0.0.jar|umbel.hbase.coprocessor.Exploader|1001|'
> >
> > hbase(main):041:0>enable 'events'
> >
> > I see it there..
> >
> > hbase(main):039:0> describe 'events'
> > DESCRIPTION
> >                                            ENABLED
> >  'events', {TABLE_ATTRIBUTES => {coprocessor$1 =>
> > 'hdfs:///Exploader-0.0.jar|umbel.hbase.coprocessor.Exploader|1001|'}
> false
> >  , {NAME => 'event', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW',
> > REPLICATION_SCOPE => '0', VERSIONS => '1', C
> >  OMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647',
> > KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536',
> >  IN_MEMORY => 'false', BLOCKCACHE => 'true'}
> >
> > I do a put into events and I see the item  present, and no entry in the
> log
> > file.
> >
> > It doesn't seem to be loaded when I look at the status 'details'
> >
> > hbase(main):042:0> status 'detailed'
> > version 0.96.1.1-cdh5.0.0-beta-2
> > 0 regionsInTransition
> > master coprocessors: []
> > 2 live servers
> >     ch3.localdomain:60020 1395253537189
> >         requestsPerSecond=4.0, numberOfOnlineRegions=3, usedHeapMB=132,
> > maxHeapMB=1541, numberOfStores=3, numberOfStorefiles=3,
> > storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
> > storefileIndexSizeMB=0, readRequestsCount=230538, writeRequestsCount=28,
> > rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
> > totalCompactingKVs=39, currentCompactedKVs=39, compactionProgressPct=1.0,
> > coprocessors=[]
> >         "events,,1395417302442.275cd6d13fce89a2040dd394792ba86e."
> >             numberOfStores=1, numberOfStorefiles=0,
> > storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
> > storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0,
> > rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
> > totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
> >         "hbase:meta,,1"
> >             numberOfStores=1, numberOfStorefiles=2,
> > storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
> > storefileIndexSizeMB=0, readRequestsCount=230527, writeRequestsCount=28,
> > rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
> > totalCompactingKVs=39, currentCompactedKVs=39, compactionProgressPct=1.0
> >
> "hbase:namespace,,1395245443099.1cc9f4eeda9c21b8d2bfcc3e63598224."
> >             numberOfStores=1, numberOfStorefiles=1,
> > storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
> > storefileIndexSizeMB=0, readRequestsCount=11, writeRequestsCount=0,
> > rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
> > totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
> >     ch2.localdomain:60020 1395253551442
> >         requestsPerSecond=0.0, numberOfOnlineRegions=1, usedHeapMB=11,
> > maxHeapMB=1541, numberOfStores=1, numberOfStorefiles=2,
> > storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
> > storefileIndexSizeMB=0, readRequestsCount=186, writeRequestsCount=7,
> > rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
> > totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN,
> > coprocessors=[]
> >         "demo,,1395257321355.c4e4b184ea117b6290d5f194a87642b0."
> >             numberOfStores=1, numberOfStorefiles=2,
> > storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0,
> > storefileIndexSizeMB=0, readRequestsCount=186, writeRequestsCount=7,
> > rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0,
> > totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
> > 0 dead servers
> >
> >
> >
> > Anybody have any options to check?
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message