Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1BC12DF07 for ; Sun, 30 Dec 2012 17:56:14 +0000 (UTC) Received: (qmail 57358 invoked by uid 500); 30 Dec 2012 17:56:13 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 57308 invoked by uid 500); 30 Dec 2012 17:56:13 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 57297 invoked by uid 99); 30 Dec 2012 17:56:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 30 Dec 2012 17:56:13 +0000 Date: Sun, 30 Dec 2012 17:56:13 +0000 (UTC) From: "nkeywal (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-6811) TestDrainingServer#testDrainingServerWithAbort sometimes fails in trunk MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-6811?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] nkeywal updated HBASE-6811: --------------------------- Attachment: 6811.v1.patch =20 > TestDrainingServer#testDrainingServerWithAbort sometimes fails in trunk > ----------------------------------------------------------------------- > > Key: HBASE-6811 > URL: https://issues.apache.org/jira/browse/HBASE-6811 > Project: HBase > Issue Type: Bug > Affects Versions: 0.96.0 > Reporter: Ted Yu > Assignee: nkeywal > Attachments: 6811.v1.patch, 6811.v1.patch > > > TestDrainingServer#testDrainingServerWithAbort failed in trunk build #334= 8: > {code} > Error Message > Test conditions are not met: regions were created/deleted during the test= . expected:<27> but was:<24> > Stacktrace > junit.framework.AssertionFailedError: Test conditions are not met: region= s were created/deleted during the test. expected:<27> but was:<24> > =09at junit.framework.Assert.fail(Assert.java:50) > =09at junit.framework.Assert.failNotEquals(Assert.java:287) > =09at junit.framework.Assert.assertEquals(Assert.java:67) > =09at junit.framework.Assert.assertEquals(Assert.java:134) > =09at org.apache.hadoop.hbase.TestDrainingServer.testDrainingServerWithAb= ort(TestDrainingServer.java:241) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo= rkMethod.java:45) > =09at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC= allable.java:15) > =09at org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework= Method.java:42) > =09at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeM= ethod.java:20) > =09at org.junit.internal.runners.statements.FailOnTimeout$StatementThread= .run(FailOnTimeout.java:62) > Standard Output > Shutting down the Mini HDFS Cluster > Shutting down DataNode 4 > Shutting down DataNode 3 > Shutting down DataNode 2 > Shutting down DataNode 1 > Shutting down DataNode 0 > Standard Error > 2012-09-18 20:18:30,026 INFO [pool-1-thread-1] hbase.ResourceChecker(144= ): before TestDrainingServer#testDrainingServerWithAbort: 441 threads, 700 = file descriptors 7 connections,=20 > 2012-09-18 20:18:30,044 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeCreated, state=3DSyncConnected, path=3D/hbase/balancer > 2012-09-18 20:18:30,044 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(1141): master:35050-0x139db080e690000 Retrieved 6 byte(s) of data from = znode /hbase/balancer and set watcher; PBUF\x08\x00 > 2012-09-18 20:18:30,045 DEBUG [IPC Server handler 2 on 35050] zookeeper.Z= KUtil(1141): master:35050-0x139db080e690000 Retrieved 6 byte(s) of data fro= m znode /hbase/balancer and set watcher; PBUF\x08\x00 > 2012-09-18 20:18:30,045 INFO [IPC Server handler 2 on 35050] master.HMas= ter(1363): BalanceSwitch=3Dfalse > 2012-09-18 20:18:30,047 INFO [Thread-604] hbase.TestDrainingServer(211):= Regions of drained server are: [t,yyy,1347999506717.bdd1a3ab3105de63248038= bd0eb40564.] > 2012-09-18 20:18:30,047 INFO [Thread-604] hbase.TestDrainingServer(112):= Making hemera.apache.org,33334,1347999502311 the draining server; it has 1= online regions > 2012-09-18 20:18:30,048 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeChildrenChanged, state=3DSyncConnected, path=3D/hbase/draining > 2012-09-18 20:18:30,049 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/draining/hemera.apache.org,33334,1347999502311 > 2012-09-18 20:18:30,049 INFO [pool-1-thread-1-EventThread] zookeeper.Dra= iningServerTracker(83): Draining RS node created, adding to list [hemera.ap= ache.org,33334,1347999502311] > 2012-09-18 20:18:30,049 INFO [Thread-604] hbase.TestDrainingServer(220):= The available servers are: [hemera.apache.org,38814,1347999502374, hemera.= apache.org,58959,1347999502361, hemera.apache.org,43875,1347999502347, heme= ra.apache.org,51601,1347999502333] > 2012-09-18 20:18:30,049 FATAL [Thread-604] regionserver.HRegionServer(181= 1): ABORTING region server hemera.apache.org,51601,1347999502333: Aborting > 2012-09-18 20:18:30,050 FATAL [Thread-604] regionserver.HRegionServer(181= 8): RegionServer abort: loaded coprocessors are: [] > 2012-09-18 20:18:30,054 INFO [Thread-604] regionserver.HRegionServer(182= 1): Dump of metrics: requestsPerSecond=3D0, numberOfOnlineRegions=3D3, numb= erOfStores=3D3, numberOfStorefiles=3D0, storefileIndexSizeMB=3D0, rootIndex= SizeKB=3D0, totalStaticIndexSizeKB=3D0, totalStaticBloomSizeKB=3D0, memstor= eSizeMB=3D0, mbInMemoryWithoutWAL=3D0, numberOfPutsWithoutWAL=3D0, readRequ= estsCount=3D0, writeRequestsCount=3D0, compactionQueueSize=3D0, flushQueueS= ize=3D0, usedHeapMB=3D167, maxHeapMB=3D1688, blockCacheSizeMB=3D1.98, block= CacheFreeMB=3D420.25, blockCacheCount=3D1, blockCacheHitCount=3D41, blockCa= cheMissCount=3D1, blockCacheEvictedCount=3D0, blockCacheHitRatio=3D97%, blo= ckCacheHitCachingRatio=3D97%, hdfsBlocksLocalityIndex=3D0, slowHLogAppendCo= unt=3D0, fsReadLatencyHistogramMean=3D0, fsReadLatencyHistogramCount=3D0, f= sReadLatencyHistogramMedian=3D0, fsReadLatencyHistogram75th=3D0, fsReadLate= ncyHistogram95th=3D0, fsReadLatencyHistogram99th=3D0, fsReadLatencyHistogra= m999th=3D0, fsPreadLatencyHistogramMean=3D0, fsPreadLatencyHistogramCount= =3D0, fsPreadLatencyHistogramMedian=3D0, fsPreadLatencyHistogram75th=3D0, f= sPreadLatencyHistogram95th=3D0, fsPreadLatencyHistogram99th=3D0, fsPreadLat= encyHistogram999th=3D0, fsWriteLatencyHistogramMean=3D0, fsWriteLatencyHist= ogramCount=3D0, fsWriteLatencyHistogramMedian=3D0, fsWriteLatencyHistogram7= 5th=3D0, fsWriteLatencyHistogram95th=3D0, fsWriteLatencyHistogram99th=3D0, = fsWriteLatencyHistogram999th=3D0 > 2012-09-18 20:18:30,056 ERROR [IPC Server handler 0 on 35050] master.HMas= ter(1193): Region server ��hemera.apache.org,51601,1347999502333 repo= rted a fatal error: > ABORTING region server hemera.apache.org,51601,1347999502333: Aborting > 2012-09-18 20:18:30,058 INFO [Thread-604] regionserver.HRegionServer(173= 7): STOPPED: Aborting > 2012-09-18 20:18:30,058 FATAL [Thread-604] regionserver.HRegionServer(181= 1): ABORTING region server hemera.apache.org,43875,1347999502347: Aborting > 2012-09-18 20:18:30,058 FATAL [Thread-604] regionserver.HRegionServer(181= 8): RegionServer abort: loaded coprocessors are: [] > 2012-09-18 20:18:30,062 INFO [Thread-604] regionserver.HRegionServer(182= 1): Dump of metrics: requestsPerSecond=3D0, numberOfOnlineRegions=3D7, numb= erOfStores=3D7, numberOfStorefiles=3D0, storefileIndexSizeMB=3D0, rootIndex= SizeKB=3D0, totalStaticIndexSizeKB=3D0, totalStaticBloomSizeKB=3D0, memstor= eSizeMB=3D0, mbInMemoryWithoutWAL=3D0, numberOfPutsWithoutWAL=3D0, readRequ= estsCount=3D0, writeRequestsCount=3D0, compactionQueueSize=3D0, flushQueueS= ize=3D0, usedHeapMB=3D167, maxHeapMB=3D1688, blockCacheSizeMB=3D1.98, block= CacheFreeMB=3D420.25, blockCacheCount=3D1, blockCacheHitCount=3D41, blockCa= cheMissCount=3D1, blockCacheEvictedCount=3D0, blockCacheHitRatio=3D97%, blo= ckCacheHitCachingRatio=3D97%, hdfsBlocksLocalityIndex=3D0, slowHLogAppendCo= unt=3D0, fsReadLatencyHistogramMean=3D0, fsReadLatencyHistogramCount=3D0, f= sReadLatencyHistogramMedian=3D0, fsReadLatencyHistogram75th=3D0, fsReadLate= ncyHistogram95th=3D0, fsReadLatencyHistogram99th=3D0, fsReadLatencyHistogra= m999th=3D0, fsPreadLatencyHistogramMean=3D0, fsPreadLatencyHistogramCount= =3D0, fsPreadLatencyHistogramMedian=3D0, fsPreadLatencyHistogram75th=3D0, f= sPreadLatencyHistogram95th=3D0, fsPreadLatencyHistogram99th=3D0, fsPreadLat= encyHistogram999th=3D0, fsWriteLatencyHistogramMean=3D0, fsWriteLatencyHist= ogramCount=3D0, fsWriteLatencyHistogramMedian=3D0, fsWriteLatencyHistogram7= 5th=3D0, fsWriteLatencyHistogram95th=3D0, fsWriteLatencyHistogram99th=3D0, = fsWriteLatencyHistogram999th=3D0 > 2012-09-18 20:18:30,062 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.SplitLogWorker(522): Sending interrupt to stop the= worker thread > 2012-09-18 20:18:30,063 INFO [SplitLogWorker-hemera.apache.org,51601,134= 7999502333] regionserver.SplitLogWorker(206): SplitLogWorker interrupted wh= ile waiting for task, exiting: java.lang.InterruptedException > 2012-09-18 20:18:30,063 INFO [SplitLogWorker-hemera.apache.org,51601,134= 7999502333] regionserver.SplitLogWorker(170): SplitLogWorker hemera.apache.= org,51601,1347999502333 exiting > 2012-09-18 20:18:30,063 ERROR [IPC Server handler 1 on 35050] master.HMas= ter(1193): Region server ��hemera.apache.org,43875,1347999502347 repo= rted a fatal error: > ABORTING region server hemera.apache.org,43875,1347999502347: Aborting > 2012-09-18 20:18:30,063 INFO [Thread-604] regionserver.HRegionServer(173= 7): STOPPED: Aborting > 2012-09-18 20:18:30,063 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333.compactionChecker] hbase.Chore(81): RegionServer:1;hemera.apache= .org,51601,1347999502333.compactionChecker exiting > 2012-09-18 20:18:30,063 FATAL [Thread-604] regionserver.HRegionServer(181= 1): ABORTING region server hemera.apache.org,58959,1347999502361: Aborting > 2012-09-18 20:18:30,063 DEBUG [pool-1-thread-1.LruBlockCache.EvictionThre= ad] hfile.LruBlockCache(418): Block cache LRU eviction started; Attempting = to free -408721.95 KB of total=3D1.98 MB > 2012-09-18 20:18:30,063 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333.cacheFlusher] regionserver.MemStoreFlusher(264): RegionServer:1;= hemera.apache.org,51601,1347999502333.cacheFlusher exiting > 2012-09-18 20:18:30,064 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-0] handler.CloseRegionHandler(124): Processing close of t,lll,1= 347999506678.1c1644d5428c228bace562ef1bed5118. > 2012-09-18 20:18:30,063 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333.logRoller] regionserver.LogRoller(118): LogRoller exiting. > 2012-09-18 20:18:30,064 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-0] regionserver.HRegion(954): Closing t,lll,1347999506678.1c164= 4d5428c228bace562ef1bed5118.: disabling compactions & flushes > 2012-09-18 20:18:30,064 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.HRegionServer(943): aborting server hemera.apache.= org,51601,1347999502333 > 2012-09-18 20:18:30,064 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.SplitLogWorker(522): Sending interrupt to stop the= worker thread > 2012-09-18 20:18:30,064 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-1] handler.CloseRegionHandler(124): Processing close of t,iii,1= 347999506669.ae0257433f2941163b1d397f3d4f6efc. > 2012-09-18 20:18:30,065 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347.cacheFlusher] regionserver.MemStoreFlusher(264): RegionServer:2;= hemera.apache.org,43875,1347999502347.cacheFlusher exiting > 2012-09-18 20:18:30,065 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347.logRoller] regionserver.LogRoller(118): LogRoller exiting. > 2012-09-18 20:18:30,065 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347.compactionChecker] hbase.Chore(81): RegionServer:2;hemera.apache= .org,43875,1347999502347.compactionChecker exiting > 2012-09-18 20:18:30,063 FATAL [Thread-604] regionserver.HRegionServer(181= 8): RegionServer abort: loaded coprocessors are: [] > 2012-09-18 20:18:30,065 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] handler.CloseRegionHandler(124): Processing close of t,eee,1= 347999506656.3b9d9fdc58f2319931d38a906c8a1289. > 2012-09-18 20:18:30,065 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-1] regionserver.HRegion(954): Closing t,iii,1347999506669.ae025= 7433f2941163b1d397f3d4f6efc.: disabling compactions & flushes > 2012-09-18 20:18:30,067 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(954): Closing t,eee,1347999506656.3b9d9= fdc58f2319931d38a906c8a1289.: disabling compactions & flushes > 2012-09-18 20:18:30,065 INFO [SplitLogWorker-hemera.apache.org,43875,134= 7999502347] regionserver.SplitLogWorker(206): SplitLogWorker interrupted wh= ile waiting for task, exiting: java.lang.InterruptedException > 2012-09-18 20:18:30,067 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.HRegionServer(943): aborting server hemera.apache.= org,43875,1347999502347 > 2012-09-18 20:18:30,067 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347] catalog.CatalogTracker(257): Stopping catalog tracker org.apach= e.hadoop.hbase.catalog.CatalogTracker@11a59ce > 2012-09-18 20:18:30,064 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333] catalog.CatalogTracker(257): Stopping catalog tracker org.apach= e.hadoop.hbase.catalog.CatalogTracker@f7bf2d > 2012-09-18 20:18:30,064 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-0] regionserver.HRegion(975): Updates disabled for region t,lll= ,1347999506678.1c1644d5428c228bace562ef1bed5118. > 2012-09-18 20:18:30,064 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-2] handler.CloseRegionHandler(124): Processing close of t,ttt,1= 347999506703.73c7f7079688e986da1850e53fb74f9d. > 2012-09-18 20:18:30,067 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] client.HConnectionManager$HConnectionImplementation(1523): Clos= ing zookeeper sessionid=3D0x139db080e690009 > 2012-09-18 20:18:30,067 INFO [Thread-604] regionserver.HRegionServer(182= 1): Dump of metrics: requestsPerSecond=3D0, numberOfOnlineRegions=3D4, numb= erOfStores=3D4, numberOfStorefiles=3D0, storefileIndexSizeMB=3D0, rootIndex= SizeKB=3D0, totalStaticIndexSizeKB=3D0, totalStaticBloomSizeKB=3D0, memstor= eSizeMB=3D0, mbInMemoryWithoutWAL=3D0, numberOfPutsWithoutWAL=3D0, readRequ= estsCount=3D0, writeRequestsCount=3D0, compactionQueueSize=3D0, flushQueueS= ize=3D0, usedHeapMB=3D168, maxHeapMB=3D1688, blockCacheSizeMB=3D1.98, block= CacheFreeMB=3D420.25, blockCacheCount=3D1, blockCacheHitCount=3D41, blockCa= cheMissCount=3D1, blockCacheEvictedCount=3D0, blockCacheHitRatio=3D97%, blo= ckCacheHitCachingRatio=3D97%, hdfsBlocksLocalityIndex=3D0, slowHLogAppendCo= unt=3D0, fsReadLatencyHistogramMean=3D0, fsReadLatencyHistogramCount=3D0, f= sReadLatencyHistogramMedian=3D0, fsReadLatencyHistogram75th=3D0, fsReadLate= ncyHistogram95th=3D0, fsReadLatencyHistogram99th=3D0, fsReadLatencyHistogra= m999th=3D0, fsPreadLatencyHistogramMean=3D0, fsPreadLatencyHistogramCount= =3D0, fsPreadLatencyHistogramMedian=3D0, fsPreadLatencyHistogram75th=3D0, f= sPreadLatencyHistogram95th=3D0, fsPreadLatencyHistogram99th=3D0, fsPreadLat= encyHistogram999th=3D0, fsWriteLatencyHistogramMean=3D0, fsWriteLatencyHist= ogramCount=3D0, fsWriteLatencyHistogramMedian=3D0, fsWriteLatencyHistogram7= 5th=3D0, fsWriteLatencyHistogram95th=3D0, fsWriteLatencyHistogram99th=3D0, = fsWriteLatencyHistogram999th=3D0 > 2012-09-18 20:18:30,067 INFO [SplitLogWorker-hemera.apache.org,43875,134= 7999502347] regionserver.SplitLogWorker(170): SplitLogWorker hemera.apache.= org,43875,1347999502347 exiting > 2012-09-18 20:18:30,067 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(975): Updates disabled for region t,eee= ,1347999506656.3b9d9fdc58f2319931d38a906c8a1289. > 2012-09-18 20:18:30,067 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] handler.CloseRegionHandler(124): Processing close of t,kkk,1= 347999506675.d91c2dc99d3bac1d51686c9a6b4e74aa. > 2012-09-18 20:18:30,069 ERROR [IPC Server handler 3 on 35050] master.HMas= ter(1193): Region server ��hemera.apache.org,58959,1347999502361 repo= rted a fatal error: > ABORTING region server hemera.apache.org,58959,1347999502361: Aborting > 2012-09-18 20:18:30,069 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(954): Closing t,kkk,1347999506675.d91c2= dc99d3bac1d51686c9a6b4e74aa.: disabling compactions & flushes > 2012-09-18 20:18:30,067 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-1] regionserver.HRegion(975): Updates disabled for region t,iii= ,1347999506669.ae0257433f2941163b1d397f3d4f6efc. > 2012-09-18 20:18:30,066 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] handler.CloseRegionHandler(124): Processing close of t,fff,1= 347999506661.7d7428c069f7e46b3ded4161a6d8d961. > 2012-09-18 20:18:30,070 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] client.HConnectionManager$HConnectionImplementation(1523): Clos= ing zookeeper sessionid=3D0x139db080e690007 > 2012-09-18 20:18:30,070 INFO [Thread-604] regionserver.HRegionServer(173= 7): STOPPED: Aborting > 2012-09-18 20:18:30,070 INFO [StoreCloserThread-t,iii,1347999506669.ae02= 57433f2941163b1d397f3d4f6efc.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,070 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(975): Updates disabled for region t,kkk= ,1347999506675.d91c2dc99d3bac1d51686c9a6b4e74aa. > 2012-09-18 20:18:30,070 INFO [StoreCloserThread-t,eee,1347999506656.3b9d= 9fdc58f2319931d38a906c8a1289.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,071 INFO [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-1] regionserver.HRegion(1023): Closed t,iii,1347999506669.ae025= 7433f2941163b1d397f3d4f6efc. > 2012-09-18 20:18:30,068 INFO [StoreCloserThread-t,lll,1347999506678.1c16= 44d5428c228bace562ef1bed5118.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,071 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-1] handler.CloseRegionHandler(168): Closed region t,iii,1347999= 506669.ae0257433f2941163b1d397f3d4f6efc. > 2012-09-18 20:18:30,071 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(1023): Closed t,eee,1347999506656.3b9d9= fdc58f2319931d38a906c8a1289. > 2012-09-18 20:18:30,068 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-2] regionserver.HRegion(954): Closing t,ttt,1347999506703.73c7f= 7079688e986da1850e53fb74f9d.: disabling compactions & flushes > 2012-09-18 20:18:30,071 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] handler.CloseRegionHandler(168): Closed region t,eee,1347999= 506656.3b9d9fdc58f2319931d38a906c8a1289. > 2012-09-18 20:18:30,071 INFO [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-0] regionserver.HRegion(1023): Closed t,lll,1347999506678.1c164= 4d5428c228bace562ef1bed5118. > 2012-09-18 20:18:30,071 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.HRegionServer(1091): Waiting on 2 regions to close > 2012-09-18 20:18:30,071 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.HRegionServer(1095): {73c7f7079688e986da1850e53fb7= 4f9d=3Dt,ttt,1347999506703.73c7f7079688e986da1850e53fb74f9d.} > 2012-09-18 20:18:30,071 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.SplitLogWorker(522): Sending interrupt to stop the= worker thread > 2012-09-18 20:18:30,070 INFO [Thread-604] hbase.TestDrainingServer(239):= Regions of drained server are: [t,yyy,1347999506717.bdd1a3ab3105de63248038= bd0eb40564.] > 2012-09-18 20:18:30,072 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361.cacheFlusher] regionserver.MemStoreFlusher(264): RegionServer:3;= hemera.apache.org,58959,1347999502361.cacheFlusher exiting > 2012-09-18 20:18:30,070 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] regionserver.HRegion(954): Closing t,fff,1347999506661.7d742= 8c069f7e46b3ded4161a6d8d961.: disabling compactions & flushes > 2012-09-18 20:18:30,072 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] handler.CloseRegionHandler(124): Processing close of t,ggg,1= 347999506664.b48b882c9992c9773e9bfda020d2137c. > 2012-09-18 20:18:30,070 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.HRegionServer(1091): Waiting on 8 regions to close > 2012-09-18 20:18:30,072 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] regionserver.HRegion(954): Closing t,ggg,1347999506664.b48b8= 82c9992c9773e9bfda020d2137c.: disabling compactions & flushes > 2012-09-18 20:18:30,072 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] handler.CloseRegionHandler(124): Processing close of t,hhh,1= 347999506667.5a1faf1d76da0300d16f9c8dbb752824. > 2012-09-18 20:18:30,072 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] regionserver.HRegion(975): Updates disabled for region t,ggg= ,1347999506664.b48b882c9992c9773e9bfda020d2137c. > 2012-09-18 20:18:30,073 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] regionserver.HRegion(954): Closing t,hhh,1347999506667.5a1fa= f1d76da0300d16f9c8dbb752824.: disabling compactions & flushes > 2012-09-18 20:18:30,072 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] handler.CloseRegionHandler(124): Processing close of t,www,1= 347999506711.985b3c0de2cbfe789c69850bb128887d. > 2012-09-18 20:18:30,073 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeDeleted, state=3DSyncConnected, path=3D/hbase/draining/hemera.= apache.org,33334,1347999502311 > 2012-09-18 20:18:30,072 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] regionserver.HRegion(975): Updates disabled for region t,fff= ,1347999506661.7d7428c069f7e46b3ded4161a6d8d961. > 2012-09-18 20:18:30,073 INFO [StoreCloserThread-t,ggg,1347999506664.b48b= 882c9992c9773e9bfda020d2137c.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,072 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361.compactionChecker] hbase.Chore(81): RegionServer:3;hemera.apache= .org,58959,1347999502361.compactionChecker exiting > 2012-09-18 20:18:30,073 INFO [StoreCloserThread-t,fff,1347999506661.7d74= 28c069f7e46b3ded4161a6d8d961.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,073 INFO [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] regionserver.HRegion(1023): Closed t,ggg,1347999506664.b48b8= 82c9992c9773e9bfda020d2137c. > 2012-09-18 20:18:30,075 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] regionserver.HRegion(1023): Closed t,fff,1347999506661.7d742= 8c069f7e46b3ded4161a6d8d961. > 2012-09-18 20:18:30,075 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] handler.CloseRegionHandler(168): Closed region t,ggg,1347999= 506664.b48b882c9992c9773e9bfda020d2137c. > 2012-09-18 20:18:30,072 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361.logRoller] regionserver.LogRoller(118): LogRoller exiting. > 2012-09-18 20:18:30,072 INFO [SplitLogWorker-hemera.apache.org,58959,134= 7999502361] regionserver.SplitLogWorker(206): SplitLogWorker interrupted wh= ile waiting for task, exiting: java.lang.InterruptedException > 2012-09-18 20:18:30,071 INFO [StoreCloserThread-t,kkk,1347999506675.d91c= 2dc99d3bac1d51686c9a6b4e74aa.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,076 INFO [SplitLogWorker-hemera.apache.org,58959,134= 7999502361] regionserver.SplitLogWorker(170): SplitLogWorker hemera.apache.= org,58959,1347999502361 exiting > 2012-09-18 20:18:30,076 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(1023): Closed t,kkk,1347999506675.d91c2= dc99d3bac1d51686c9a6b4e74aa. > 2012-09-18 20:18:30,071 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-0] handler.CloseRegionHandler(168): Closed region t,lll,1347999= 506678.1c1644d5428c228bace562ef1bed5118. > 2012-09-18 20:18:30,071 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] handler.CloseRegionHandler(124): Processing close of t,sss,1= 347999506698.c1e5810326004add2ab532ccc9e8c24e. > 2012-09-18 20:18:30,071 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-2] regionserver.HRegion(975): Updates disabled for region t,ttt= ,1347999506703.73c7f7079688e986da1850e53fb74f9d. > 2012-09-18 20:18:30,079 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] handler.CloseRegionHandler(168): Closed region t,kkk,1347999= 506675.d91c2dc99d3bac1d51686c9a6b4e74aa. > 2012-09-18 20:18:30,079 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] handler.CloseRegionHandler(124): Processing close of t,,1347= 999506624.6b45157a30794a82fc5cbdb3589032e2. > 2012-09-18 20:18:30,078 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(954): Closing t,sss,1347999506698.c1e58= 10326004add2ab532ccc9e8c24e.: disabling compactions & flushes > 2012-09-18 20:18:30,076 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] handler.CloseRegionHandler(124): Processing close of t,nnn,1= 347999506684.a2e6ab866441d82e1124ad6dcaf7fa03. > 2012-09-18 20:18:30,075 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] handler.CloseRegionHandler(168): Closed region t,fff,1347999= 506661.7d7428c069f7e46b3ded4161a6d8d961. > 2012-09-18 20:18:30,079 INFO [StoreCloserThread-t,ttt,1347999506703.73c7= f7079688e986da1850e53fb74f9d.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,073 INFO [pool-1-thread-1-EventThread] zookeeper.Dra= iningServerTracker(101): Draining RS node deleted, removing from list [heme= ra.apache.org,33334,1347999502311] > 2012-09-18 20:18:30,084 INFO [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-2] regionserver.HRegion(1023): Closed t,ttt,1347999506703.73c7f= 7079688e986da1850e53fb74f9d. > 2012-09-18 20:18:30,084 INFO [pool-1-thread-1] hbase.ResourceChecker(144= ): after TestDrainingServer#testDrainingServerWithAbort: 348 threads (was 4= 41), 584 file descriptors (was 700). 5 connections (was 7),=20 > 2012-09-18 20:18:30,073 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] regionserver.HRegion(954): Closing t,www,1347999506711.985b3= c0de2cbfe789c69850bb128887d.: disabling compactions & flushes > 2012-09-18 20:18:30,073 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] regionserver.HRegion(975): Updates disabled for region t,hhh= ,1347999506667.5a1faf1d76da0300d16f9c8dbb752824. > 2012-09-18 20:18:30,072 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.HRegionServer(943): aborting server hemera.apache.= org,58959,1347999502361 > 2012-09-18 20:18:30,086 INFO [StoreCloserThread-t,hhh,1347999506667.5a1f= af1d76da0300d16f9c8dbb752824.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,072 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.HRegionServer(1095): {c1e5810326004add2ab532ccc9e8= c24e=3Dt,sss,1347999506698.c1e5810326004add2ab532ccc9e8c24e., 6b45157a30794= a82fc5cbdb3589032e2=3Dt,,1347999506624.6b45157a30794a82fc5cbdb3589032e2., 9= 5255bd4b3285804a2c818d1bf7f459f=3Dt,xxx,1347999506714.95255bd4b3285804a2c81= 8d1bf7f459f., cb765c4343d7b8c707c88b4d4b79a165=3Dt,qqq,1347999506692.cb765c= 4343d7b8c707c88b4d4b79a165., 78622cfb2af5eca037e2375d7566cac6=3Dt,mmm,13479= 99506681.78622cfb2af5eca037e2375d7566cac6.} > 2012-09-18 20:18:30,086 INFO [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] regionserver.HRegion(1023): Closed t,hhh,1347999506667.5a1fa= f1d76da0300d16f9c8dbb752824. > 2012-09-18 20:18:30,086 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] handler.CloseRegionHandler(168): Closed region t,hhh,1347999= 506667.5a1faf1d76da0300d16f9c8dbb752824. > 2012-09-18 20:18:30,086 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] handler.CloseRegionHandler(124): Processing close of t,ooo,1= 347999506686.c4178dd0ed59cff7c16b018f8936b194. > 2012-09-18 20:18:30,086 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361] catalog.CatalogTracker(257): Stopping catalog tracker org.apach= e.hadoop.hbase.catalog.CatalogTracker@1880b02 > 2012-09-18 20:18:30,086 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] regionserver.HRegion(975): Updates disabled for region t,www= ,1347999506711.985b3c0de2cbfe789c69850bb128887d. > 2012-09-18 20:18:30,084 DEBUG [RS_CLOSE_REGION-hemera.apache.org,51601,13= 47999502333-2] handler.CloseRegionHandler(168): Closed region t,ttt,1347999= 506703.73c7f7079688e986da1850e53fb74f9d. > 2012-09-18 20:18:30,084 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeChildrenChanged, state=3DSyncConnected, path=3D/hbase/draining > 2012-09-18 20:18:30,084 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] regionserver.HRegion(954): Closing t,nnn,1347999506684.a2e6a= b866441d82e1124ad6dcaf7fa03.: disabling compactions & flushes > 2012-09-18 20:18:30,081 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] handler.CloseRegionHandler(124): Processing close of t,xxx,1= 347999506714.95255bd4b3285804a2c818d1bf7f459f. > 2012-09-18 20:18:30,090 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] regionserver.HRegion(954): Closing t,xxx,1347999506714.95255= bd4b3285804a2c818d1bf7f459f.: disabling compactions & flushes > 2012-09-18 20:18:30,090 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] regionserver.HRegion(975): Updates disabled for region t,xxx= ,1347999506714.95255bd4b3285804a2c818d1bf7f459f. > 2012-09-18 20:18:30,079 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(975): Updates disabled for region t,sss= ,1347999506698.c1e5810326004add2ab532ccc9e8c24e. > 2012-09-18 20:18:30,079 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(954): Closing t,,1347999506624.6b45157a= 30794a82fc5cbdb3589032e2.: disabling compactions & flushes > 2012-09-18 20:18:30,090 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] regionserver.HRegion(975): Updates disabled for region t,nnn= ,1347999506684.a2e6ab866441d82e1124ad6dcaf7fa03. > 2012-09-18 20:18:30,090 INFO [StoreCloserThread-t,sss,1347999506698.c1e5= 810326004add2ab532ccc9e8c24e.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,090 INFO [StoreCloserThread-t,www,1347999506711.985b= 3c0de2cbfe789c69850bb128887d.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,089 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] client.HConnectionManager$HConnectionImplementation(1523): Clos= ing zookeeper sessionid=3D0x139db080e690008 > 2012-09-18 20:18:30,091 INFO [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] regionserver.HRegion(1023): Closed t,www,1347999506711.985b3= c0de2cbfe789c69850bb128887d. > 2012-09-18 20:18:30,091 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] handler.CloseRegionHandler(168): Closed region t,www,1347999= 506711.985b3c0de2cbfe789c69850bb128887d. > 2012-09-18 20:18:30,091 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] handler.CloseRegionHandler(124): Processing close of t,rrr,1= 347999506695.29ca9f1226c85d9ad4523735386186da. > 2012-09-18 20:18:30,089 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] regionserver.HRegion(954): Closing t,ooo,1347999506686.c4178= dd0ed59cff7c16b018f8936b194.: disabling compactions & flushes > 2012-09-18 20:18:30,091 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] regionserver.HRegion(975): Updates disabled for region t,ooo= ,1347999506686.c4178dd0ed59cff7c16b018f8936b194. > 2012-09-18 20:18:30,091 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] regionserver.HRegion(954): Closing t,rrr,1347999506695.29ca9= f1226c85d9ad4523735386186da.: disabling compactions & flushes > 2012-09-18 20:18:30,091 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] regionserver.HRegion(975): Updates disabled for region t,rrr= ,1347999506695.29ca9f1226c85d9ad4523735386186da. > 2012-09-18 20:18:30,091 INFO [StoreCloserThread-t,nnn,1347999506684.a2e6= ab866441d82e1124ad6dcaf7fa03.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,092 INFO [StoreCloserThread-t,rrr,1347999506695.29ca= 9f1226c85d9ad4523735386186da.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,092 INFO [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] regionserver.HRegion(1023): Closed t,nnn,1347999506684.a2e6a= b866441d82e1124ad6dcaf7fa03. > 2012-09-18 20:18:30,092 INFO [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] regionserver.HRegion(1023): Closed t,rrr,1347999506695.29ca9= f1226c85d9ad4523735386186da. > 2012-09-18 20:18:30,092 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-0] handler.CloseRegionHandler(168): Closed region t,nnn,1347999= 506684.a2e6ab866441d82e1124ad6dcaf7fa03. > 2012-09-18 20:18:30,091 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(1023): Closed t,sss,1347999506698.c1e58= 10326004add2ab532ccc9e8c24e. > 2012-09-18 20:18:30,092 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] handler.CloseRegionHandler(168): Closed region t,sss,1347999= 506698.c1e5810326004add2ab532ccc9e8c24e. > 2012-09-18 20:18:30,092 INFO [pool-1-thread-1] hbase.HBaseTestingUtility= (747): Shutting down minicluster > 2012-09-18 20:18:30,092 DEBUG [pool-1-thread-1] util.JVMClusterUtil(223):= Shutting down HBase Cluster > 2012-09-18 20:18:30,090 INFO [StoreCloserThread-t,xxx,1347999506714.9525= 5bd4b3285804a2c818d1bf7f459f.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,090 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(975): Updates disabled for region t,,13= 47999506624.6b45157a30794a82fc5cbdb3589032e2. > 2012-09-18 20:18:30,093 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] regionserver.HRegion(1023): Closed t,xxx,1347999506714.95255= bd4b3285804a2c818d1bf7f459f. > 2012-09-18 20:18:30,092 INFO [pool-1-thread-1] master.HMaster(2049): Clu= ster shutdown requested > 2012-09-18 20:18:30,092 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] handler.CloseRegionHandler(124): Processing close of t,qqq,1= 347999506692.cb765c4343d7b8c707c88b4d4b79a165. > 2012-09-18 20:18:30,093 INFO [StoreCloserThread-t,,1347999506624.6b45157= a30794a82fc5cbdb3589032e2.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,092 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-1] handler.CloseRegionHandler(168): Closed region t,rrr,1347999= 506695.29ca9f1226c85d9ad4523735386186da. > 2012-09-18 20:18:30,093 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(1023): Closed t,,1347999506624.6b45157a= 30794a82fc5cbdb3589032e2. > 2012-09-18 20:18:30,092 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.CompactSplitThread(253): Waiting for Split Thread = to finish... > 2012-09-18 20:18:30,093 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.CompactSplitThread(253): Waiting for Large Compact= ion Thread to finish... > 2012-09-18 20:18:30,091 INFO [StoreCloserThread-t,ooo,1347999506686.c417= 8dd0ed59cff7c16b018f8936b194.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,093 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.CompactSplitThread(253): Waiting for Small Compact= ion Thread to finish... > 2012-09-18 20:18:30,094 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311-EventThread] zookeeper.ZooKeeperWatcher(265): regionserver:33334= -0x139db080e690002 Received ZooKeeper Event, type=3DNodeDeleted, state=3DSy= ncConnected, path=3D/hbase/shutdown > 2012-09-18 20:18:30,093 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] handler.CloseRegionHandler(168): Closed region t,,1347999506= 624.6b45157a30794a82fc5cbdb3589032e2. > 2012-09-18 20:18:30,093 INFO [hemera.apache.org,35050,1347999502111-Cata= logJanitor] hbase.Chore(81): hemera.apache.org,35050,1347999502111-CatalogJ= anitor exiting > 2012-09-18 20:18:30,093 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(954): Closing t,qqq,1347999506692.cb765= c4343d7b8c707c88b4d4b79a165.: disabling compactions & flushes > 2012-09-18 20:18:30,093 INFO [Master:0;hemera.apache.org,35050,134799950= 2111] master.ServerManager(398): Waiting on regionserver(s) to go down heme= ra.apache.org,38814,1347999502374, hemera.apache.org,58959,1347999502361, h= emera.apache.org,43875,1347999502347, hemera.apache.org,33334,1347999502311= , hemera.apache.org,51601,1347999502333 > 2012-09-18 20:18:30,093 INFO [hemera.apache.org,35050,1347999502111-Bala= ncerChore] hbase.Chore(81): hemera.apache.org,35050,1347999502111-BalancerC= hore exiting > 2012-09-18 20:18:30,093 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-1] handler.CloseRegionHandler(168): Closed region t,xxx,1347999= 506714.95255bd4b3285804a2c818d1bf7f459f. > 2012-09-18 20:18:30,094 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(975): Updates disabled for region t,qqq= ,1347999506692.cb765c4343d7b8c707c88b4d4b79a165. > 2012-09-18 20:18:30,094 DEBUG [RS_CLOSE_ROOT-hemera.apache.org,58959,1347= 999502361-0] handler.CloseRegionHandler(124): Processing close of -ROOT-,,0= .70236052 > 2012-09-18 20:18:30,094 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.HRegionServer(1091): Waiting on 2 regions to close > 2012-09-18 20:18:30,094 INFO [StoreCloserThread-t,qqq,1347999506692.cb76= 5c4343d7b8c707c88b4d4b79a165.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,094 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] handler.CloseRegionHandler(124): Processing close of t,mmm,1= 347999506681.78622cfb2af5eca037e2375d7566cac6. > 2012-09-18 20:18:30,095 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] regionserver.HRegion(1023): Closed t,qqq,1347999506692.cb765= c4343d7b8c707c88b4d4b79a165. > 2012-09-18 20:18:30,094 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361-EventThread] zookeeper.ZooKeeperWatcher(265): regionserver:58959= -0x139db080e690005 Received ZooKeeper Event, type=3DNodeDeleted, state=3DSy= ncConnected, path=3D/hbase/shutdown > 2012-09-18 20:18:30,094 INFO [pool-1-thread-1] regionserver.HRegionServe= r(1737): STOPPED: Shutdown requested > 2012-09-18 20:18:30,094 INFO [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] regionserver.HRegion(1023): Closed t,ooo,1347999506686.c4178= dd0ed59cff7c16b018f8936b194. > 2012-09-18 20:18:30,094 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333-EventThread] zookeeper.ZooKeeperWatcher(265): regionserver:51601= -0x139db080e690001 Received ZooKeeper Event, type=3DNodeDeleted, state=3DSy= ncConnected, path=3D/hbase/shutdown > 2012-09-18 20:18:30,093 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374-EventThread] zookeeper.ZooKeeperWatcher(265): regionserver:38814= -0x139db080e690003 Received ZooKeeper Event, type=3DNodeDeleted, state=3DSy= ncConnected, path=3D/hbase/shutdown > 2012-09-18 20:18:30,093 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347-EventThread] zookeeper.ZooKeeperWatcher(265): regionserver:43875= -0x139db080e690004 Received ZooKeeper Event, type=3DNodeDeleted, state=3DSy= ncConnected, path=3D/hbase/shutdown > 2012-09-18 20:18:30,093 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeDeleted, state=3DSyncConnected, path=3D/hbase/shutdown > 2012-09-18 20:18:30,095 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361-EventThread] zookeeper.ZKUtil(237): regionserver:58959-0x139db08= 0e690005 /hbase/shutdown does not exist. Watcher is set. > 2012-09-18 20:18:30,095 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374-EventThread] zookeeper.ZKUtil(237): regionserver:38814-0x139db08= 0e690003 /hbase/shutdown does not exist. Watcher is set. > 2012-09-18 20:18:30,095 DEBUG [RS_CLOSE_REGION-hemera.apache.org,58959,13= 47999502361-2] handler.CloseRegionHandler(168): Closed region t,ooo,1347999= 506686.c4178dd0ed59cff7c16b018f8936b194. > 2012-09-18 20:18:30,095 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-0] handler.CloseRegionHandler(168): Closed region t,qqq,1347999= 506692.cb765c4343d7b8c707c88b4d4b79a165. > 2012-09-18 20:18:30,096 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(237): master:35050-0x139db080e690000 /hbase/shutdown does not exist. Wa= tcher is set. > 2012-09-18 20:18:30,095 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(954): Closing t,mmm,1347999506681.78622= cfb2af5eca037e2375d7566cac6.: disabling compactions & flushes > 2012-09-18 20:18:30,094 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.HRegionServer(1095): {70236052=3D-ROOT-,,0.7023605= 2} > 2012-09-18 20:18:30,094 DEBUG [RS_CLOSE_ROOT-hemera.apache.org,58959,1347= 999502361-0] regionserver.HRegion(954): Closing -ROOT-,,0.70236052: disabli= ng compactions & flushes > 2012-09-18 20:18:30,094 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311-EventThread] zookeeper.ZKUtil(237): regionserver:33334-0x139db08= 0e690002 /hbase/shutdown does not exist. Watcher is set. > 2012-09-18 20:18:30,096 DEBUG [RS_CLOSE_ROOT-hemera.apache.org,58959,1347= 999502361-0] regionserver.HRegion(975): Updates disabled for region -ROOT-,= ,0.70236052 > 2012-09-18 20:18:30,096 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(975): Updates disabled for region t,mmm= ,1347999506681.78622cfb2af5eca037e2375d7566cac6. > 2012-09-18 20:18:30,096 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347-EventThread] zookeeper.ZKUtil(237): regionserver:43875-0x139db08= 0e690004 /hbase/shutdown does not exist. Watcher is set. > 2012-09-18 20:18:30,095 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.SplitLogWorker(522): Sending interrupt to stop the= worker thread > 2012-09-18 20:18:30,096 INFO [StoreCloserThread-t,mmm,1347999506681.7862= 2cfb2af5eca037e2375d7566cac6.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,098 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311.cacheFlusher] regionserver.MemStoreFlusher(264): RegionServer:0;= hemera.apache.org,33334,1347999502311.cacheFlusher exiting > 2012-09-18 20:18:30,098 INFO [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] regionserver.HRegion(1023): Closed t,mmm,1347999506681.78622= cfb2af5eca037e2375d7566cac6. > 2012-09-18 20:18:30,098 INFO [StoreCloserThread--ROOT-,,0.70236052-1] re= gionserver.HStore(635): Closed info > 2012-09-18 20:18:30,095 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333-EventThread] zookeeper.ZKUtil(237): regionserver:51601-0x139db08= 0e690001 /hbase/shutdown does not exist. Watcher is set. > 2012-09-18 20:18:30,098 INFO [RS_CLOSE_ROOT-hemera.apache.org,58959,1347= 999502361-0] regionserver.HRegion(1023): Closed -ROOT-,,0.70236052 > 2012-09-18 20:18:30,098 DEBUG [RS_CLOSE_REGION-hemera.apache.org,43875,13= 47999502347-2] handler.CloseRegionHandler(168): Closed region t,mmm,1347999= 506681.78622cfb2af5eca037e2375d7566cac6. > 2012-09-18 20:18:30,098 DEBUG [RS_CLOSE_REGION-hemera.apache.org,33334,13= 47999502311-0] handler.CloseRegionHandler(124): Processing close of t,yyy,1= 347999506717.bdd1a3ab3105de63248038bd0eb40564. > 2012-09-18 20:18:30,098 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311.compactionChecker] hbase.Chore(81): RegionServer:0;hemera.apache= .org,33334,1347999502311.compactionChecker exiting > 2012-09-18 20:18:30,098 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311.logRoller] regionserver.LogRoller(118): LogRoller exiting. > 2012-09-18 20:18:30,098 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.HRegionServer(947): stopping server hemera.apache.= org,33334,1347999502311 > 2012-09-18 20:18:30,098 INFO [SplitLogWorker-hemera.apache.org,33334,134= 7999502311] regionserver.SplitLogWorker(206): SplitLogWorker interrupted wh= ile waiting for task, exiting: java.lang.InterruptedException > 2012-09-18 20:18:30,098 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311] catalog.CatalogTracker(257): Stopping catalog tracker org.apach= e.hadoop.hbase.catalog.CatalogTracker@5afcb1 > 2012-09-18 20:18:30,098 DEBUG [RS_CLOSE_REGION-hemera.apache.org,33334,13= 47999502311-0] regionserver.HRegion(954): Closing t,yyy,1347999506717.bdd1a= 3ab3105de63248038bd0eb40564.: disabling compactions & flushes > 2012-09-18 20:18:30,098 DEBUG [RS_CLOSE_ROOT-hemera.apache.org,58959,1347= 999502361-0] handler.CloseRegionHandler(168): Closed region -ROOT-,,0.70236= 052 > 2012-09-18 20:18:30,099 DEBUG [RS_CLOSE_REGION-hemera.apache.org,33334,13= 47999502311-0] regionserver.HRegion(975): Updates disabled for region t,yyy= ,1347999506717.bdd1a3ab3105de63248038bd0eb40564. > 2012-09-18 20:18:30,099 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] client.HConnectionManager$HConnectionImplementation(1523): Clos= ing zookeeper sessionid=3D0x139db080e69000b > 2012-09-18 20:18:30,099 INFO [SplitLogWorker-hemera.apache.org,33334,134= 7999502311] regionserver.SplitLogWorker(170): SplitLogWorker hemera.apache.= org,33334,1347999502311 exiting > 2012-09-18 20:18:30,099 INFO [StoreCloserThread-t,yyy,1347999506717.bdd1= a3ab3105de63248038bd0eb40564.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,099 INFO [RS_CLOSE_REGION-hemera.apache.org,33334,13= 47999502311-0] regionserver.HRegion(1023): Closed t,yyy,1347999506717.bdd1a= 3ab3105de63248038bd0eb40564. > 2012-09-18 20:18:30,100 DEBUG [RS_CLOSE_REGION-hemera.apache.org,33334,13= 47999502311-0] handler.CloseRegionHandler(168): Closed region t,yyy,1347999= 506717.bdd1a3ab3105de63248038bd0eb40564. > 2012-09-18 20:18:30,100 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.HRegionServer(966): stopping server hemera.apache.= org,33334,1347999502311; all regions closed. > 2012-09-18 20:18:30,100 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311.logSyncer] wal.HLog$LogSyncer(1245): RegionServer:0;hemera.apach= e.org,33334,1347999502311.logSyncer exiting > 2012-09-18 20:18:30,100 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311] wal.HLog(1007): closing hlog writer in hdfs://localhost:52077/u= ser/jenkins/hbase/.logs/hemera.apache.org,33334,1347999502311 > 2012-09-18 20:18:30,272 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.HRegionServer(966): stopping server hemera.apache.= org,51601,1347999502333; all regions closed. > 2012-09-18 20:18:30,272 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333.logSyncer] wal.HLog$LogSyncer(1245): RegionServer:1;hemera.apach= e.org,51601,1347999502333.logSyncer exiting > 2012-09-18 20:18:30,272 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333] wal.HLog(1007): closing hlog writer in hdfs://localhost:52077/u= ser/jenkins/hbase/.logs/hemera.apache.org,51601,1347999502333 > 2012-09-18 20:18:30,284 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311.leaseChecker] regionserver.Leases(123): RegionServer:0;hemera.ap= ache.org,33334,1347999502311.leaseChecker closing leases > 2012-09-18 20:18:30,284 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311.leaseChecker] regionserver.Leases(130): RegionServer:0;hemera.ap= ache.org,33334,1347999502311.leaseChecker closed leases > 2012-09-18 20:18:30,285 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333.leaseChecker] regionserver.Leases(123): RegionServer:1;hemera.ap= ache.org,51601,1347999502333.leaseChecker closing leases > 2012-09-18 20:18:30,285 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347.leaseChecker] regionserver.Leases(123): RegionServer:2;hemera.ap= ache.org,43875,1347999502347.leaseChecker closing leases > 2012-09-18 20:18:30,285 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347.leaseChecker] regionserver.Leases(130): RegionServer:2;hemera.ap= ache.org,43875,1347999502347.leaseChecker closed leases > 2012-09-18 20:18:30,286 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.Leases(123): RegionServer:1;hemera.apache.org,5160= 1,1347999502333 closing leases > 2012-09-18 20:18:30,286 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.Leases(130): RegionServer:1;hemera.apache.org,5160= 1,1347999502333 closed leases > 2012-09-18 20:18:30,285 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333.leaseChecker] regionserver.Leases(130): RegionServer:1;hemera.ap= ache.org,51601,1347999502333.leaseChecker closed leases > 2012-09-18 20:18:30,286 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.CompactSplitThread(253): Waiting for Split Thread = to finish... > 2012-09-18 20:18:30,286 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.HRegionServer(966): stopping server hemera.apache.= org,43875,1347999502347; all regions closed. > 2012-09-18 20:18:30,286 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.CompactSplitThread(253): Waiting for Large Compact= ion Thread to finish... > 2012-09-18 20:18:30,287 DEBUG [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.CompactSplitThread(253): Waiting for Small Compact= ion Thread to finish... > 2012-09-18 20:18:30,287 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347.logSyncer] wal.HLog$LogSyncer(1245): RegionServer:2;hemera.apach= e.org,43875,1347999502347.logSyncer exiting > 2012-09-18 20:18:30,287 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347] wal.HLog(1007): closing hlog writer in hdfs://localhost:52077/u= ser/jenkins/hbase/.logs/hemera.apache.org,43875,1347999502347 > 2012-09-18 20:18:30,287 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361.leaseChecker] regionserver.Leases(123): RegionServer:3;hemera.ap= ache.org,58959,1347999502361.leaseChecker closing leases > 2012-09-18 20:18:30,288 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361.leaseChecker] regionserver.Leases(130): RegionServer:3;hemera.ap= ache.org,58959,1347999502361.leaseChecker closed leases > 2012-09-18 20:18:30,289 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeDeleted, state=3DSyncConnected, path=3D/hbase/rs/hemera.apache= .org,51601,1347999502333 > 2012-09-18 20:18:30,289 INFO [pool-1-thread-1-EventThread] zookeeper.Reg= ionServerTracker(94): RegionServer ephemeral node deleted, processing expir= ation [hemera.apache.org,51601,1347999502333] > 2012-09-18 20:18:30,289 INFO [pool-1-thread-1-EventThread] master.Server= Manager(446): Cluster shutdown set; hemera.apache.org,51601,1347999502333 e= xpired; onlineServers=3D4 > 2012-09-18 20:18:30,289 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeChildrenChanged, state=3DSyncConnected, path=3D/hbase/rs > 2012-09-18 20:18:30,290 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.HRegionServer(995): stopping server hemera.apache.= org,51601,1347999502333; zookeeper connection closed. > 2012-09-18 20:18:30,290 INFO [RegionServer:1;hemera.apache.org,51601,134= 7999502333] regionserver.HRegionServer(998): RegionServer:1;hemera.apache.o= rg,51601,1347999502333 exiting > 2012-09-18 20:18:30,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFi= leSystem@21e115] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(186)= : Hook closing fs=3Dorg.apache.hadoop.hbase.fs.HFileSystem@21e115 > 2012-09-18 20:18:30,291 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,38814,1347999502374 > 2012-09-18 20:18:30,291 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,43875,1347999502347 > 2012-09-18 20:18:30,292 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,58959,1347999502361 > 2012-09-18 20:18:30,293 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,33334,1347999502311 > 2012-09-18 20:18:30,296 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.HRegionServer(966): stopping server hemera.apache.= org,58959,1347999502361; all regions closed. > 2012-09-18 20:18:30,296 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361.logSyncer] wal.HLog$LogSyncer(1245): RegionServer:3;hemera.apach= e.org,58959,1347999502361.logSyncer exiting > 2012-09-18 20:18:30,297 DEBUG [RegionServer:3;hemera.apache.org,58959,134= 7999502361] wal.HLog(1007): closing hlog writer in hdfs://localhost:52077/u= ser/jenkins/hbase/.logs/hemera.apache.org,58959,1347999502361 > 2012-09-18 20:18:30,298 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.Leases(123): RegionServer:2;hemera.apache.org,4387= 5,1347999502347 closing leases > 2012-09-18 20:18:30,298 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.Leases(130): RegionServer:2;hemera.apache.org,4387= 5,1347999502347 closed leases > 2012-09-18 20:18:30,298 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.CompactSplitThread(253): Waiting for Split Thread = to finish... > 2012-09-18 20:18:30,298 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.CompactSplitThread(253): Waiting for Large Compact= ion Thread to finish... > 2012-09-18 20:18:30,298 DEBUG [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.CompactSplitThread(253): Waiting for Small Compact= ion Thread to finish... > 2012-09-18 20:18:30,300 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeDeleted, state=3DSyncConnected, path=3D/hbase/rs/hemera.apache= .org,43875,1347999502347 > 2012-09-18 20:18:30,300 INFO [pool-1-thread-1-EventThread] zookeeper.Reg= ionServerTracker(94): RegionServer ephemeral node deleted, processing expir= ation [hemera.apache.org,43875,1347999502347] > 2012-09-18 20:18:30,300 INFO [pool-1-thread-1-EventThread] master.Server= Manager(446): Cluster shutdown set; hemera.apache.org,43875,1347999502347 e= xpired; onlineServers=3D3 > 2012-09-18 20:18:30,301 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeChildrenChanged, state=3DSyncConnected, path=3D/hbase/rs > 2012-09-18 20:18:30,301 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.HRegionServer(995): stopping server hemera.apache.= org,43875,1347999502347; zookeeper connection closed. > 2012-09-18 20:18:30,301 INFO [RegionServer:2;hemera.apache.org,43875,134= 7999502347] regionserver.HRegionServer(998): RegionServer:2;hemera.apache.o= rg,43875,1347999502347 exiting > 2012-09-18 20:18:30,302 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFi= leSystem@147e54e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(186= ): Hook closing fs=3Dorg.apache.hadoop.hbase.fs.HFileSystem@147e54e > 2012-09-18 20:18:30,302 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,38814,1347999502374 > 2012-09-18 20:18:30,303 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,58959,1347999502361 > 2012-09-18 20:18:30,303 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,33334,1347999502311 > 2012-09-18 20:18:30,307 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.Leases(123): RegionServer:3;hemera.apache.org,5895= 9,1347999502361 closing leases > 2012-09-18 20:18:30,308 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.Leases(130): RegionServer:3;hemera.apache.org,5895= 9,1347999502361 closed leases > 2012-09-18 20:18:30,309 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeDeleted, state=3DSyncConnected, path=3D/hbase/rs/hemera.apache= .org,58959,1347999502361 > 2012-09-18 20:18:30,309 INFO [pool-1-thread-1-EventThread] zookeeper.Reg= ionServerTracker(94): RegionServer ephemeral node deleted, processing expir= ation [hemera.apache.org,58959,1347999502361] > 2012-09-18 20:18:30,309 INFO [pool-1-thread-1-EventThread] master.Server= Manager(446): Cluster shutdown set; hemera.apache.org,58959,1347999502361 e= xpired; onlineServers=3D2 > 2012-09-18 20:18:30,309 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeChildrenChanged, state=3DSyncConnected, path=3D/hbase/rs > 2012-09-18 20:18:30,310 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.HRegionServer(995): stopping server hemera.apache.= org,58959,1347999502361; zookeeper connection closed. > 2012-09-18 20:18:30,310 INFO [RegionServer:3;hemera.apache.org,58959,134= 7999502361] regionserver.HRegionServer(998): RegionServer:3;hemera.apache.o= rg,58959,1347999502361 exiting > 2012-09-18 20:18:30,310 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFi= leSystem@1c7510d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(186= ): Hook closing fs=3Dorg.apache.hadoop.hbase.fs.HFileSystem@1c7510d > 2012-09-18 20:18:30,310 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,38814,1347999502374 > 2012-09-18 20:18:30,311 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.HRegionServer(869): Closing user regions > 2012-09-18 20:18:30,311 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,33334,1347999502311 > 2012-09-18 20:18:30,311 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] handler.CloseRegionHandler(124): Processing close of t,bbb,1= 347999506644.8a6358bbd5596deaad1f278da7ca32b4. > 2012-09-18 20:18:30,311 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] regionserver.HRegion(954): Closing t,bbb,1347999506644.8a635= 8bbd5596deaad1f278da7ca32b4.: disabling compactions & flushes > 2012-09-18 20:18:30,311 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] handler.CloseRegionHandler(124): Processing close of t,vvv,1= 347999506708.df029f1344d578333d45fbd32dbbba23. > 2012-09-18 20:18:30,311 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] regionserver.HRegion(975): Updates disabled for region t,bbb= ,1347999506644.8a6358bbd5596deaad1f278da7ca32b4. > 2012-09-18 20:18:30,312 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(954): Closing t,vvv,1347999506708.df029= f1344d578333d45fbd32dbbba23.: disabling compactions & flushes > 2012-09-18 20:18:30,312 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(975): Updates disabled for region t,vvv= ,1347999506708.df029f1344d578333d45fbd32dbbba23. > 2012-09-18 20:18:30,312 INFO [StoreCloserThread-t,bbb,1347999506644.8a63= 58bbd5596deaad1f278da7ca32b4.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,311 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] handler.CloseRegionHandler(124): Processing close of t,ppp,1= 347999506690.815416a53df0b3b68fc865a0edf53203. > 2012-09-18 20:18:30,312 INFO [StoreCloserThread-t,vvv,1347999506708.df02= 9f1344d578333d45fbd32dbbba23.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,312 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] regionserver.HRegion(954): Closing t,ppp,1347999506690.81541= 6a53df0b3b68fc865a0edf53203.: disabling compactions & flushes > 2012-09-18 20:18:30,313 INFO [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(1023): Closed t,vvv,1347999506708.df029= f1344d578333d45fbd32dbbba23. > 2012-09-18 20:18:30,313 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] regionserver.HRegion(975): Updates disabled for region t,ppp= ,1347999506690.815416a53df0b3b68fc865a0edf53203. > 2012-09-18 20:18:30,313 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] handler.CloseRegionHandler(168): Closed region t,vvv,1347999= 506708.df029f1344d578333d45fbd32dbbba23. > 2012-09-18 20:18:30,312 INFO [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] regionserver.HRegion(1023): Closed t,bbb,1347999506644.8a635= 8bbd5596deaad1f278da7ca32b4. > 2012-09-18 20:18:30,313 INFO [StoreCloserThread-t,ppp,1347999506690.8154= 16a53df0b3b68fc865a0edf53203.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,313 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] handler.CloseRegionHandler(124): Processing close of t,jjj,1= 347999506672.393b3166f0a447101593a6e538c0a2fd. > 2012-09-18 20:18:30,313 INFO [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] regionserver.HRegion(1023): Closed t,ppp,1347999506690.81541= 6a53df0b3b68fc865a0edf53203. > 2012-09-18 20:18:30,313 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(954): Closing t,jjj,1347999506672.393b3= 166f0a447101593a6e538c0a2fd.: disabling compactions & flushes > 2012-09-18 20:18:30,314 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] handler.CloseRegionHandler(168): Closed region t,ppp,1347999= 506690.815416a53df0b3b68fc865a0edf53203. > 2012-09-18 20:18:30,314 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(975): Updates disabled for region t,jjj= ,1347999506672.393b3166f0a447101593a6e538c0a2fd. > 2012-09-18 20:18:30,314 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] handler.CloseRegionHandler(124): Processing close of t,ddd,1= 347999506653.d94a101bf8bc56ad5a83b8b626f8189b. > 2012-09-18 20:18:30,313 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] handler.CloseRegionHandler(168): Closed region t,bbb,1347999= 506644.8a6358bbd5596deaad1f278da7ca32b4. > 2012-09-18 20:18:30,314 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] regionserver.HRegion(954): Closing t,ddd,1347999506653.d94a1= 01bf8bc56ad5a83b8b626f8189b.: disabling compactions & flushes > 2012-09-18 20:18:30,314 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] handler.CloseRegionHandler(124): Processing close of t,ccc,1= 347999506650.8568717cae604e1dab3b78bfeff881e9. > 2012-09-18 20:18:30,314 INFO [StoreCloserThread-t,jjj,1347999506672.393b= 3166f0a447101593a6e538c0a2fd.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,314 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] regionserver.HRegion(954): Closing t,ccc,1347999506650.85687= 17cae604e1dab3b78bfeff881e9.: disabling compactions & flushes > 2012-09-18 20:18:30,315 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] regionserver.HRegion(975): Updates disabled for region t,ccc= ,1347999506650.8568717cae604e1dab3b78bfeff881e9. > 2012-09-18 20:18:30,314 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] regionserver.HRegion(975): Updates disabled for region t,ddd= ,1347999506653.d94a101bf8bc56ad5a83b8b626f8189b. > 2012-09-18 20:18:30,315 INFO [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(1023): Closed t,jjj,1347999506672.393b3= 166f0a447101593a6e538c0a2fd. > 2012-09-18 20:18:30,315 INFO [StoreCloserThread-t,ccc,1347999506650.8568= 717cae604e1dab3b78bfeff881e9.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,315 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] handler.CloseRegionHandler(168): Closed region t,jjj,1347999= 506672.393b3166f0a447101593a6e538c0a2fd. > 2012-09-18 20:18:30,315 INFO [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] regionserver.HRegion(1023): Closed t,ccc,1347999506650.85687= 17cae604e1dab3b78bfeff881e9. > 2012-09-18 20:18:30,316 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-1] handler.CloseRegionHandler(168): Closed region t,ccc,1347999= 506650.8568717cae604e1dab3b78bfeff881e9. > 2012-09-18 20:18:30,315 INFO [StoreCloserThread-t,ddd,1347999506653.d94a= 101bf8bc56ad5a83b8b626f8189b.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,316 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] handler.CloseRegionHandler(124): Processing close of t,uuu,1= 347999506706.bf4ceeff334c5a35fa3a54272c2f395f. > 2012-09-18 20:18:30,316 INFO [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] regionserver.HRegion(1023): Closed t,ddd,1347999506653.d94a1= 01bf8bc56ad5a83b8b626f8189b. > 2012-09-18 20:18:30,316 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(954): Closing t,uuu,1347999506706.bf4ce= eff334c5a35fa3a54272c2f395f.: disabling compactions & flushes > 2012-09-18 20:18:30,316 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-2] handler.CloseRegionHandler(168): Closed region t,ddd,1347999= 506653.d94a101bf8bc56ad5a83b8b626f8189b. > 2012-09-18 20:18:30,316 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(975): Updates disabled for region t,uuu= ,1347999506706.bf4ceeff334c5a35fa3a54272c2f395f. > 2012-09-18 20:18:30,317 INFO [StoreCloserThread-t,uuu,1347999506706.bf4c= eeff334c5a35fa3a54272c2f395f.-1] regionserver.HStore(635): Closed f > 2012-09-18 20:18:30,317 INFO [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] regionserver.HRegion(1023): Closed t,uuu,1347999506706.bf4ce= eff334c5a35fa3a54272c2f395f. > 2012-09-18 20:18:30,317 DEBUG [RS_CLOSE_REGION-hemera.apache.org,38814,13= 47999502374-0] handler.CloseRegionHandler(168): Closed region t,uuu,1347999= 506706.bf4ceeff334c5a35fa3a54272c2f395f. > 2012-09-18 20:18:30,392 INFO [hemera.apache.org,35050,1347999502111.spli= tLogManagerTimeoutMonitor] hbase.Chore(81): hemera.apache.org,35050,1347999= 502111.splitLogManagerTimeoutMonitor exiting > 2012-09-18 20:18:30,507 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311] wal.HLog(975): Moved 1 log files to /user/jenkins/hbase/.oldlog= s > 2012-09-18 20:18:30,509 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.Leases(123): RegionServer:0;hemera.apache.org,3333= 4,1347999502311 closing leases > 2012-09-18 20:18:30,509 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.Leases(130): RegionServer:0;hemera.apache.org,3333= 4,1347999502311 closed leases > 2012-09-18 20:18:30,509 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.CompactSplitThread(253): Waiting for Split Thread = to finish... > 2012-09-18 20:18:30,509 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.CompactSplitThread(253): Waiting for Large Compact= ion Thread to finish... > 2012-09-18 20:18:30,509 DEBUG [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.CompactSplitThread(253): Waiting for Small Compact= ion Thread to finish... > 2012-09-18 20:18:30,510 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeDeleted, state=3DSyncConnected, path=3D/hbase/rs/hemera.apache= .org,33334,1347999502311 > 2012-09-18 20:18:30,511 INFO [pool-1-thread-1-EventThread] zookeeper.Reg= ionServerTracker(94): RegionServer ephemeral node deleted, processing expir= ation [hemera.apache.org,33334,1347999502311] > 2012-09-18 20:18:30,511 INFO [pool-1-thread-1-EventThread] master.Server= Manager(446): Cluster shutdown set; hemera.apache.org,33334,1347999502311 e= xpired; onlineServers=3D1 > 2012-09-18 20:18:30,511 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeChildrenChanged, state=3DSyncConnected, path=3D/hbase/rs > 2012-09-18 20:18:30,512 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.HRegionServer(995): stopping server hemera.apache.= org,33334,1347999502311; zookeeper connection closed. > 2012-09-18 20:18:30,512 INFO [RegionServer:0;hemera.apache.org,33334,134= 7999502311] regionserver.HRegionServer(998): RegionServer:0;hemera.apache.o= rg,33334,1347999502311 exiting > 2012-09-18 20:18:30,512 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFi= leSystem@1ee9cc3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(186= ): Hook closing fs=3Dorg.apache.hadoop.hbase.fs.HFileSystem@1ee9cc3 > 2012-09-18 20:18:30,513 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKU= til(235): master:35050-0x139db080e690000 Set watcher on existing znode /hba= se/rs/hemera.apache.org,38814,1347999502374 > 2012-09-18 20:18:30,513 INFO [pool-1-thread-1] regionserver.HRegionServe= r(1737): STOPPED: Shutdown requested > 2012-09-18 20:18:30,514 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.SplitLogWorker(522): Sending interrupt to stop the= worker thread > 2012-09-18 20:18:30,514 INFO [SplitLogWorker-hemera.apache.org,38814,134= 7999502374] regionserver.SplitLogWorker(206): SplitLogWorker interrupted wh= ile waiting for task, exiting: java.lang.InterruptedException > 2012-09-18 20:18:30,514 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374.compactionChecker] hbase.Chore(81): RegionServer:4;hemera.apache= .org,38814,1347999502374.compactionChecker exiting > 2012-09-18 20:18:30,514 INFO [SplitLogWorker-hemera.apache.org,38814,134= 7999502374] regionserver.SplitLogWorker(170): SplitLogWorker hemera.apache.= org,38814,1347999502374 exiting > 2012-09-18 20:18:30,514 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.HRegionServer(947): stopping server hemera.apache.= org,38814,1347999502374 > 2012-09-18 20:18:30,514 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374.logRoller] regionserver.LogRoller(118): LogRoller exiting. > 2012-09-18 20:18:30,514 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374.cacheFlusher] regionserver.MemStoreFlusher(264): RegionServer:4;= hemera.apache.org,38814,1347999502374.cacheFlusher exiting > 2012-09-18 20:18:30,514 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374] catalog.CatalogTracker(257): Stopping catalog tracker org.apach= e.hadoop.hbase.catalog.CatalogTracker@df39bc > 2012-09-18 20:18:30,515 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] client.HConnectionManager$HConnectionImplementation(1523): Clos= ing zookeeper sessionid=3D0x139db080e69000a > 2012-09-18 20:18:30,516 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.CompactSplitThread(253): Waiting for Split Thread = to finish... > 2012-09-18 20:18:30,516 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.CompactSplitThread(253): Waiting for Large Compact= ion Thread to finish... > 2012-09-18 20:18:30,516 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.CompactSplitThread(253): Waiting for Small Compact= ion Thread to finish... > 2012-09-18 20:18:30,517 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.HRegionServer(1091): Waiting on 1 regions to close > 2012-09-18 20:18:30,517 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] handler.CloseRegionHandler(124): Processing close of .META.,,1= .1028785192 > 2012-09-18 20:18:30,517 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.HRegionServer(1095): {1028785192=3D.META.,,1.10287= 85192} > 2012-09-18 20:18:30,517 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HRegion(954): Closing .META.,,1.1028785192: disab= ling compactions & flushes > 2012-09-18 20:18:30,518 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HRegion(975): Updates disabled for region .META.,= ,1.1028785192 > 2012-09-18 20:18:30,518 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HRegion(1481): Started memstore flush for .META.,= ,1.1028785192, current region memstore size 20.1k > 2012-09-18 20:18:30,518 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HRegion(1528): Finished snapshotting .META.,,1.10= 28785192, commencing wait for mvcc, flushsize=3D20560 > 2012-09-18 20:18:30,518 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HRegion(1538): Finished snapshotting, commencing = flushing stores > 2012-09-18 20:18:30,521 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] util.FSUtils(167): Creating file=3Dhdfs://localhost:52077/user= /jenkins/hbase/.META./1028785192/.tmp/6c449086188648c08a990537dba22ca4 with= permission=3Drwxrwxrwx > 2012-09-18 20:18:30,523 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] hfile.HFileWriterV2(142): Initialized with CacheConfig:enabled= [cacheDataOnRead=3Dtrue] [cacheDataOnWrite=3Dfalse] [cacheIndexesOnWrite= =3Dfalse] [cacheBloomsOnWrite=3Dfalse] [cacheEvictOnClose=3Dfalse] [cacheCo= mpressed=3Dfalse] > 2012-09-18 20:18:30,524 INFO [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.StoreFile$Writer(1021): Delete Family Bloom filte= r type for hdfs://localhost:52077/user/jenkins/hbase/.META./1028785192/.tmp= /6c449086188648c08a990537dba22ca4: CompoundBloomFilterWriter > 2012-09-18 20:18:30,939 INFO [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.StoreFile$Writer(1241): NO General Bloom and NO D= eleteFamily was added to HFile (hdfs://localhost:52077/user/jenkins/hbase/.= META./1028785192/.tmp/6c449086188648c08a990537dba22ca4)=20 > 2012-09-18 20:18:30,939 INFO [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HStore(767): Flushed , sequenceid=3D59, memsize= =3D20.1k, into tmp file hdfs://localhost:52077/user/jenkins/hbase/.META./10= 28785192/.tmp/6c449086188648c08a990537dba22ca4 > 2012-09-18 20:18:30,948 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HStore(792): Renaming flushed file at hdfs://loca= lhost:52077/user/jenkins/hbase/.META./1028785192/.tmp/6c449086188648c08a990= 537dba22ca4 to hdfs://localhost:52077/user/jenkins/hbase/.META./1028785192/= info/6c449086188648c08a990537dba22ca4 > 2012-09-18 20:18:30,954 INFO [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HStore(815): Added hdfs://localhost:52077/user/je= nkins/hbase/.META./1028785192/info/6c449086188648c08a990537dba22ca4, entrie= s=3D89, sequenceid=3D59, filesize=3D10.2k > 2012-09-18 20:18:30,955 INFO [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HRegion(1617): Finished memstore flush of ~20.1k/= 20560, currentsize=3D0.0/0 for region .META.,,1.1028785192 in 437ms, sequen= ceid=3D59, compaction requested=3Dfalse > 2012-09-18 20:18:30,956 INFO [StoreCloserThread-.META.,,1.1028785192-1] = regionserver.HStore(635): Closed info > 2012-09-18 20:18:30,956 INFO [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] regionserver.HRegion(1023): Closed .META.,,1.1028785192 > 2012-09-18 20:18:30,956 DEBUG [RS_CLOSE_META-hemera.apache.org,38814,1347= 999502374-0] handler.CloseRegionHandler(168): Closed region .META.,,1.10287= 85192 > 2012-09-18 20:18:31,112 INFO [Master:0;hemera.apache.org,35050,134799950= 2111] master.ServerManager(398): Waiting on regionserver(s) to go down heme= ra.apache.org,38814,1347999502374 > 2012-09-18 20:18:31,118 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.HRegionServer(966): stopping server hemera.apache.= org,38814,1347999502374; all regions closed. > 2012-09-18 20:18:31,118 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374.logSyncer] wal.HLog$LogSyncer(1245): RegionServer:4;hemera.apach= e.org,38814,1347999502374.logSyncer exiting > 2012-09-18 20:18:31,118 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374] wal.HLog(1007): closing hlog writer in hdfs://localhost:52077/u= ser/jenkins/hbase/.logs/hemera.apache.org,38814,1347999502374 > 2012-09-18 20:18:31,124 DEBUG [RegionServer:4;hemera.apache.org,38814,134= 7999502374] wal.HLog(975): Moved 1 log files to /user/jenkins/hbase/.oldlog= s > 2012-09-18 20:18:31,125 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.Leases(123): RegionServer:4;hemera.apache.org,3881= 4,1347999502374 closing leases > 2012-09-18 20:18:31,125 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.Leases(130): RegionServer:4;hemera.apache.org,3881= 4,1347999502374 closed leases > 2012-09-18 20:18:31,126 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeDeleted, state=3DSyncConnected, path=3D/hbase/rs/hemera.apache= .org,38814,1347999502374 > 2012-09-18 20:18:31,126 INFO [pool-1-thread-1-EventThread] zookeeper.Reg= ionServerTracker(94): RegionServer ephemeral node deleted, processing expir= ation [hemera.apache.org,38814,1347999502374] > 2012-09-18 20:18:31,126 INFO [pool-1-thread-1-EventThread] master.Server= Manager(446): Cluster shutdown set; hemera.apache.org,38814,1347999502374 e= xpired; onlineServers=3D0 > 2012-09-18 20:18:31,126 DEBUG [Master:0;hemera.apache.org,35050,134799950= 2111] master.HMaster(1067): Stopping service threads > 2012-09-18 20:18:31,126 INFO [pool-1-thread-1-EventThread] master.HMaste= r(2049): Cluster shutdown set; onlineServer=3D0 > 2012-09-18 20:18:31,127 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.HRegionServer(995): stopping server hemera.apache.= org,38814,1347999502374; zookeeper connection closed. > 2012-09-18 20:18:31,127 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374] regionserver.HRegionServer(998): RegionServer:4;hemera.apache.o= rg,38814,1347999502374 exiting > 2012-09-18 20:18:31,127 INFO [Master:0;hemera.apache.org,35050,134799950= 2111.oldLogCleaner] hbase.Chore(81): Master:0;hemera.apache.org,35050,13479= 99502111.oldLogCleaner exiting > 2012-09-18 20:18:31,127 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): master:35050-0x139db080e690000 Received ZooKeeper Event= , type=3DNodeChildrenChanged, state=3DSyncConnected, path=3D/hbase/rs > 2012-09-18 20:18:31,127 INFO [Master:0;hemera.apache.org,35050,134799950= 2111.archivedHFileCleaner] hbase.Chore(81): Master:0;hemera.apache.org,3505= 0,1347999502111.archivedHFileCleaner exiting > 2012-09-18 20:18:31,128 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFi= leSystem@194f467] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(186= ): Hook closing fs=3Dorg.apache.hadoop.hbase.fs.HFileSystem@194f467 > 2012-09-18 20:18:31,128 INFO [pool-1-thread-1] util.JVMClusterUtil(263):= Shutdown of 1 master(s) and 5 regionserver(s) complete > 2012-09-18 20:18:31,128 INFO [pool-1-thread-1] client.HConnectionManager= $HConnectionImplementation(1523): Closing zookeeper sessionid=3D0x139db080e= 69000d > 2012-09-18 20:18:31,129 DEBUG [Master:0;hemera.apache.org,35050,134799950= 2111] zookeeper.ZKUtil(1141): master:35050-0x139db080e690000 Retrieved 36 b= yte(s) of data from znode /hbase/master; data=3DPBUF\x0A\x1E\x0A\x11hemera.= ap... > 2012-09-18 20:18:31,130 DEBUG [Master:0;hemera.apache.org,35050,134799950= 2111] catalog.CatalogTracker(257): Stopping catalog tracker org.apache.hado= op.hbase.catalog.CatalogTracker@1152c0e > 2012-09-18 20:18:31,130 INFO [hemera.apache.org,35050,1347999502111.time= outMonitor] hbase.Chore(81): hemera.apache.org,35050,1347999502111.timeoutM= onitor exiting > 2012-09-18 20:18:31,130 INFO [hemera.apache.org,35050,1347999502111.time= rUpdater] hbase.Chore(81): hemera.apache.org,35050,1347999502111.timerUpdat= er exiting > 2012-09-18 20:18:31,130 INFO [Master:0;hemera.apache.org,35050,134799950= 2111] master.HMaster(481): HMaster main thread exiting > 2012-09-18 20:18:31,132 INFO [pool-1-thread-1] zookeeper.MiniZooKeeperCl= uster(238): Shutdown MiniZK cluster with all ZK servers > 2012-09-18 20:18:31,132 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped= SelectChannelConnector@localhost:0 > 2012-09-18 20:18:31,231 DEBUG [Master:0;hemera.apache.org,35050,134799950= 2111-EventThread] zookeeper.ZooKeeperWatcher(265): hconnection 0x1c1eceb-0x= 139db080e690006 Received ZooKeeper Event, type=3DNone, state=3DDisconnected= , path=3Dnull > 2012-09-18 20:18:31,231 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(265): unittest-0x139db080e69000e Received ZooKeeper Event, ty= pe=3DNone, state=3DDisconnected, path=3Dnull > 2012-09-18 20:18:31,231 DEBUG [Master:0;hemera.apache.org,35050,134799950= 2111-EventThread] zookeeper.ZooKeeperWatcher(363): hconnection 0x1c1eceb-0x= 139db080e690006 Received Disconnected from ZooKeeper, ignoring > 2012-09-18 20:18:31,231 DEBUG [pool-1-thread-1-EventThread] zookeeper.Zoo= KeeperWatcher(363): unittest-0x139db080e69000e Received Disconnected from Z= ooKeeper, ignoring > 2012-09-18 20:18:31,237 WARN [org.apache.hadoop.hdfs.server.datanode.Dat= aXceiverServer@1f09a31] datanode.DataXceiverServer(138): DatanodeRegistrati= on(127.0.0.1:34950, storageID=3DDS-1597293543-140.211.11.27-34950-134799950= 1880, infoPort=3D40910, ipcPort=3D42169):DataXceiveServer:java.nio.channels= .AsynchronousCloseException > =09at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInte= rruptibleChannel.java:185) > =09at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.j= ava:159) > =09at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) > =09at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXc= eiverServer.java:131) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:31,285 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374.leaseChecker] regionserver.Leases(123): RegionServer:4;hemera.ap= ache.org,38814,1347999502374.leaseChecker closing leases > 2012-09-18 20:18:31,285 INFO [RegionServer:4;hemera.apache.org,38814,134= 7999502374.leaseChecker] regionserver.Leases(130): RegionServer:4;hemera.ap= ache.org,38814,1347999502374.leaseChecker closed leases > 2012-09-18 20:18:32,237 WARN [pool-1-thread-1] util.MBeans(73): Hadoop:s= ervice=3DDataNode,name=3DFSDatasetState-UndefinedStorageId-809266774 > javax.management.InstanceNotFoundException: Hadoop:service=3DDataNode,nam= e=3DFSDatasetState-UndefinedStorageId-809266774 > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(Defa= ultMBeanServerInterceptor.java:1094) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnre= gisterMBean(DefaultMBeanServerInterceptor.java:415) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBe= an(DefaultMBeanServerInterceptor.java:403) > =09at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServ= er.java:506) > =09at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:71) > =09at org.apache.hadoop.hdfs.server.datanode.FSDataset.shutdown(FSDataset= .java:2067) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.j= ava:799) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdownDataNodes(MiniDFSClus= ter.java:566) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:= 550) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniDFSCluster(= HBaseTestingUtility.java:503) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniCluster(HBa= seTestingUtility.java:752) > =09at org.apache.hadoop.hbase.TestDrainingServer.tearDownAfterClass(TestD= rainingServer.java:132) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo= rkMethod.java:45) > =09at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC= allable.java:15) > =09at org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework= Method.java:42) > =09at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.= java:36) > =09at org.junit.runners.ParentRunner.run(ParentRunner.java:300) > =09at org.junit.runners.Suite.runChild(Suite.java:128) > =09at org.junit.runners.Suite.runChild(Suite.java:24) > =09at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) > =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:= 441) > =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > =09at java.util.concurrent.FutureTask.run(FutureTask.java:138) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolEx= ecutor.java:886) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:908) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:32,238 WARN [pool-1-thread-1] datanode.FSDatasetAsyncDi= skService(121): AsyncDiskService has already shut down. > 2012-09-18 20:18:32,238 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped= SelectChannelConnector@localhost:0 > 2012-09-18 20:18:32,341 WARN [org.apache.hadoop.hdfs.server.datanode.Dat= aXceiverServer@2a5ab9] datanode.DataXceiverServer(138): DatanodeRegistratio= n(127.0.0.1:46013, storageID=3DDS-1826840059-140.211.11.27-46013-1347999501= 721, infoPort=3D33986, ipcPort=3D42754):DataXceiveServer:java.nio.channels.= AsynchronousCloseException > =09at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInte= rruptibleChannel.java:185) > =09at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.j= ava:159) > =09at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) > =09at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXc= eiverServer.java:131) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:33,341 WARN [pool-1-thread-1] util.MBeans(73): Hadoop:s= ervice=3DDataNode,name=3DFSDatasetState-UndefinedStorageId1641970170 > javax.management.InstanceNotFoundException: Hadoop:service=3DDataNode,nam= e=3DFSDatasetState-UndefinedStorageId1641970170 > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(Defa= ultMBeanServerInterceptor.java:1094) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnre= gisterMBean(DefaultMBeanServerInterceptor.java:415) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBe= an(DefaultMBeanServerInterceptor.java:403) > =09at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServ= er.java:506) > =09at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:71) > =09at org.apache.hadoop.hdfs.server.datanode.FSDataset.shutdown(FSDataset= .java:2067) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.j= ava:799) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdownDataNodes(MiniDFSClus= ter.java:566) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:= 550) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniDFSCluster(= HBaseTestingUtility.java:503) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniCluster(HBa= seTestingUtility.java:752) > =09at org.apache.hadoop.hbase.TestDrainingServer.tearDownAfterClass(TestD= rainingServer.java:132) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo= rkMethod.java:45) > =09at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC= allable.java:15) > =09at org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework= Method.java:42) > =09at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.= java:36) > =09at org.junit.runners.ParentRunner.run(ParentRunner.java:300) > =09at org.junit.runners.Suite.runChild(Suite.java:128) > =09at org.junit.runners.Suite.runChild(Suite.java:24) > =09at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) > =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:= 441) > =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > =09at java.util.concurrent.FutureTask.run(FutureTask.java:138) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolEx= ecutor.java:886) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:908) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:33,342 WARN [pool-1-thread-1] datanode.FSDatasetAsyncDi= skService(121): AsyncDiskService has already shut down. > 2012-09-18 20:18:33,342 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped= SelectChannelConnector@localhost:0 > 2012-09-18 20:18:33,444 WARN [org.apache.hadoop.hdfs.server.datanode.Dat= aXceiverServer@18c458] datanode.DataXceiverServer(138): DatanodeRegistratio= n(127.0.0.1:39857, storageID=3DDS-635958744-140.211.11.27-39857-13479995015= 58, infoPort=3D49006, ipcPort=3D39278):DataXceiveServer:java.nio.channels.A= synchronousCloseException > =09at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInte= rruptibleChannel.java:185) > =09at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.j= ava:159) > =09at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) > =09at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXc= eiverServer.java:131) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:34,444 WARN [pool-1-thread-1] util.MBeans(73): Hadoop:s= ervice=3DDataNode,name=3DFSDatasetState-UndefinedStorageId389747850 > javax.management.InstanceNotFoundException: Hadoop:service=3DDataNode,nam= e=3DFSDatasetState-UndefinedStorageId389747850 > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(Defa= ultMBeanServerInterceptor.java:1094) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnre= gisterMBean(DefaultMBeanServerInterceptor.java:415) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBe= an(DefaultMBeanServerInterceptor.java:403) > =09at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServ= er.java:506) > =09at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:71) > =09at org.apache.hadoop.hdfs.server.datanode.FSDataset.shutdown(FSDataset= .java:2067) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.j= ava:799) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdownDataNodes(MiniDFSClus= ter.java:566) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:= 550) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniDFSCluster(= HBaseTestingUtility.java:503) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniCluster(HBa= seTestingUtility.java:752) > =09at org.apache.hadoop.hbase.TestDrainingServer.tearDownAfterClass(TestD= rainingServer.java:132) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo= rkMethod.java:45) > =09at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC= allable.java:15) > =09at org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework= Method.java:42) > =09at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.= java:36) > =09at org.junit.runners.ParentRunner.run(ParentRunner.java:300) > =09at org.junit.runners.Suite.runChild(Suite.java:128) > =09at org.junit.runners.Suite.runChild(Suite.java:24) > =09at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) > =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:= 441) > =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > =09at java.util.concurrent.FutureTask.run(FutureTask.java:138) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolEx= ecutor.java:886) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:908) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:34,445 WARN [pool-1-thread-1] datanode.FSDatasetAsyncDi= skService(121): AsyncDiskService has already shut down. > 2012-09-18 20:18:34,445 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped= SelectChannelConnector@localhost:0 > 2012-09-18 20:18:34,547 WARN [org.apache.hadoop.hdfs.server.datanode.Dat= aXceiverServer@11c55bb] datanode.DataXceiverServer(138): DatanodeRegistrati= on(127.0.0.1:47094, storageID=3DDS-1080581881-140.211.11.27-47094-134799950= 1341, infoPort=3D51461, ipcPort=3D36418):DataXceiveServer:java.nio.channels= .AsynchronousCloseException > =09at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInte= rruptibleChannel.java:185) > =09at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.j= ava:159) > =09at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) > =09at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXc= eiverServer.java:131) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:35,547 WARN [pool-1-thread-1] util.MBeans(73): Hadoop:s= ervice=3DDataNode,name=3DFSDatasetState-UndefinedStorageId-1857067045 > javax.management.InstanceNotFoundException: Hadoop:service=3DDataNode,nam= e=3DFSDatasetState-UndefinedStorageId-1857067045 > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(Defa= ultMBeanServerInterceptor.java:1094) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnre= gisterMBean(DefaultMBeanServerInterceptor.java:415) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBe= an(DefaultMBeanServerInterceptor.java:403) > =09at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServ= er.java:506) > =09at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:71) > =09at org.apache.hadoop.hdfs.server.datanode.FSDataset.shutdown(FSDataset= .java:2067) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.j= ava:799) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdownDataNodes(MiniDFSClus= ter.java:566) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:= 550) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniDFSCluster(= HBaseTestingUtility.java:503) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniCluster(HBa= seTestingUtility.java:752) > =09at org.apache.hadoop.hbase.TestDrainingServer.tearDownAfterClass(TestD= rainingServer.java:132) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo= rkMethod.java:45) > =09at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC= allable.java:15) > =09at org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework= Method.java:42) > =09at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.= java:36) > =09at org.junit.runners.ParentRunner.run(ParentRunner.java:300) > =09at org.junit.runners.Suite.runChild(Suite.java:128) > =09at org.junit.runners.Suite.runChild(Suite.java:24) > =09at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) > =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:= 441) > =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > =09at java.util.concurrent.FutureTask.run(FutureTask.java:138) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolEx= ecutor.java:886) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:908) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:35,548 WARN [pool-1-thread-1] datanode.FSDatasetAsyncDi= skService(121): AsyncDiskService has already shut down. > 2012-09-18 20:18:35,548 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped= SelectChannelConnector@localhost:0 > 2012-09-18 20:18:35,650 WARN [org.apache.hadoop.hdfs.server.datanode.Dat= aXceiverServer@b3b6a6] datanode.DataXceiverServer(138): DatanodeRegistratio= n(127.0.0.1:58813, storageID=3DDS-1129259921-140.211.11.27-58813-1347999501= 165, infoPort=3D47167, ipcPort=3D40188):DataXceiveServer:java.nio.channels.= AsynchronousCloseException > =09at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInte= rruptibleChannel.java:185) > =09at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.j= ava:159) > =09at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) > =09at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXc= eiverServer.java:131) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:36,179 WARN [DataNode: [/x1/jenkins/jenkins-slave/works= pace/HBase-TRUNK/trunk/hbase-server/target/test-data/d1b07c00-61dd-47e9-ac9= b-95a060d6795d/dfscluster_6ef910b6-2888-4dda-84f2-de311d45c6a2/dfs/data/dat= a1,/x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-server/targe= t/test-data/d1b07c00-61dd-47e9-ac9b-95a060d6795d/dfscluster_6ef910b6-2888-4= dda-84f2-de311d45c6a2/dfs/data/data2]] util.MBeans(73): Hadoop:service=3DDa= taNode,name=3DDataNodeInfo > javax.management.InstanceNotFoundException: Hadoop:service=3DDataNode,nam= e=3DDataNodeInfo > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(Defa= ultMBeanServerInterceptor.java:1094) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnre= gisterMBean(DefaultMBeanServerInterceptor.java:415) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBe= an(DefaultMBeanServerInterceptor.java:403) > =09at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServ= er.java:506) > =09at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:71) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.unRegisterMXBean(Da= taNode.java:522) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.j= ava:737) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.run(DataNode.java:1= 471) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:36,650 WARN [pool-1-thread-1] util.MBeans(73): Hadoop:s= ervice=3DDataNode,name=3DFSDatasetState-UndefinedStorageId-245364923 > javax.management.InstanceNotFoundException: Hadoop:service=3DDataNode,nam= e=3DFSDatasetState-UndefinedStorageId-245364923 > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(Defa= ultMBeanServerInterceptor.java:1094) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnre= gisterMBean(DefaultMBeanServerInterceptor.java:415) > =09at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBe= an(DefaultMBeanServerInterceptor.java:403) > =09at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServ= er.java:506) > =09at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:71) > =09at org.apache.hadoop.hdfs.server.datanode.FSDataset.shutdown(FSDataset= .java:2067) > =09at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.j= ava:799) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdownDataNodes(MiniDFSClus= ter.java:566) > =09at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:= 550) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniDFSCluster(= HBaseTestingUtility.java:503) > =09at org.apache.hadoop.hbase.HBaseTestingUtility.shutdownMiniCluster(HBa= seTestingUtility.java:752) > =09at org.apache.hadoop.hbase.TestDrainingServer.tearDownAfterClass(TestD= rainingServer.java:132) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo= rkMethod.java:45) > =09at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC= allable.java:15) > =09at org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework= Method.java:42) > =09at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.= java:36) > =09at org.junit.runners.ParentRunner.run(ParentRunner.java:300) > =09at org.junit.runners.Suite.runChild(Suite.java:128) > =09at org.junit.runners.Suite.runChild(Suite.java:24) > =09at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) > =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:= 441) > =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > =09at java.util.concurrent.FutureTask.run(FutureTask.java:138) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolEx= ecutor.java:886) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:908) > =09at java.lang.Thread.run(Thread.java:662) > 2012-09-18 20:18:36,651 WARN [pool-1-thread-1] datanode.FSDatasetAsyncDi= skService(121): AsyncDiskService has already shut down. > 2012-09-18 20:18:36,651 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped= SelectChannelConnector@localhost:0 > 2012-09-18 20:18:36,753 WARN [org.apache.hadoop.hdfs.server.namenode.FSN= amesystem$ReplicationMonitor@1827d1] namenode.FSNamesystem$ReplicationMonit= or(2718): ReplicationMonitor thread received InterruptedException.java.lang= .InterruptedException: sleep interrupted > 2012-09-18 20:18:36,774 INFO [pool-1-thread-1] hbase.HBaseTestingUtility= (756): Minicluster is down > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs For more information on JIRA, see: http://www.atlassian.com/software/jira