hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ramkrishna vasudevan <ramkrishna.s.vasude...@gmail.com>
Subject Re: region server not response
Date Sat, 17 Nov 2012 05:01:29 GMT
Could you send the exact Exception that you had got.  The logs that you
have attached comes after the region server starts going down.

Regards
Ram

On Sat, Nov 17, 2012 at 9:38 AM, yutoo yanio <yutoo.yanio@gmail.com> wrote:

> my region server stopped after 30 minutes!!!!
> this my shutdown log
> after "2012-11-15 15:38:44,170 INFO
> org.apache.hadoop.hbase.regionserver.Leases: regionserver60020.leaseChecker
> closed leases" wait about 30mins and "2012-11-15 16:08:10,361 INFO
> org.apache.hadoop.hbase.regionserver.StoreFile: NO General Bloom and NO
> DeleteFamily was added to..."
>
> why??
>
>
> 2012-11-15 15:38:43,538 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
> IPC Server listener on 60020
> 2012-11-15 15:38:43,538 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC
> Server handler 4 on 60020: exiting
> 2012-11-15 15:38:43,542 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
> IPC Server Responder
> 2012-11-15 15:38:43,542 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
> IPC Server Responder
> 2012-11-15 15:38:43,542 INFO
> org.apache.hadoop.hbase.regionserver.SplitLogWorker: Sending interrupt to
> stop the worker thread
> 2012-11-15 15:38:43,562 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer: Stopping infoServer
> 2012-11-15 15:38:43,563 INFO
> org.apache.hadoop.hbase.regionserver.SplitLogWorker: SplitLogWorker
> interrupted while waiting for task, exiting: java.lang.InterruptedException
> 2012-11-15 15:38:43,563 INFO
> org.apache.hadoop.hbase.regionserver.SplitLogWorker: SplitLogWorker
> n6,60020,1352965568246 exiting
> 2012-11-15 15:38:43,572 INFO org.mortbay.log: Stopped
> SelectChannelConnector@0.0.0.0:60030
> 2012-11-15 15:38:43,701 DEBUG
> org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> started; Attempting to free 483.41 MB of total=4.03 GB
> 2012-11-15 15:38:43,737 DEBUG
> org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> completed; freed=483.42 MB, total=3.56 GB, single=1.01 GB, multi=2.97 GB,
> memory=0 KB
> 2012-11-15 15:38:44,169 INFO org.apache.hadoop.hbase.regionserver.Leases:
> regionserver60020.leaseChecker closing leases
> 2012-11-15 15:38:44,170 INFO org.apache.hadoop.hbase.regionserver.Leases:
> regionserver60020.leaseChecker closed leases
> 2012-11-15 16:08:10,361 INFO
> org.apache.hadoop.hbase.regionserver.StoreFile: NO General Bloom and NO
> DeleteFamily was added to HFile
>
> (hdfs://m2/hbase/table1/cc44e74d2b64c638d5e9d88b33b71633/.tmp/d204665e2a7446758e3575057f48bc4f)
> 2012-11-15 16:08:10,361 INFO org.apache.hadoop.hbase.regionserver.Store:
> Flushed , sequenceid=275054780, memsize=128.0m, into tmp file
>
> hdfs://m2/hbase/table1/cc44e74d2b64c638d5e9d88b33b71633/.tmp/d204665e2a7446758e3575057f48bc4f
> 2012-11-15 16:08:10,374 DEBUG org.apache.hadoop.hbase.regionserver.Store:
> Renaming flushed file at
>
> hdfs://m2/hbase/table1/cc44e74d2b64c638d5e9d88b33b71633/.tmp/d204665e2a7446758e3575057f48bc4f
> to
>
> hdfs://m2/hbase/table1/cc44e74d2b64c638d5e9d88b33b71633/table2/d204665e2a7446758e3575057f48bc4f
> 2012-11-15 16:08:10,386 INFO org.apache.hadoop.hbase.regionserver.Store:
> Added
>
> hdfs://m2/hbase/table1/cc44e74d2b64c638d5e9d88b33b71633/table2/d204665e2a7446758e3575057f48bc4f,
> entries=541204, sequenceid=275054780, filesize=35.2m
> 2012-11-15 16:08:10,387 INFO org.apache.hadoop.hbase.regionserver.HRegion:
> Finished memstore flush of ~128.0m/134218592, currentsize=78.9m/82739248
> for region
> table1,09366395507%20121105,1352812474398.cc44e74d2b64c638d5e9d88b33b71633.
> in 4514605ms, sequenceid=275054780, compaction requested=false
> 2012-11-15 16:08:10,388 INFO
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher:
> regionserver60020.cacheFlusher exiting
> 2012-11-15 16:08:10,428 DEBUG
> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter: using new
> createWriter -- HADOOP-6840
> 2012-11-15 16:08:10,428 DEBUG
> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter:
>
> Path=hdfs://m2/hbase/.logs/n6,60020,1352965568246/n6%2C60020%2C1352965568246.1352983090387,
> syncFs=true, hflush=false, compression=false
> 2012-11-15 16:08:10,475 INFO org.apache.hadoop.hbase.regionserver.wal.HLog:
> Roll
>
> /hbase/.logs/n6,60020,1352965568246/n6%2C60020%2C1352965568246.1352976383263,
> entries=12, filesize=1742.  for
>
> /hbase/.logs/n6,60020,1352965568246/n6%2C60020%2C1352965568246.1352983090387
> 2012-11-15 16:08:10,475 DEBUG
> org.apache.hadoop.hbase.regionserver.wal.HLog: Last sequenceid written is
> empty. Deleting all old hlogs
> 2012-11-15 16:08:10,475 INFO org.apache.hadoop.hbase.regionserver.wal.HLog:
> moving old hlog file
>
> /hbase/.logs/n6,60020,1352965568246/n6%2C60020%2C1352965568246.1352976383263
> whose highest sequenceid is 275054780 to
> /hbase/.oldlogs/n6%2C60020%2C1352965568246.1352976383263
> 2012-11-15 16:08:10,487 INFO
> org.apache.hadoop.hbase.regionserver.LogRoller: LogRoller exiting.
>
> On Thu, Nov 15, 2012 at 8:50 PM, ramkrishna vasudevan <
> ramkrishna.s.vasudevan@gmail.com> wrote:
>
> > Check your UI.  Does it show any regions in transition?
> >
> > Can you try doing kill -9 and restart the region server.
> >
> > Regards
> > Ram
> >
> > On Thu, Nov 15, 2012 at 5:48 PM, yutoo yanio <yutoo.yanio@gmail.com>
> > wrote:
> >
> > > hi every body
> > >
> > > in my cluster sometime a region server not responsed  and we give
> > exception
> > > like this :
> > > "org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException:
> > > Failed 22 actions: servers with issues: n6:60020"
> > > after this exception i check log of n6 and log has not any exception
> but
> > > region server does not responsed.
> > > when i run "hbase-daemon.sh stop regionserver" on n6, this command does
> > not
> > > complete( show unlimited dot in screen)
> > >
> > > i should run "kill -9" to kill the region server process and run again.
> > >
> > > what happened?
> > > thanks.
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message