hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vrodio...@carrieriq.com>
Subject RE: -ROOT- is offline
Date Wed, 04 Jan 2012 20:15:35 GMT
This is 90.4 release

Best regards,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodionov@carrieriq.com

________________________________________
From: Vladimir Rodionov
Sent: Wednesday, January 04, 2012 12:08 PM
To: dev@hbase.apache.org
Subject: -ROOT- is offline

This is the log from

check-meta.rb run:

12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.18-274.3.1.el5
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Client environment:user.dir=/opt/msip/clients/CIQ-Performance/m2mDeployment/trunk.181-307704/hbase-0.90.1/bin
12/01/04 19:08:05 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=us01-ciqps1-name01.carrieriq.com:2181
sessionTimeout=490000 watcher=hconnection
12/01/04 19:08:05 INFO zookeeper.ClientCnxn: Opening socket connection to server us01-ciqps1-name01.carrieriq.com/XX.XX.XX.100:2181
12/01/04 19:08:05 INFO zookeeper.ClientCnxn: Socket connection established to us01-ciqps1-name01.carrieriq.com/XX.XX.XX.100:2181,
initiating session
12/01/04 19:08:05 INFO zookeeper.ClientCnxn: Session establishment complete on server us01-ciqps1-name01.carrieriq.com/XX.XX.XX.100:2181,
sessionid = 0x134aa18d2ef001f, negotiated timeout = 490000
12/01/04 19:08:05 DEBUG client.HConnectionManager$HConnectionImplementation: Lookedup root
region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7178b64b;
hsa=us01-ciqps1-grid04.carrieriq.com:60020
12/01/04 19:08:05 DEBUG client.HConnectionManager$HConnectionImplementation: locateRegionInMeta
parentTable=-ROOT-, metaLocation=address: us01-ciqps1-grid04.carrieriq.com:60020, regioninfo:
-ROOT-,,0.70236052, attempt=0 of 20 failed; retrying after sleep of 8000 because: org.apache.hadoop.hbase.NotServingRegionException:
Region is not online: -ROOT-,,0
        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2359)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.getClosestRowBefore(HRegionServer.java:1645)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)


We got the issue before with one of our nodes (looks like hardware failure) and I tried to
stop HBase cluster using regular script.
It got stuck in the middle and I had to kill RSs manually.

Now I can not start the cluster - I am getting this : Region is not online: -ROOT-,,0

What can be done in this situation to restore the cluster? I hate telling people that their
data will be lost (fortunately it is not in production).

Best regards,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodionov@carrieriq.com

________________________________________
From: Andrew Purtell [apurtell@apache.org]
Sent: Wednesday, January 04, 2012 10:23 AM
To: dev@hbase.apache.org
Subject: Re: HBase Hackathon @ EBay

The 19th works for me.

Whatever the format.

Hearing what is going on with the Cassini project ops wise would be reason enough to attend.

Best regards,


  - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)


>________________________________
> From: Ted Yu <yuzhihong@gmail.com>
>To: dev@hbase.apache.org
>Sent: Tuesday, January 3, 2012 3:29 PM
>Subject: HBase Hackathon @ EBay
>
>Hi,
>HBase 0.92 is about to be released.
>Todd Lipcon once asked how high our confidence was going through the cases
>in HBASE-4925 on HBase 0.92
>
>Well, let's find out the answer to Todd's question on Jan. 19th @ EBay :-)
>
>The theme for this Hackathon is on 0.92 stability.
>
>A meetup invitation would go out soon.
>
>Cheers
>
>
>

Confidentiality Notice:  The information contained in this message, including any attachments
hereto, may be confidential and is intended to be read only by the individual or entity to
whom this message is addressed. If the reader of this message is not the intended recipient
or an agent or designee of the intended recipient, please note that any review, use, disclosure
or distribution of this message or its attachments, in any form, is strictly prohibited. 
If you have received this message in error, please immediately notify the sender and/or Notifications@carrieriq.com
and delete or destroy any copy of this message and its attachments.

Mime
View raw message