hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anil gupta <anilgupt...@gmail.com>
Subject Re: Unable to see old tables after migrating from 0.94 to 0.98
Date Tue, 29 Jul 2014 00:45:12 GMT
Hi Stack,

I basically did full table scan for hbase:meta by running this(since
cluster has 2-3 regions only): scan 'hbase:meta', {RAW => true, VERSIONS =>
10}
Output of above query shows rows for "hbase:namespace" and "dummy" table.
So, it seems like hbase:meta doesn't have any old data.

Our sysadmin team is still trying to locate all the logs. However, i
remember one error that i resolved. I was related to "hbase.versions" file.
It was some complaint about Protbouf version. I deleted hbase.versions file
and then HBase came up. I'll update this email once i get more details
about error logs.

Here are the steps we followed to migrate:
1. Ran parcel update of CDH
2. Restarted HBase
3. ShutDown HBAse
4. Ran "hbase upgrade -execute"

After reading the upgrade steps, It seems "hbase upgrade -execute" should
have been taken before Restarting HBase?
We have run "hbase upgrade -execute" many times now but its not helping us.
Data of 0.94 tables is still present in HDFS.

Thanks,
Anil Gupta



On Mon, Jul 28, 2014 at 3:30 PM, Stack <stack@duboce.net> wrote:

> You have log from migration Anil?  Any complaints there?  Can you scan the
> .META. back in time?  If you specify timestamp that is before your update,
> do you see anything?
>
> St.Ack
>
>
> On Mon, Jul 28, 2014 at 1:55 PM, anil gupta <anilgupta84@gmail.com> wrote:
>
> > Hi All,
> >
> > We upgraded from HBase0.94.15(cdh4.5) to HBase0.98.1(cdh5.1). We are able
> > to CRUD if we create new tables. However, old tables are not showing up.
> > I checked ZK, and i can see znodes of 0.94 tables under /hbase/table94 .
> I
> > looked into hbase:meta table and i did not find any of my 0.94 tables in
> > it. I see rows for the tables that i created in HBase0.98. We need to get
> > back those tables.
> >
> > I also tried to run "hbase hbck". But hbck is giving following error:
> > Exception in thread "main" java.io.IOException:
> > org.apache.zookeeper.KeeperException$DataInconsistencyException:
> > KeeperErrorCode = DataInconsistency
> >     at
> > org.apache.hadoop.hbase.util.HBaseFsck$1.connect(HBaseFsck.java:1390)
> >     at
> > org.apache.hadoop.hbase.util.HBaseFsck$1.connect(HBaseFsck.java:1380)
> >     at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.execute(HConnectionManager.java:552)
> >     at
> >
> >
> org.apache.hadoop.hbase.util.HBaseFsck.loadDisabledTables(HBaseFsck.java:1380)
> >     at
> >
> >
> org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:459)
> >     at
> > org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:484)
> >     at org.apache.hadoop.hbase.util.HBaseFsck.exec(HBaseFsck.java:4032)
> >     at
> >
> >
> org.apache.hadoop.hbase.util.HBaseFsck$HBaseFsckTool.run(HBaseFsck.java:3841)
> >     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> >     at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:3829)
> > Caused by:
> org.apache.zookeeper.KeeperException$DataInconsistencyException:
> > KeeperErrorCode = DataInconsistency
> >     at org.apache.hadoop.hbase.zookeeper.ZKUtil.convert(ZKUtil.java:1859)
> >     at
> >
> >
> org.apache.hadoop.hbase.zookeeper.ZKTableReadOnly.getTableState(ZKTableReadOnly.java:164)
> >     at
> >
> >
> org.apache.hadoop.hbase.zookeeper.ZKTableReadOnly.getDisabledOrDisablingTables(ZKTableReadOnly.java:128)
> >     at
> > org.apache.hadoop.hbase.util.HBaseFsck$1.connect(HBaseFsck.java:1386)
> >     ... 10 more
> > Caused by: org.apache.hadoop.hbase.exceptions.DeserializationException:
> > Missing pb magic PBUF prefix
> >     at
> >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.expectPBMagicPrefix(ProtobufUtil.java:256)
> >     at
> >
> >
> org.apache.hadoop.hbase.zookeeper.ZKTableReadOnly.getTableState(ZKTableReadOnly.java:154)
> >     ... 12 more
> >
> > Is there any utility that can write the meta data for 0.94 tables? Also,
> i
> > would like to fix "DeserializationException: Missing pb magic PBUF
> prefix".
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
>



-- 
Thanks & Regards,
Anil Gupta

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message