hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 张铎 <palomino...@gmail.com>
Subject Re: meta region written by 2.0 cannot be opened by 1.x
Date Tue, 06 Dec 2016 10:20:33 GMT
Could this be solved by hosting meta only on master?

BTW, MetaCellComparator is introduced in HBASE-10800.

Thanks.

2016-12-06 17:44 GMT+08:00 Ted Yu <yuzhihong@gmail.com>:

> Hi,
> When I restarted a cluster with 1.1 , I found that hbase:meta region
> (written to by the previously deployed 2.0) couldn't be opened:
>
> Caused by: java.io.IOException:
> org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading
> HFile Trailer from file hdfs://yz1.xx.com:8020/apps/  hbase/data/data/
>  hbase/meta/1588230740/info/599fc8a37311414e876803312009a986
>         at
> org.apache.hadoop.hbase.regionserver.HStore.openStoreFiles(HStore.java:
> 579)
>         at
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:
> 534)
>         at
> org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:275)
>         at
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.
> java:5150)
>         at
> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:912)
>         at
> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:909)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         ... 3 more
> Caused by: org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem
> reading HFile Trailer from file hdfs://
> yz1.xx.com:8020/apps/hbase/data/data/hbase/ meta/1588230740/
>  info/599fc8a37311414e876803312009a986
>         at
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:483)
>         at
> org.apache.hadoop.hbase.io.hfile.HFile.createReader(HFile.java:511)
>         at
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.
> <init>(StoreFile.java:1128)
>         at
> org.apache.hadoop.hbase.regionserver.StoreFileInfo.
> open(StoreFileInfo.java:267)
>         at
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:409)
>         at
> org.apache.hadoop.hbase.regionserver.StoreFile.
> createReader(StoreFile.java:517)
>         at
> org.apache.hadoop.hbase.regionserver.HStore.createStoreFileAndReader(
> HStore.java:687)
>         at
> org.apache.hadoop.hbase.regionserver.HStore.access$000(HStore.java:130)
>         at
> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:554)
>         at
> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:551)
>         ... 6 more
> Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
>         at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(
> FixedFileTrailer.java:581)
>         at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.deserializeFromPB(
> FixedFileTrailer.java:300)
>         at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.
> deserialize(FixedFileTrailer.java:242)
>         at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(
> FixedFileTrailer.java:407)
>         at
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:468)
>         ... 15 more
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:264)
>         at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(
> FixedFileTrailer.java:579)
>
> When user does rolling upgrade from 1.1 to 2.0, the above may cause problem
> if hbase:meta region is updated by server running 2.0 but later assigned to
> a region server which still runs 1.1 (due to crash of the server running
> 2.0, e.g.)
>
> I want to get community feedback on the severity of this issue.
>
> Thanks
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message