hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: meta region written by 2.0 cannot be opened by 1.x
Date Tue, 06 Dec 2016 18:19:10 GMT
Looking at http://hbase.apache.org/book.html#executing.the.0.96.upgrade ,
there is step of running "bin/hbase upgrade -check"

How about adding a sample hfile which contains
CellComparator$MetaCellComparator
so that the upgrade check can read and verify ?

On Tue, Dec 6, 2016 at 8:50 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> The build I used yesterday didn't include HBASE-16189
> <https://issues.apache.org/jira/browse/HBASE-16189>
>
> Once it is included, the cluster can be downgraded fine.
>
> I wonder how users would know that their existing deployment has
> HBASE-16189 <https://issues.apache.org/jira/browse/HBASE-16189> before
> upgrading to 2.0 release.
>
> On Tue, Dec 6, 2016 at 2:29 AM, ramkrishna vasudevan <
> ramkrishna.s.vasudevan@gmail.com> wrote:
>
>> @Ted
>> Does your version have this fix
>> https://issues.apache.org/jira/browse/HBASE-16189
>>
>> Regards
>> Ram
>>
>> On Tue, Dec 6, 2016 at 3:56 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>>
>> > Is the assumption that hbase:meta would not split ?
>> >
>> > In other thread, Francis Liu was proposing supporting splittable
>> > hbase:meta in 2.0 release.
>> >
>> > Cheers
>> >
>> > > On Dec 6, 2016, at 2:20 AM, 张铎 <palomino219@gmail.com> wrote:
>> > >
>> > > Could this be solved by hosting meta only on master?
>> > >
>> > > BTW, MetaCellComparator is introduced in HBASE-10800.
>> > >
>> > > Thanks.
>> > >
>> > > 2016-12-06 17:44 GMT+08:00 Ted Yu <yuzhihong@gmail.com>:
>> > >
>> > >> Hi,
>> > >> When I restarted a cluster with 1.1 , I found that hbase:meta region
>> > >> (written to by the previously deployed 2.0) couldn't be opened:
>> > >>
>> > >> Caused by: java.io.IOException:
>> > >> org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem
>> reading
>> > >> HFile Trailer from file hdfs://yz1.xx.com:8020/apps/
>> hbase/data/data/
>> > >> hbase/meta/1588230740/info/599fc8a37311414e876803312009a986
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HStore.openStoreFiles(
>> HStore.java:
>> > >> 579)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(
>> HStore.java:
>> > >> 534)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:275)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHSto
>> re(HRegion.
>> > >> java:5150)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.
>> java:912)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.
>> java:909)
>> > >>        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > >>        at
>> > >> java.util.concurrent.Executors$RunnableAdapter.call(
>> Executors.java:511)
>> > >>        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > >>        ... 3 more
>> > >> Caused by: org.apache.hadoop.hbase.io.hfile.CorruptHFileException:
>> > Problem
>> > >> reading HFile Trailer from file hdfs://
>> > >> yz1.xx.com:8020/apps/hbase/data/data/hbase/ meta/1588230740/
>> > >> info/599fc8a37311414e876803312009a986
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(
>> > HFile.java:483)
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.HFile.createReader(HFile.java:511)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.
>> > >> <init>(StoreFile.java:1128)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.StoreFileInfo.
>> > >> open(StoreFileInfo.java:267)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFil
>> e.java:409)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.StoreFile.
>> > >> createReader(StoreFile.java:517)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HStore.createStoreFileA
>> ndReader(
>> > >> HStore.java:687)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HStore.access$000(
>> HStore.java:130)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:554)
>> > >>        at
>> > >> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:551)
>> > >>        ... 6 more
>> > >> Caused by: java.io.IOException: java.lang.ClassNotFoundException:
>> > >> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getCompara
>> torClass(
>> > >> FixedFileTrailer.java:581)
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.deserializeFromPB(
>> > >> FixedFileTrailer.java:300)
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.
>> > >> deserialize(FixedFileTrailer.java:242)
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(
>> > >> FixedFileTrailer.java:407)
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(
>> > HFile.java:468)
>> > >>        ... 15 more
>> > >> Caused by: java.lang.ClassNotFoundException:
>> > >> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
>> > >>        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>> > >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>> > >>        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
>> 331)
>> > >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>> > >>        at java.lang.Class.forName0(Native Method)
>> > >>        at java.lang.Class.forName(Class.java:264)
>> > >>        at
>> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getCompara
>> torClass(
>> > >> FixedFileTrailer.java:579)
>> > >>
>> > >> When user does rolling upgrade from 1.1 to 2.0, the above may cause
>> > problem
>> > >> if hbase:meta region is updated by server running 2.0 but later
>> > assigned to
>> > >> a region server which still runs 1.1 (due to crash of the server
>> running
>> > >> 2.0, e.g.)
>> > >>
>> > >> I want to get community feedback on the severity of this issue.
>> > >>
>> > >> Thanks
>> > >>
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message