Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
From: Ted Yu <yuzhihong@gmail.com>
Content-Type: text/plain;
	charset=utf-8
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (1.0)
Subject: Re: meta region written by 2.0 cannot be opened by 1.x
Message-Id: <CA90C159-F08C-43A3-8BCB-F4CF645C69CF@gmail.com>
Date: Tue, 6 Dec 2016 02:26:36 -0800
References: <CALte62zeSZp=kG9B7x-3Zb=g2D5=VzgM1nLQV7q7CZs22het+Q@mail.gmail.com> <CAAAYAnOvB62xXpu5t7sx2tfsFkdXt6z09nbA3XDQ=74py-f2rA@mail.gmail.com>
In-Reply-To: <CAAAYAnOvB62xXpu5t7sx2tfsFkdXt6z09nbA3XDQ=74py-f2rA@mail.gmail.com>
To: dev@hbase.apache.org
archived-at: Tue, 06 Dec 2016 10:26:50 -0000

Is the assumption that hbase:meta would not split ?

In other thread, Francis Liu was proposing supporting splittable hbase:meta i=
n 2.0 release.=20

Cheers

> On Dec 6, 2016, at 2:20 AM, =E5=BC=A0=E9=93=8E <palomino219@gmail.com> wro=
te:
>=20
> Could this be solved by hosting meta only on master?
>=20
> BTW, MetaCellComparator is introduced in HBASE-10800.
>=20
> Thanks.
>=20
> 2016-12-06 17:44 GMT+08:00 Ted Yu <yuzhihong@gmail.com>:
>=20
>> Hi,
>> When I restarted a cluster with 1.1 , I found that hbase:meta region
>> (written to by the previously deployed 2.0) couldn't be opened:
>>=20
>> Caused by: java.io.IOException:
>> org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading
>> HFile Trailer from file hdfs://yz1.xx.com:8020/apps/  hbase/data/data/
>> hbase/meta/1588230740/info/599fc8a37311414e876803312009a986
>>        at
>> org.apache.hadoop.hbase.regionserver.HStore.openStoreFiles(HStore.java:
>> 579)
>>        at
>> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:
>> 534)
>>        at
>> org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:275)
>>        at
>> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.
>> java:5150)
>>        at
>> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:912)
>>        at
>> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:909)
>>        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>        at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>        ... 3 more
>> Caused by: org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Proble=
m
>> reading HFile Trailer from file hdfs://
>> yz1.xx.com:8020/apps/hbase/data/data/hbase/ meta/1588230740/
>> info/599fc8a37311414e876803312009a986
>>        at
>> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:483)
>>        at
>> org.apache.hadoop.hbase.io.hfile.HFile.createReader(HFile.java:511)
>>        at
>> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.
>> <init>(StoreFile.java:1128)
>>        at
>> org.apache.hadoop.hbase.regionserver.StoreFileInfo.
>> open(StoreFileInfo.java:267)
>>        at
>> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:409)
>>        at
>> org.apache.hadoop.hbase.regionserver.StoreFile.
>> createReader(StoreFile.java:517)
>>        at
>> org.apache.hadoop.hbase.regionserver.HStore.createStoreFileAndReader(
>> HStore.java:687)
>>        at
>> org.apache.hadoop.hbase.regionserver.HStore.access$000(HStore.java:130)
>>        at
>> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:554)
>>        at
>> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:551)
>>        ... 6 more
>> Caused by: java.io.IOException: java.lang.ClassNotFoundException:
>> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
>>        at
>> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(
>> FixedFileTrailer.java:581)
>>        at
>> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.deserializeFromPB(
>> FixedFileTrailer.java:300)
>>        at
>> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.
>> deserialize(FixedFileTrailer.java:242)
>>        at
>> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(
>> FixedFileTrailer.java:407)
>>        at
>> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:468)
>>        ... 15 more
>> Caused by: java.lang.ClassNotFoundException:
>> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
>>        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>>        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>        at java.lang.Class.forName0(Native Method)
>>        at java.lang.Class.forName(Class.java:264)
>>        at
>> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(
>> FixedFileTrailer.java:579)
>>=20
>> When user does rolling upgrade from 1.1 to 2.0, the above may cause probl=
em
>> if hbase:meta region is updated by server running 2.0 but later assigned t=
o
>> a region server which still runs 1.1 (due to crash of the server running
>> 2.0, e.g.)
>>=20
>> I want to get community feedback on the severity of this issue.
>>=20
>> Thanks
>>=20