hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: meta region written by 2.0 cannot be opened by 1.x
Date Tue, 06 Dec 2016 16:50:07 GMT
The build I used yesterday didn't include HBASE-16189
<https://issues.apache.org/jira/browse/HBASE-16189>

Once it is included, the cluster can be downgraded fine.

I wonder how users would know that their existing deployment has HBASE-16189
<https://issues.apache.org/jira/browse/HBASE-16189> before upgrading to 2.0
release.

On Tue, Dec 6, 2016 at 2:29 AM, ramkrishna vasudevan <
ramkrishna.s.vasudevan@gmail.com> wrote:

> @Ted
> Does your version have this fix
> https://issues.apache.org/jira/browse/HBASE-16189
>
> Regards
> Ram
>
> On Tue, Dec 6, 2016 at 3:56 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > Is the assumption that hbase:meta would not split ?
> >
> > In other thread, Francis Liu was proposing supporting splittable
> > hbase:meta in 2.0 release.
> >
> > Cheers
> >
> > > On Dec 6, 2016, at 2:20 AM, 张铎 <palomino219@gmail.com> wrote:
> > >
> > > Could this be solved by hosting meta only on master?
> > >
> > > BTW, MetaCellComparator is introduced in HBASE-10800.
> > >
> > > Thanks.
> > >
> > > 2016-12-06 17:44 GMT+08:00 Ted Yu <yuzhihong@gmail.com>:
> > >
> > >> Hi,
> > >> When I restarted a cluster with 1.1 , I found that hbase:meta region
> > >> (written to by the previously deployed 2.0) couldn't be opened:
> > >>
> > >> Caused by: java.io.IOException:
> > >> org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem
> reading
> > >> HFile Trailer from file hdfs://yz1.xx.com:8020/apps/
> hbase/data/data/
> > >> hbase/meta/1588230740/info/599fc8a37311414e876803312009a986
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HStore.
> openStoreFiles(HStore.java:
> > >> 579)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HStore.
> loadStoreFiles(HStore.java:
> > >> 534)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:275)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HRegion.
> instantiateHStore(HRegion.
> > >> java:5150)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:912)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:909)
> > >>        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >>        at
> > >> java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> > >>        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >>        ... 3 more
> > >> Caused by: org.apache.hadoop.hbase.io.hfile.CorruptHFileException:
> > Problem
> > >> reading HFile Trailer from file hdfs://
> > >> yz1.xx.com:8020/apps/hbase/data/data/hbase/ meta/1588230740/
> > >> info/599fc8a37311414e876803312009a986
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(
> > HFile.java:483)
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.HFile.createReader(HFile.java:511)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.
> > >> <init>(StoreFile.java:1128)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.StoreFileInfo.
> > >> open(StoreFileInfo.java:267)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.StoreFile.open(
> StoreFile.java:409)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.StoreFile.
> > >> createReader(StoreFile.java:517)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HStore.createStoreFileAndReader(
> > >> HStore.java:687)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HStore.access$
> 000(HStore.java:130)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:554)
> > >>        at
> > >> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:551)
> > >>        ... 6 more
> > >> Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> > >> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(
> > >> FixedFileTrailer.java:581)
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.deserializeFromPB(
> > >> FixedFileTrailer.java:300)
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.
> > >> deserialize(FixedFileTrailer.java:242)
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(
> > >> FixedFileTrailer.java:407)
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(
> > HFile.java:468)
> > >>        ... 15 more
> > >> Caused by: java.lang.ClassNotFoundException:
> > >> org.apache.hadoop.hbase.CellComparator$MetaCellComparator
> > >>        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > >>        at sun.misc.Launcher$AppClassLoader.loadClass(
> Launcher.java:331)
> > >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > >>        at java.lang.Class.forName0(Native Method)
> > >>        at java.lang.Class.forName(Class.java:264)
> > >>        at
> > >> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(
> > >> FixedFileTrailer.java:579)
> > >>
> > >> When user does rolling upgrade from 1.1 to 2.0, the above may cause
> > problem
> > >> if hbase:meta region is updated by server running 2.0 but later
> > assigned to
> > >> a region server which still runs 1.1 (due to crash of the server
> running
> > >> 2.0, e.g.)
> > >>
> > >> I want to get community feedback on the severity of this issue.
> > >>
> > >> Thanks
> > >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message