hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guangle Fan <fanguan...@gmail.com>
Subject Re: copy snapshot for scanner "no table descriptor found"
Date Wed, 10 Sep 2014 19:41:55 GMT
Sorry correct my words.
The snapshot was created by 0.98.1 cdh5.1.0 (new format of snapshot)
And reading where the failure happened is using 0.96.1.1 cdh5.0.1 (still
looking for old format)

On Wed, Sep 10, 2014 at 12:35 PM, Guangle Fan <fanguangle@gmail.com> wrote:

> Hi, Matteo
>
> Thanks for the replay! The version I'm running is 0.98.1 cdh5.1.0 from
> Cloudera, Yes, it doesn't apply that new format yet.
>
> Guangle
>
> On Wed, Sep 10, 2014 at 11:50 AM, Matteo Bertozzi <theo.bertozzi@gmail.com
> > wrote:
>
>> you are probably not using hbase 0.98.1 or you were mixing different
>> version
>> The data.manifest got in master/0.98.6 so, the snapshot is generated with
>> one of those,
>> and you are may be reading with a version that does not support the new
>> format
>>
>> Matteo
>>
>>
>> On Wed, Sep 10, 2014 at 11:13 AM, Guangle Fan <fanguangle@gmail.com>
>> wrote:
>>
>> > Hi,
>> >
>> > I'm running hbase 0.98.1
>> >
>> > When using TableMapReduceUtil to init a MR job on a snapshot, I got an
>> > error :
>> >
>> > org.apache.hadoop.hbase.TableInfoMissingException: No table descriptor
>> file
>> > under hdfs://hbase/hbase/.hbase-snapshot/xxx-snapshot
>> >
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.util.FSTableDescriptors.getTableDescriptorFromFs(FSTableDescriptors.java:481)
>> >
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.snapshot.RestoreSnapshotHelper.copySnapshotForScanner(RestoreSnapshotHelper.java:725)
>> >
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat.setInput(TableSnapshotInputFormat.java:394)
>> >
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableSnapshotMapperJob(TableMapReduceUtil.java:300)
>> >
>> > at
>> com.flipboard.etl.MRJobs2.aggregateMagazineMetaByUser(MRJobs2.java:538)
>> >
>> > at com.flipboard.etl.MapReduceRunner2.run(MapReduceRunner2.java:164)
>> >
>> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> >
>> > at com.flipboard.etl.MapReduceRunner2.main(MapReduceRunner2.java:68)
>> >
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >
>> > at
>> >
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> >
>> > at
>> >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >
>> > at java.lang.reflect.Method.invoke(Method.java:597)
>> >
>> >  at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>> >
>> >
>> > It's looking for .tableinfo file under snapshot directory, but there are
>> > only two files there :
>> >
>> > -rwxr-xr-x   3 hbase hadoop         51 2014-09-10 00:49
>> > hdfs://hbase/hbase/.hbase-snapshot/xxx-snapshot/.snapshotinfo
>> >
>> > -rw-r--r--   3 hbase hadoop      11733 2014-09-10 00:49
>> > hdfs://hbase/hbase/.hbase-snapshot/xxx-snapshot/data.manifest
>> >
>> >
>> > The snapshot was created by hbase shell :
>> >
>> > snapshot 'xxx', 'xxx-snapshot'
>> >
>> >
>> > Any ideas why there is such inconsistency ?
>> >
>> >
>> > Thanks!
>> >
>> >
>> > Guangle
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message