hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siddharth Karandikar <siddharth.karandi...@gmail.com>
Subject Re: export snapshot of cloned table fails
Date Tue, 01 Oct 2013 12:17:06 GMT
Thanks a lot Matteo for quick response.
I will upgrade to 0.94.12 then ...

Thanks,
Siddharth

On Tue, Oct 1, 2013 at 3:26 PM, Matteo Bertozzi <theo.bertozzi@gmail.com> wrote:
> that is a bad hfileLink name creation in the visitReferencedFiles/storeFile
> when you have already a hfileLink.
> it is fixed in 0.94.12 by HBASE-8760
>
> Matteo
>
>
>
> On Tue, Oct 1, 2013 at 6:43 AM, Siddharth Karandikar <
> siddharth.karandikar@gmail.com> wrote:
>
>> Btw, I am running on 0.94.10.
>>
>> On Tue, Oct 1, 2013 at 11:12 AM, Siddharth Karandikar
>> <siddharth.karandikar@gmail.com> wrote:
>> > Hi,
>> >
>> > Here is the output of SnapshotInfo
>> >
>> > hbase2-bigdata:~/siddharth/tools/hbase-0.94.10 # ./bin/hbase
>> > org.apache.hadoop.hbase.snapshot.SnapshotInfo
>> > -Dfs.default.name=hdfs://hbase2-bigdata.vxindia.veritas.com:9000/
>> > -snapshot CMT2SS1 -files
>> > Snapshot Info
>> > ----------------------------------------
>> >    Name: CMT2SS1
>> >    Type: FLUSH
>> >   Table: CMT2
>> >  Format: 0
>> > Created: 2013-09-30T07:02:43
>> >
>> > Snapshot Files
>> > ----------------------------------------
>> >      0.0
>> CMT2/95d51af133141274fe2f0a9da79247cb/f1/MT2=d1bcc79d7e81c481c287cb1b7f6d78e2-9b57efdf5219495ebd15d0e0b227007c
>> > 13/09/30 23:41:43 INFO util.FSVisitor: No logs under
>> > directory:hdfs://
>> hbase2-bigdata.vxindia.veritas.com:9000/hbase/.hbase-snapshot/CMT2SS1/.logs
>> >
>> > 1 HFiles (0 in archive), total size 0.0 (NaN% 0.0 shared with the source
>> table)
>> > 0 Logs, total size 0.0
>> >
>> >
>> >
>> > Thanks,
>> > Siddharth
>> >
>> > On Mon, Sep 30, 2013 at 7:25 PM, Matteo Bertozzi
>> > <theo.bertozzi@gmail.com> wrote:
>> >> The input name looks wrong, not an hfileLink.
>> >> How that was created?
>> >> could you dump the snapshots files with hbase
>> >> org.apache.hadoop.hbase.SnapshotInfo -snapshot NAME -files
>> >>
>> >> Matteo
>> >>
>> >>
>> >>
>> >> On Mon, Sep 30, 2013 at 2:36 PM, Siddharth Karandikar <
>> >> siddharth.karandikar@gmail.com> wrote:
>> >>
>> >>> Hi,
>> >>>
>> >>> I have reached a situation where good old ExportSnapshot fails
>> >>>
>> >>> Here is what I am doing
>> >>>
>> >>> 1) Create table MT2
>> >>> 2) Take a snapshot of MT2 -> MT2SS1
>> >>> 3) Export MT2SS1 - works
>> >>>
>> >>> 4) Drop MT2, delete MT2SS1 from source system
>> >>> 5) Export back (import) MT2SS1 - works
>> >>>
>> >>> 6) Clone a table using MT2SS1 -> CMT2
>> >>> 7) Take a snapshot of CMT2 -> CMT2SS1
>> >>> 8) Export CMT2SS1 - FAILS
>> >>>
>> >>> Though the steps look complex, I feel, it is going to be very common
>> >>> to take snapshot of cloned (restored?) table and export that snapshot.
>> >>>
>> >>> Here is the whole output of ExportSnapshot -
>> http://pastebin.com/N1f0Kg1a
>> >>>
>> >>>
>> >>> I think  storeFile (..) in SnapshotReferenceUtil.visitReferencedFiles
>> >>> is creating a path like
>> >>>
>> >>>
>> "f1/CMT2=95d51af133141274fe2f0a9da79247cb-MT2=d1bcc79d7e81c481c287cb1b7f6d78e2-9b57efdf5219495ebd15d0e0b227007c"
>> >>> which is making it fail later.
>> >>>
>> >>>
>> >>> Thanks,
>> >>> Siddharth
>> >>>
>>

Mime
View raw message