hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manjeet Singh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-19071) Import from Hbase version 0.94.27 to higher version 1.2.1 not working
Date Mon, 23 Oct 2017 17:42:00 GMT
Manjeet Singh created HBASE-19071:

             Summary: Import from Hbase version 0.94.27 to higher version 1.2.1 not working

                 Key: HBASE-19071
                 URL: https://issues.apache.org/jira/browse/HBASE-19071
             Project: HBase
          Issue Type: Bug
          Components: hbase
    Affects Versions: 1.2.1
            Reporter: Manjeet Singh

Data migration from one cluster to another cluster in same N/W, but with a different version
of hbase one is 0.94.27 (source cluster hbase) and another is destination cluster hbase version
is 1.2.1. is not working.

I have used below command to take backup of hbase table on source cluster is:
 ./hbase org.apache.hadoop.hbase.mapreduce.Export SPDBRebuild /data/backupData/
and as a result below files were genrated by using above command:-
drwxr-xr-x 3 root root        4096 Dec  9  2016 _logs
-rw-r--r-- 1 root root   788227695 Dec 16  2016 part-m-00000
-rw-r--r-- 1 root root  1098757026 Dec 16  2016 part-m-00001
-rw-r--r-- 1 root root   906973626 Dec 16  2016 part-m-00002
-rw-r--r-- 1 root root  1981769314 Dec 16  2016 part-m-00003
-rw-r--r-- 1 root root  2099785782 Dec 16  2016 part-m-00004
-rw-r--r-- 1 root root  4118835540 Dec 16  2016 part-m-00005
-rw-r--r-- 1 root root 14217981341 Dec 16  2016 part-m-00006
-rw-r--r-- 1 root root           0 Dec 16  2016 _SUCCESS
 I import these file in another Hbase version (1.2.1)

in order to restore these files I am assuming I have to move these files in destination cluster
and have to run below command 

hbase org.apache.hadoop.hbase.mapreduce.Import <tablename> <hdfs path on same cluster>

sudo -u hdfs hbase org.apache.hadoop.hbase.mapreduce.Import test_table  hdfs://<IP>:8020/data/ExportedFiles

I am getting below error

17/10/23 16:13:50 INFO mapreduce.Job: Task Id : attempt_1505781444745_0070_m_000003_0, Status
Error: java.io.IOException: keyvalues=NONE read 2 bytes, should read 121347
        at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:2306)
        at org.apache.hadoop.mapreduce.lib.input.SequenceFileRecordReader.nextKeyValue(SequenceFileRecordReader.java:78)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556)
        at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
        at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

This message was sent by Atlassian JIRA

View raw message