Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 23 Oct 2017 17:42:00 +0000 (UTC)
From: "Manjeet Singh (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.13111487.1508780478000.36514.1508780520599@Atlassian.JIRA>
In-Reply-To: <JIRA.13111487.1508780478000@Atlassian.JIRA>
References: <JIRA.13111487.1508780478000@Atlassian.JIRA> <JIRA.13111487.1508780478868@jira-lw-us.apache.org>
Subject: [jira] [Created] (HBASE-19071) Import from Hbase version 0.94.27 to
 higher version 1.2.1 not working
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 23 Oct 2017 17:42:05 -0000

Manjeet Singh created HBASE-19071:
-------------------------------------

             Summary: Import from Hbase version 0.94.27 to higher version 1.2.1 not working 
                 Key: HBASE-19071
                 URL: https://issues.apache.org/jira/browse/HBASE-19071
             Project: HBase
          Issue Type: Bug
          Components: hbase
    Affects Versions: 1.2.1
            Reporter: Manjeet Singh


Data migration from one cluster to another cluster in same N/W, but with a different version of hbase one is 0.94.27 (source cluster hbase) and another is destination cluster hbase version is 1.2.1. is not working.

I have used below command to take backup of hbase table on source cluster is:
 ./hbase org.apache.hadoop.hbase.mapreduce.Export SPDBRebuild /data/backupData/
and as a result below files were genrated by using above command:-
drwxr-xr-x 3 root root        4096 Dec  9  2016 _logs
-rw-r--r-- 1 root root   788227695 Dec 16  2016 part-m-00000
-rw-r--r-- 1 root root  1098757026 Dec 16  2016 part-m-00001
-rw-r--r-- 1 root root   906973626 Dec 16  2016 part-m-00002
-rw-r--r-- 1 root root  1981769314 Dec 16  2016 part-m-00003
-rw-r--r-- 1 root root  2099785782 Dec 16  2016 part-m-00004
-rw-r--r-- 1 root root  4118835540 Dec 16  2016 part-m-00005
-rw-r--r-- 1 root root 14217981341 Dec 16  2016 part-m-00006
-rw-r--r-- 1 root root           0 Dec 16  2016 _SUCCESS
 I import these file in another Hbase version (1.2.1)

in order to restore these files I am assuming I have to move these files in destination cluster and have to run below command 

hbase org.apache.hadoop.hbase.mapreduce.Import <tablename> <hdfs path on same cluster> 


sudo -u hdfs hbase org.apache.hadoop.hbase.mapreduce.Import test_table  hdfs://<IP>:8020/data/ExportedFiles

I am getting below error

17/10/23 16:13:50 INFO mapreduce.Job: Task Id : attempt_1505781444745_0070_m_000003_0, Status : FAILED
Error: java.io.IOException: keyvalues=NONE read 2 bytes, should read 121347
        at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:2306)
        at org.apache.hadoop.mapreduce.lib.input.SequenceFileRecordReader.nextKeyValue(SequenceFileRecordReader.java:78)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556)
        at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
        at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)