hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-19006) Fix TestIncrementalBackupWithBulkLoad under hadoop3
Date Fri, 13 Oct 2017 21:58:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-19006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204247#comment-16204247
] 

Ted Yu commented on HBASE-19006:
--------------------------------

{code}
2017-10-13 13:55:56,703 WARN  [Thread-881] mapred.LocalJobRunner$Job(590): job_local876554327_0004
java.io.IOException: Inconsistent sequence file: current chunk file org.apache.hadoop.tools.CopyListingFileStatus@e44de415{hdfs://localhost:62602/user/vrodionov/test-data/
      6b218856-adc9-4659-ad15-868aa83e6c48/data/ns1/test-1507928111932/95d195f6a91639b50388e50fc8751d69/f/7e45c3c177964f0cb315c8d2456b8b90_SeqId_205_
length = 5100 aclEntries = null,  xAttrs = null} doesnt match prior entry org.apache.hadoop.tools.CopyListingFileStatus@a91b2cdf{hdfs://localhost:62602/user/vrodionov/test-data/6b218856-adc9-4659-ad15-
          868aa83e6c48/data/ns1/test-1507928111932/95d195f6a91639b50388e50fc8751d69/f/615e1b7549ff47b68a9d599ae7f6832f_SeqId_205_
length = 5142 aclEntries = null, xAttrs = null}
  at org.apache.hadoop.tools.mapred.CopyCommitter.concatFileChunks(CopyCommitter.java:269)
  at org.apache.hadoop.tools.mapred.CopyCommitter.commitJob(CopyCommitter.java:96)
  at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:567)
...
2017-10-13 13:55:56,830 ERROR [main] tools.DistCp(167): Exception encountered
java.lang.Exception: DistCp job-id: job_local876554327_0004 failed
  at org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupCopyJob$BackupDistCp.execute(MapReduceBackupCopyJob.java:248)
  at org.apache.hadoop.tools.DistCp.run(DistCp.java:153)
  at org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupCopyJob.copy(MapReduceBackupCopyJob.java:407)
  at org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.incrementalCopyHFiles(IncrementalTableBackupClient.java:300)
{code}
Interesting - the first stack trace was at WARN and second stack trace didn't reveal cause
...

> Fix TestIncrementalBackupWithBulkLoad under hadoop3
> ---------------------------------------------------
>
>                 Key: HBASE-19006
>                 URL: https://issues.apache.org/jira/browse/HBASE-19006
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>            Priority: Critical
>             Fix For: 2.0.0-beta-2
>
>         Attachments: org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad-output.txt.gz
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message