hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yu Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5472) LoadIncrementalHFiles loops forever if the target table misses a CF
Date Mon, 22 Apr 2013 15:31:17 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638104#comment-13638104

Yu Li commented on HBASE-5472:

Hi all,

I checked the test report, it failed on TestAtomicOperation#testMultiRowMutationMultiThreads.
I checked the code path of this test case, and don't think modification in the v3 patch would
affect this case(it's irrelavant to bulkload). Also, I have run the test case in my local
env with below command, and it passed w/o error, so I personally think it's only an intermittent
failure not brought by patch attached here.
{noformat}mvn -Dtest=TestAtomicOperation#testMultiRowMutationMultiThreads test{noformat}

@Ted and @Nick, looking forward to your further comments, thanks.
> LoadIncrementalHFiles loops forever if the target table misses a CF
> -------------------------------------------------------------------
>                 Key: HBASE-5472
>                 URL: https://issues.apache.org/jira/browse/HBASE-5472
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.94.3, 0.94.4, 0.95.0
>            Reporter: Lars Hofhansl
>            Assignee: Yu Li
>            Priority: Minor
>         Attachments: HBASE-5472-trunk.patch, HBASE-5472-trunk-v2.patch, HBASE-5472-trunk-v3.patch
> I have some HFiles for two column families 'y','z', but I specified a target table that
only has CF 'y'.
> I see the following repeated forever.
> ...
> 12/02/23 22:57:37 WARN mapreduce.LoadIncrementalHFiles: Attempt to bulk load region containing
 into table z with files [family:y path:hdfs://bunnypig:9000/bulk/z2/y/bd6f1c3cc8b443fc9e9e5fddcdaa3b09,
family:z path:hdfs://bunnypig:9000/bulk/z2/z/38f12fdbb7de40e8bf0e6489ef34365d] failed.  This
is recoverable and they will be retried.
> 12/02/23 22:57:37 DEBUG client.MetaScanner: Scanning .META. starting at row=z,,00000000000000
for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7b7a4989
> 12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Split occured while grouping
HFiles, retry attempt 1596 with 2 files remaining to group or split
> 12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://bunnypig:9000/bulk/z2/y/bd6f1c3cc8b443fc9e9e5fddcdaa3b09
first=r last=r
> 12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://bunnypig:9000/bulk/z2/z/38f12fdbb7de40e8bf0e6489ef34365d
first=r last=r
> 12/02/23 22:57:37 DEBUG mapreduce.LoadIncrementalHFiles: Going to connect to server region=z,,1330066309814.d5fa76a38c9565f614755e34eacf8316.,
hostname=localhost, port=60020 for row 
> ...

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message