hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5472) LoadIncrementalHFiles loops forever if the target table misses a CF
Date Mon, 22 Apr 2013 18:05:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638238#comment-13638238
] 

Ted Yu commented on HBASE-5472:
-------------------------------

{code}
+    // family name in HFiles are invalid
{code}
Please make the plurality of 'name' and 'are' consistent.
{code}
+      // further check whether the exception message is correct
+      String errMsg = e.getMessage();
+      String expectedMsg = "invalid family name found";
{code}
Can you define expectedMsg in LoadIncrementalHFiles as package private variable and reference
it from the test ?
That way the chance of the test being broken in the future is lower.
                
> LoadIncrementalHFiles loops forever if the target table misses a CF
> -------------------------------------------------------------------
>
>                 Key: HBASE-5472
>                 URL: https://issues.apache.org/jira/browse/HBASE-5472
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.94.3, 0.94.4, 0.95.0
>            Reporter: Lars Hofhansl
>            Assignee: Yu Li
>            Priority: Minor
>         Attachments: HBASE-5472-trunk.patch, HBASE-5472-trunk-v2.patch, HBASE-5472-trunk-v3.patch
>
>
> I have some HFiles for two column families 'y','z', but I specified a target table that
only has CF 'y'.
> I see the following repeated forever.
> ...
> 12/02/23 22:57:37 WARN mapreduce.LoadIncrementalHFiles: Attempt to bulk load region containing
 into table z with files [family:y path:hdfs://bunnypig:9000/bulk/z2/y/bd6f1c3cc8b443fc9e9e5fddcdaa3b09,
family:z path:hdfs://bunnypig:9000/bulk/z2/z/38f12fdbb7de40e8bf0e6489ef34365d] failed.  This
is recoverable and they will be retried.
> 12/02/23 22:57:37 DEBUG client.MetaScanner: Scanning .META. starting at row=z,,00000000000000
for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7b7a4989
> 12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Split occured while grouping
HFiles, retry attempt 1596 with 2 files remaining to group or split
> 12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://bunnypig:9000/bulk/z2/y/bd6f1c3cc8b443fc9e9e5fddcdaa3b09
first=r last=r
> 12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://bunnypig:9000/bulk/z2/z/38f12fdbb7de40e8bf0e6489ef34365d
first=r last=r
> 12/02/23 22:57:37 DEBUG mapreduce.LoadIncrementalHFiles: Going to connect to server region=z,,1330066309814.d5fa76a38c9565f614755e34eacf8316.,
hostname=localhost, port=60020 for row 
> ...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message