hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13037) LoadIncrementalHFile should try to verify the content of unmatched families
Date Fri, 13 Feb 2015 21:14:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320772#comment-14320772
] 

Hudson commented on HBASE-13037:
--------------------------------

FAILURE: Integrated in HBase-1.0 #736 (See [https://builds.apache.org/job/HBase-1.0/736/])
HBASE-13037 LoadIncrementalHFile should try to verify the content of unmatched families (matteo.bertozzi:
rev 9b8f4805d7d7cc682ac6f231c5f36bf49b20b67e)
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java


> LoadIncrementalHFile should try to verify the content of unmatched families
> ---------------------------------------------------------------------------
>
>                 Key: HBASE-13037
>                 URL: https://issues.apache.org/jira/browse/HBASE-13037
>             Project: HBase
>          Issue Type: Bug
>          Components: Client, mapreduce
>    Affects Versions: 0.99.2, 0.98.10
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>             Fix For: 1.0.0, 2.0.0, 0.98.11
>
>         Attachments: HBASE-13037-v0.patch, HBASE-13037-v1.patch
>
>
> if the bulkload dir contains "other folders" with a valid family name, LoadIncrementalHFile
will throw an unmatched family name exception.
> (In this case our test was running with the MR log dir pointing to the same bulkload
dir)
> {code}
> Unmatched family names found: unmatched family names in HFiles to be bulkloaded: [_logs];
valid family names of table testMRIncrementalLoad_1423719217782 are: [info-A, info-B]
> Stacktrace
> {code}
> In theory we can add a second check to verify if the file inside the unmatched family
is an hfile or not, and in case the folder doesn't contain hfiles we can skip that folder,
and avoid the unmatched family exception.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message