hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13037) LoadIncrementalHFile should try to verify the content of unmatched families
Date Fri, 13 Feb 2015 14:00:14 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320101#comment-14320101

Jonathan Hsieh commented on HBASE-13037:

Fix on commit: can we include the file status path info with this warning?
LOG.warn("Error closing fsdis FSDataInputStreamWrapper", t);

Otherwise, +1

> LoadIncrementalHFile should try to verify the content of unmatched families
> ---------------------------------------------------------------------------
>                 Key: HBASE-13037
>                 URL: https://issues.apache.org/jira/browse/HBASE-13037
>             Project: HBase
>          Issue Type: Bug
>          Components: Client, mapreduce
>    Affects Versions: 0.99.2, 0.98.10
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>             Fix For: 1.0.0, 2.0.0, 0.98.11
>         Attachments: HBASE-13037-v0.patch, HBASE-13037-v1.patch
> if the bulkload dir contains "other folders" with a valid family name, LoadIncrementalHFile
will throw an unmatched family name exception.
> (In this case our test was running with the MR log dir pointing to the same bulkload
> {code}
> Unmatched family names found: unmatched family names in HFiles to be bulkloaded: [_logs];
valid family names of table testMRIncrementalLoad_1423719217782 are: [info-A, info-B]
> Stacktrace
> {code}
> In theory we can add a second check to verify if the file inside the unmatched family
is an hfile or not, and in case the folder doesn't contain hfiles we can skip that folder,
and avoid the unmatched family exception.

This message was sent by Atlassian JIRA

View raw message