hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4552) multi-CF bulk load is not atomic across column families
Date Fri, 21 Oct 2011 23:36:32 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133190#comment-13133190
] 

Jonathan Hsieh commented on HBASE-4552:
---------------------------------------

Plan

1) Test to show there is an atomicity problem.  Likely just does not use LoadIncrementalHFiles
2) Fix for the region server side.
3) Rewrite of LoadIncrementalHFiles so that it groups the proper HFiles into the new bulkLoadHFile
calls.  This will likely have two parallel steps - the first gather enough info to group HFiles
and then the second that attempts to bulk load.
                
> multi-CF bulk load is not atomic across column families
> -------------------------------------------------------
>
>                 Key: HBASE-4552
>                 URL: https://issues.apache.org/jira/browse/HBASE-4552
>             Project: HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 0.92.0
>            Reporter: Todd Lipcon
>            Assignee: Jonathan Hsieh
>             Fix For: 0.92.0
>
>
> Currently the bulk load API simply imports one HFile at a time. With multi-column-family
support, this is inappropriate, since different CFs show up separately. Instead, the IPC endpoint
should take a of CF -> HFiles, so we can online them all under a single region-wide lock.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message