hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeffrey Zhong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12533) staging directories are not deleted after secure bulk load
Date Thu, 20 Nov 2014 21:54:34 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220079#comment-14220079

Jeffrey Zhong commented on HBASE-12533:

Can you add a comment when we are calling the coprocessors to say that we are only calling
the first region
Yes, we're use the first region to call the prepareBulkLoad once. 

> staging directories are not deleted after secure bulk load
> ----------------------------------------------------------
>                 Key: HBASE-12533
>                 URL: https://issues.apache.org/jira/browse/HBASE-12533
>             Project: HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 0.98.6
>         Environment: CDH5.2 + Kerberos
>            Reporter: Andrejs Dubovskis
>            Assignee: Jeffrey Zhong
>         Attachments: HBASE-12533.patch
> We using secure bulk load heavily in our environment. And it was working with no problem
during some time. But last week I found that clients hangs while calling *doBulkLoad*
> After some investigation I found that HDFS keeps more than 1,000,000 directories in /tmp/hbase-staging
> When directory's content was purged the load process runs successfully.
> According the [hbase book|http://hbase.apache.org/book/ch08s03.html#hbase.secure.bulkload]

> {code}
> HBase manages creation and deletion of this directory.
> {code}

This message was sent by Atlassian JIRA

View raw message