hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeffrey Zhong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12533) staging directories does not deleted after secure bulk load
Date Wed, 19 Nov 2014 18:27:33 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218280#comment-14218280

Jeffrey Zhong commented on HBASE-12533:

[~dubislv] What kind of folders are left in the staging folder? Could you show some examples?
I'm assuming you saw issue that bulkload runs successfully while it still leave some folders
in staging folder after the bulkload. 

> staging directories does not deleted after secure bulk load
> -----------------------------------------------------------
>                 Key: HBASE-12533
>                 URL: https://issues.apache.org/jira/browse/HBASE-12533
>             Project: HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 0.98.6
>         Environment: CDH5.2 + Kerberos
>            Reporter: Andrejs Dubovskis
> We using secure bulk load heavily in our environment. And it was working with no problem
during some time. But last week I found that clients hangs while calling *doBulkLoad*
> After some investigation I found that HDFS keeps more than 1,000,000 directories in /tmp/hbase-staging
> When directory's content was purged the load process runs successfully.
> According the [hbase book|http://hbase.apache.org/book/ch08s03.html#hbase.secure.bulkload]

> {code}
> HBase manages creation and deletion of this directory.
> {code}

This message was sent by Atlassian JIRA

View raw message