hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Dimiduk (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-10500) Some tools OOM when BucketCache is enabled
Date Tue, 11 Feb 2014 23:18:21 GMT

     [ https://issues.apache.org/jira/browse/HBASE-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nick Dimiduk updated HBASE-10500:
---------------------------------

    Attachment: HBASE-10500.01.patch

Patch moves conf management into constructors so that programatic use is also corrected. Without
it, IntegrationTestImportTsv and IntegrationTestBulkLoad fail.

Also remove the apparently redundant config from LoadIncrementalHFiles. If you were kind enough
to provide a +1 earlier, note that this patch is a little more invasive.

> Some tools OOM when BucketCache is enabled
> ------------------------------------------
>
>                 Key: HBASE-10500
>                 URL: https://issues.apache.org/jira/browse/HBASE-10500
>             Project: HBase
>          Issue Type: Bug
>          Components: HFile
>    Affects Versions: 0.98.0, 0.96.0, 0.99.0
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>         Attachments: HBASE-10500.00.patch, HBASE-10500.01.patch
>
>
> Running {{hbck --repair}} or {{LoadIncrementalHFiles}} when BucketCache is enabled in
offheap mode can cause OOM. This is apparently because {{bin/hbase}} does not include $HBASE_REGIONSERVER_OPTS
for these tools. This results in HRegion or HFileReaders initialized with a CacheConfig that
doesn't have the necessary Direct Memory.
> Possible solutions include:
>  - disable blockcache in the config used by hbck when running its repairs
>  - include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments
> I'm leaning toward the former because it's possible that hbck is run on a host with different
hardware profile as the RS.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message