hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zach York (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-19435) Reopen Files for ClosedChannelException in BucketCache
Date Fri, 08 Dec 2017 19:23:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-19435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284076#comment-16284076
] 

Zach York commented on HBASE-19435:
-----------------------------------

[~stack] Unfortunately I'm still working on the reproduction from my side and don't have the
helpful logs :(

[~ram_krish] Where in the code does it evict blocks in a compaction (just for my own learning,
I understand it's not as important here).
I'm thinking that your proposition might be correct. This is a major compaction after heavy
ingestion with a few key cache configs that cause heavy cache usage (prefetch on open, cache
on write, cache on read, etc). 

> Reopen Files for ClosedChannelException in BucketCache
> ------------------------------------------------------
>
>                 Key: HBASE-19435
>                 URL: https://issues.apache.org/jira/browse/HBASE-19435
>             Project: HBase
>          Issue Type: Bug
>          Components: BucketCache
>    Affects Versions: 2.0.0, 1.3.1
>            Reporter: Zach York
>            Assignee: Zach York
>             Fix For: 1.4.1, 2.0.0-beta-1
>
>         Attachments: HBASE-19435.branch-1.001.patch, HBASE-19435.master.001.patch, HBASE-19435.master.002.patch,
HBASE-19435.master.003.patch, HBASE-19435.master.004.patch, HBASE-19435.master.005.patch,
HBASE-19435.master.006.patch, HBASE-19435.master.007.patch, HBASE-19435.master.007.patch
>
>
> When using the FileIOEngine for BucketCache, the cache will be disabled if the connection
is interrupted or closed. HBase will then get ClosedChannelExceptions trying to access the
file. After 60s, the RS will disable the cache. This causes severe read performance degradation
for workloads that rely on this cache. FileIOEngine never tries to reopen the connection.
This JIRA is to reopen files when the BucketCache encounters a ClosedChannelException.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message