hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ramkrishna.s.vasudevan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-19435) Reopen Files for ClosedChannelException in BucketCache
Date Fri, 08 Dec 2017 04:48:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-19435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283047#comment-16283047
] 

ramkrishna.s.vasudevan commented on HBASE-19435:
------------------------------------------------

When ever a compaction happens we try to remove that hfile that was compacted from the cache.
So all those blocks related to that hfile is removed. 
But since this is bucket cache - what we have is buckets that has these blocks and those are
always in the fixed set of files that we have configured for file mode bucket cache. And when
we evict a block for the compacted file there is nothing like we go and close the file associated
with it inside bucket cache becuase that does not have any knowledge on what file's blocks
are evicted or cached.
May be there are too many file channels open due to heavy compaction and that internally closes
the socket channel open on this bucket cache's files? 

> Reopen Files for ClosedChannelException in BucketCache
> ------------------------------------------------------
>
>                 Key: HBASE-19435
>                 URL: https://issues.apache.org/jira/browse/HBASE-19435
>             Project: HBase
>          Issue Type: Bug
>          Components: BucketCache
>    Affects Versions: 2.0.0, 1.3.1
>            Reporter: Zach York
>            Assignee: Zach York
>             Fix For: 1.4.1, 2.0.0-beta-1
>
>         Attachments: HBASE-19435.branch-1.001.patch, HBASE-19435.master.001.patch, HBASE-19435.master.002.patch,
HBASE-19435.master.003.patch, HBASE-19435.master.004.patch, HBASE-19435.master.005.patch,
HBASE-19435.master.006.patch, HBASE-19435.master.007.patch, HBASE-19435.master.007.patch
>
>
> When using the FileIOEngine for BucketCache, the cache will be disabled if the connection
is interrupted or closed. HBase will then get ClosedChannelExceptions trying to access the
file. After 60s, the RS will disable the cache. This causes severe read performance degradation
for workloads that rely on this cache. FileIOEngine never tries to reopen the connection.
This JIRA is to reopen files when the BucketCache encounters a ClosedChannelException.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message