hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18002) Investigate why bucket cache filling up in file mode in an exisitng file is slower
Date Wed, 05 Jul 2017 02:52:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074183#comment-16074183
] 

Anoop Sam John commented on HBASE-18002:
----------------------------------------

Ya if the after a restart, the region is not coming back to same RS, those blocks belonging
to this region is not usable.  I have seen some jira raised which discuss abt making regions
come back to original RS as much as possible. This helps wrt HDFS locality also.  Dont know
which one.. May be we should check possibility for that.   
But we can not delete file on restart. Otherwise we have to remove the concept of persistence
in IOEngine.

> Investigate why bucket cache filling up in file mode in an exisitng file  is slower
> -----------------------------------------------------------------------------------
>
>                 Key: HBASE-18002
>                 URL: https://issues.apache.org/jira/browse/HBASE-18002
>             Project: HBase
>          Issue Type: Sub-task
>          Components: BucketCache
>    Affects Versions: 2.0.0
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 2.0.0
>
>         Attachments: HBASE-18002.patch
>
>
> This issue was observed when we recently did some tests with SSD based bucket cache.
Similar thing was also reported by @stack and [~danielpol] while doing some of these bucket
cache related testing.
> When we try to preload a bucket cache (in file mode) with a new file the bucket cache
fills up quite faster and there not much 'failedBlockAdditions'. But when the same bucket
cache is filled up with a preexisitng file ( that had already some entries filled up) this
time it has more 'failedBlockAdditions' and the cache does not fill up faster. Investigate
why this happens. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message