hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15338) Add a option to disable the data block cache for testing the performance of underlying file system
Date Fri, 04 Mar 2016 05:26:40 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179354#comment-15179354
] 

Anoop Sam John commented on HBASE-15338:
----------------------------------------

Actually we dont write any blocks as META block as such.  The block category META is used
for FFT and FileInfo also.. But those are read and set as state in HFile's reader instance.
 So no Q of caching comes..  Said that, no way we will ask to BC whether to cache a META category
block.  So its fine.. +1 for not changing that line. In latest patch u have that. U will revert
it?
BTW is this committed? Am not able to see in commit log !!

> Add a option to disable the data block cache for testing the performance of underlying
file system
> --------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15338
>                 URL: https://issues.apache.org/jira/browse/HBASE-15338
>             Project: HBase
>          Issue Type: Improvement
>          Components: integration tests
>            Reporter: Liu Shaohui
>            Assignee: Liu Shaohui
>            Priority: Minor
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15338-trunk-v1.diff, HBASE-15338-trunk-v2.diff, HBASE-15338-trunk-v3.diff,
HBASE-15338-trunk-v4.diff, HBASE-15338-trunk-v5.diff, HBASE-15338-trunk-v6.diff, HBASE-15338-trunk-v7.diff
>
>
> When testing and comparing the performance of different file systems(HDFS, Azure blob
storage, AWS S3 and so on) for HBase, it's better to avoid the affect of the HBase BlockCache
and get the actually random read latency when data block is read from underlying file system.
(Usually, the index block and meta block should be cached in memory in the testing).
> So we add a option in CacheConfig to disable the data block cache.
> Suggestions are welcomed~ Thanks



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message