hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liu Shaohui (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-15338) Add a option to disable the data block cache for testing the performance of underlying file system
Date Fri, 04 Mar 2016 03:43:40 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Liu Shaohui updated HBASE-15338:
--------------------------------
      Resolution: Fixed
    Hadoop Flags: Reviewed
    Release Note: Add a new config: hbase.block.data.cacheonread, which is a global switch
for caching data blocks on read. The default value of this switch is true, and data blocks
will be cached on read if the block cache is enabled for the family and cacheBlocks flag is
set to be true for get and scan operations. If this global switch is set to false, data blocks
won't be cached even if the block cache is enabled for the family and the cacheBlocks flag
of Gets or Scans are sets as true. Bloom blocks and index blocks are always be cached if the
block cache of the regionserver is enabled. One usage of this switch is for the performance
tests for the extreme case that  the cache for data blocks all missed and all data blocks
are read from underlying file system.
          Status: Resolved  (was: Patch Available)

> Add a option to disable the data block cache for testing the performance of underlying
file system
> --------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15338
>                 URL: https://issues.apache.org/jira/browse/HBASE-15338
>             Project: HBase
>          Issue Type: Improvement
>          Components: integration tests
>            Reporter: Liu Shaohui
>            Assignee: Liu Shaohui
>            Priority: Minor
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15338-trunk-v1.diff, HBASE-15338-trunk-v2.diff, HBASE-15338-trunk-v3.diff,
HBASE-15338-trunk-v4.diff, HBASE-15338-trunk-v5.diff, HBASE-15338-trunk-v6.diff
>
>
> When testing and comparing the performance of different file systems(HDFS, Azure blob
storage, AWS S3 and so on) for HBase, it's better to avoid the affect of the HBase BlockCache
and get the actually random read latency when data block is read from underlying file system.
(Usually, the index block and meta block should be cached in memory in the testing).
> So we add a option in CacheConfig to disable the data block cache.
> Suggestions are welcomed~ Thanks



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message