hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15338) Add a option to disable the data block cache for testing the performance of underlying file system
Date Fri, 26 Feb 2016 09:04:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15168687#comment-15168687
] 

Anoop Sam John commented on HBASE-15338:
----------------------------------------

When we set cache data on read to false in HCD and no other changes in configs from default
values, the req is we should not cache DATA blocks only. But INDEX , BLOOM etc should get
cached..  If it is not happening, it may be a bug and we need address that rather than adding
a new config again.

See the javadoc of HCD setter
{code}
 /**
   * @param blockCacheEnabled True if hfile DATA type blocks should be cached (We always cache
   * INDEX and BLOOM blocks; you cannot turn this off).
   * @return this (for chained invocation)
   */
  public HColumnDescriptor setBlockCacheEnabled(boolean blockCacheEnabled) {
    return setValue(BLOCKCACHE, Boolean.toString(blockCacheEnabled));
  }
{code}

> Add a option to disable the data block cache for testing the performance of underlying
file system
> --------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15338
>                 URL: https://issues.apache.org/jira/browse/HBASE-15338
>             Project: HBase
>          Issue Type: Improvement
>          Components: integration tests
>            Reporter: Liu Shaohui
>            Assignee: Liu Shaohui
>            Priority: Minor
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15338-trunk-v1.diff, HBASE-15338-trunk-v2.diff, HBASE-15338-trunk-v3.diff
>
>
> When testing and comparing the performance of different file systems(HDFS, Azure blob
storage, AWS S3 and so on) for HBase, it's better to avoid the affect of the HBase BlockCache
and get the actually random read latency when data block is read from underlying file system.
(Usually, the index block and meta block should be cached in memory in the testing).
> So we add a option in CacheConfig to disable the data block cache.
> Suggestions are welcomed~ Thanks



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message