hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ramkrishna.s.vasudevan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-18300) Implement a Multi TieredBucketCache
Date Fri, 30 Jun 2017 12:12:00 GMT
ramkrishna.s.vasudevan created HBASE-18300:
----------------------------------------------

             Summary: Implement a Multi TieredBucketCache
                 Key: HBASE-18300
                 URL: https://issues.apache.org/jira/browse/HBASE-18300
             Project: HBase
          Issue Type: New Feature
          Components: BucketCache
    Affects Versions: 2.0.0
            Reporter: ramkrishna.s.vasudevan
            Assignee: ramkrishna.s.vasudevan
             Fix For: 2.0.0, 2.0.0-alpha-2


We did an internal brainstorming to study the feasibility of this. Some of our recent tests
on SSDs like Optane shows that they are vastly faster in randomreads and can act as effective
caches. 
In the current state we have a single tier of Bucket cache and the bucket cache can either
be offheap or configured to work with file mode. (The file mode can have multiple files backing
it).
So this model restricts us from using either the memory or the file and not both. 
With the advent of faster devices like Optane SSDs, NVMe based devices it is better we try
to utilize all those devices and try using them for the bucket cache so that we can avoid
the impact of slower devices where the actual data resides on the HDFS data nodes. 

Combined with this we can allow the user to configure the caching layer per family/table so
that one can effectively make use of the caching tiers.

Can upload a design doc here. Before that, would like to know the suggestions here. Thoughts!!!



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message