hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 牛兆捷 <nzjem...@gmail.com>
Subject performance of block cache
Date Wed, 20 Aug 2014 03:06:27 GMT
Hi all:

I saw some interesting results from Hortonworks blog (block cache

In this result, the ratio of memory footprint to database size is held
fixed while
the absolute values are increased.

In my mind, the performance should becomes worse for larger ratio as the
of the absolute value. For example BucketCache#(tmpfs), the difference
between ratio (DB"1.5":"RAM"1.0) and ratio (DB"4.5":"RAM"1.0) becomes
larger as the increase of memory.
Actually, the result of ratio ( DB"1.5":"RAM"1.0) increase linearly, and
the result of ratio (DB"1.5":"RAM"1.0) exponentially.

However, for BucketCache#(heap) and LruBlockCache, the result is out of my
The curves of ratio (DB"1.5":"RAM"1.0) and ratio (DB"4.5":"RAM"1.0) both
increase exponentially, but the relative differences as the increase of
memory are not consistent.
Take LruBlockCache as an example, the difference of ratio
(DB"1.5":"RAM"1.0) and ratio (DB"4.5":"RAM"1.0) becomes smaller from 20 GB
to 50 GB, but becomes larger from 50 GB to 60 GB.

How to analysis the cause of this result, any ideas?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message