hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Manes (JIRA)" <>
Subject [jira] [Created] (HIVE-13471) TinyLFU cache
Date Sun, 10 Apr 2016 04:56:25 GMT
Ben Manes created HIVE-13471:

             Summary: TinyLFU cache
                 Key: HIVE-13471
             Project: Hive
          Issue Type: Improvement
          Components: llap
            Reporter: Ben Manes

Hive currently uses either the [FIFO|]
or [LRFU|]
caching algorithms. My understanding is that LRFU is O(lg n) and makes predictions based on
the current working set.

A more modern alternative is [TinyLFU|] which is O(1) by
capturing the frequency in a sketch and recency through LRU queues. This allows it to [outperforms|]
ARC and LIRS, two of the best policies to date.

[Caffeine|] provides a concurrent implementation by using
the write-ahead log approach to record & replay updates (see [HighScalability article|]).
It is currently being migrated to in [HBASE-15560|]
and [ACCUMULO-4177|] for their on-heap

If there is interest let me know if I can be of help.

This message was sent by Atlassian JIRA

View raw message