Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@accumulo.apache.org
MIME-Version: 1.0
In-Reply-To: <57027810.6050708@gmail.com>
References: 
 <CAGu0=MOQo0mcBcZCH_HwHzSHMjc1Aw-ze=_E2b9WzwP7AG7FBg@mail.gmail.com>
	<CAL5zq9b7uEk2bGAsczGCpKtW7UAJhnQSQJ7BdovyoDKA4c0Stw@mail.gmail.com>
	<009501d18dce$b09b6b50$11d241f0$@comcast.net>
	<57027810.6050708@gmail.com>
Date: Mon, 4 Apr 2016 10:45:17 -0400
Message-ID: 
 <CAGUtCHoDDPqfQ0h4p-4qdfd4bFkP9d8YKp84ZhT1G8juphYRKw@mail.gmail.com>
Subject: Re: LruBlockCache alternative
From: Keith Turner <keith@deenlo.com>
To: Accumulo Dev List <dev@accumulo.apache.org>
Content-Type: multipart/alternative; boundary=001a113cc546f93855052fa9c6d7

--001a113cc546f93855052fa9c6d7
Content-Type: text/plain; charset=UTF-8

On Mon, Apr 4, 2016 at 10:20 AM, Josh Elser <josh.elser@gmail.com> wrote:

> Cool, thanks for the poke, Ben!
>
> Last I checked, our version of the LRUBlockCache was nearly identical to
> what was in HBase 1.x. I would imagine this would be easy to bring over.
>
> Maybe we can also try to swipe BucketCache while we're at it and get some
> off-heap support for blocks.
>
> Aside: it would be nice if we could somehow find a way to share code like
> this across the projects. HBase was interested in FATE for some time, but
> eventually created their own new solution. I'm not sure what else exists
> that we might want to share between projects.


One way to share code is to spin off new projects, like the following :

 https://github.com/snazy/ohc


>
> dlmarion@comcast.net wrote:
>
>> Associated issue: https://issues.apache.org/jira/browse/ACCUMULO-4177
>>
>>
>> -----Original Message-----
>>> From: Christopher [mailto:ctubbsii@apache.org]
>>> Sent: Sunday, April 03, 2016 1:31 PM
>>> To: dev@accumulo.apache.org
>>> Subject: Re: LruBlockCache alternative
>>>
>>> Thanks for the pointer!
>>>
>>> On Sun, Apr 3, 2016, 12:08 Benjamin Manes<ben.manes@gmail.com>  wrote:
>>>
>>> Hi,
>>>>
>>>> I noticed that Accumulo's LruBlockCache [1] appears to be based on
>>>>
>>> HBase's.
>>>
>>>> I currently have a patch being reviewed in HBASE-15560 [2] that
>>>> replaces the pseudo Segmented LRU with the TinyLFU eviction policy.
>>>> That should allow the cache to make better predictions based on
>>>> frequency and recency, such as improved scan resistance. Full details
>>>> are in the JIRA ticket. I think it should be easy to port if there is
>>>> interest.
>>>>
>>>> Cheers,
>>>> Ben
>>>>
>>>> [1]
>>>>
>>>>
>>>> https://github.com/apache/accumulo/blob/master/core/src/main/java/org/
>>>
>>>> apache/accumulo/core/file/blockfile/cache/LruBlockCache.java
>>>> [2] https://issues.apache.org/jira/browse/HBASE-15560
>>>>
>>>>
>>

--001a113cc546f93855052fa9c6d7--