Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates
 209.85.161.41 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type
         :content-transfer-encoding;
        b=ZbNZm1K4FQXDCngCocmTkEn4SX50UHJBpnG3uW/Q+6TfsEc6gjog0qEBDqBezz4ESI
         yraoD7mngd/1mECv63KYgtlU1nY5U16nJdOOAed3MfNP8KkpFoCI2VdBYQqQG9p6v7Op
         A5cKJuZZdE9UF1T4K2UKPLmdjvYyKbMo21hLw=
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: <BANLkTin_qEXp_YDGbezLDcqxrsuUpzjMMA@mail.gmail.com>
References: <BANLkTinNp46-VOvmj2R2WoaDr8TF1MS-yA@mail.gmail.com>
	<BANLkTimakaENMBjcLeZqm-med7RNSd5Bjg@mail.gmail.com>
	<BANLkTin_qEXp_YDGbezLDcqxrsuUpzjMMA@mail.gmail.com>
Date: Tue, 14 Jun 2011 15:51:44 -0700
Message-ID: <BANLkTimYzcHOJQQDxLem1B7Hixgo3-wuhQ@mail.gmail.com>
Subject: Re: ConcurrentSkipListMap performance in the MemStore
From: Stack <stack@duboce.net>
To: dev@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Or do as Todd suggested a while back and pull in CSLM and hack it to
suit our needs; its public domain.
St.Ack

On Tue, Jun 14, 2011 at 3:23 PM, Jason Rutherglen
<jason.rutherglen@gmail.com> wrote:
>> See this J: http://www.cloudera.com/blog/2011/03/avoiding-full-gcs-in-hb=
ase-with-memstore-local-allocation-buffers-part-3/
>
> Interesting.
>
> In Lucene for realtime search we have the same problem where the
> best/only option right now for the realtime terms dictionary is to use
> ConcurrentSkipListMap. =A0However the Node, key, value, and Index
> objects all are pointers that consume RAM and need to be cleaned up.
>
> Lucene right now during indexing does not generate much object pointer
> garbage. =A0We have the same problem in the two projects.
>
> Maybe there's a way to create an AtomicIntegerArray based system that
> uses int pointers to perform the same function as a the concurrent
> skip list. =A0It would greatly reduce garbage generation.
>
> On Tue, Jun 14, 2011 at 10:14 AM, Stack <stack@duboce.net> wrote:
>> See this J: http://www.cloudera.com/blog/2011/03/avoiding-full-gcs-in-hb=
ase-with-memstore-local-allocation-buffers-part-3/
>> St.Ack
>>
>> On Mon, Jun 13, 2011 at 10:58 PM, Jason Rutherglen
>> <jason.rutherglen@gmail.com> wrote:
>>> Is there an issue with garbage generated from using CSLM in the MemStor=
e?
>>>
>>
>