Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of ddragutoiu@gmail.com designates
 209.85.161.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:subject:references
         :in-reply-to:content-type;
        b=ZKHqnfuBX2USPJGH/67MwjMafzx3yrIyS0ZTcUWMrv580Di+88m96tL9LASvHaRnB2
         2COM9KzOx/w/tRIe0/uBMAmP2anmbypmSwFeqk9e0VU25CJFGZ2s2jQQzh31jCZcHqjk
         a4B10q//nniTXBUVfsls+YN2SO0QW0q9324JQ=
Message-ID: <4BE01865.1090703@gmail.com>
Date: Tue, 04 May 2010 15:51:49 +0300
From: Dorin Dragutoiu <ddragutoiu@gmail.com>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; ro;
 rv:1.9.1.9) Gecko/20100317 Lightning/1.0b1 Thunderbird/3.0.4
MIME-Version: 1.0
To: user@cassandra.apache.org
Subject: Re: Design Query
References: <y2ka94315c71005010434j34958699m3a9a5ec8e30cadd4@mail.gmail.com>
 <h2u8f9ac4a91005040228oabbe4a46yef4e99172688e863@mail.gmail.com>
In-Reply-To: <h2u8f9ac4a91005040228oabbe4a46yef4e99172688e863@mail.gmail.com>
Content-Type: multipart/alternative;
 boundary="------------090904020503000401050305"

This is a multi-part message in MIME format.
--------------090904020503000401050305
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

2. I have used the same configuration (3 machines with 4GB RAM) and I 
got an Out of memory error on compactation each time trying to compact 4 
x 128MB sstables. Tried different configuration incl Java Opts, same 
result. When I have used 16GB ram machine everything worked like a charm.

Pe 04.05.2010 12:28, vineet daniel a scris:
>
> As you havent specified all the details pertaining to filters and your 
> data layout (structure) at a very high level what i can suggest is 
> that you need to create a seperate CF for each filter.
>
>
> On Sat, May 1, 2010 at 5:04 PM, Rakesh Rajan <rakeshxp@gmail.com 
> <mailto:rakeshxp@gmail.com>> wrote:
>
>     I am evaluating cassandra to implement activity streams. We
>     currently have over 1000000 feeds with total entries exceeding
>     320000000 implemented using redis ( ~320 entries / feed). Would
>     like hear from the community on how to use cassandra to solve the
>     following cases:
>
>        1. Ability to fetch entries by applying a few filters ( like
>           show me only likes from a given user). This would include
>           range query to support pagination. So this would mean
>           indices on a few columns like the feed id, feed type etc.
>        2. We have around 3 machines with 4GB RAM for this purpose and
>           thinking of having replication factor 2. Would 4GB * 3 be
>           enough for cassandra for this kind of data? I read that
>           cassandra does not keep all the data in memory but want to
>           be sure that we have the right server config to handle this
>           data using cassandra.
>
>     Thanks,
>     Rakesh
>
>

--------------090904020503000401050305
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
  <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
2. I have used the same configuration (3 machines with 4GB RAM) and I
got an Out of memory error on compactation each time trying to compact
4 x 128MB sstables. Tried different configuration incl Java Opts, same
result. When I have used 16GB ram machine everything worked like a
charm.<br>
<br>
Pe 04.05.2010 12:28, vineet daniel a scris:
<blockquote
 cite="mid:h2u8f9ac4a91005040228oabbe4a46yef4e99172688e863@mail.gmail.com"
 type="cite"><br>
As you havent specified all the details pertaining to filters and your
data layout (structure) at a very high level what i can suggest is that
you need to create a seperate CF for each filter. <br>
  <br>
  <br>
  <div class="gmail_quote">On Sat, May 1, 2010 at 5:04 PM, Rakesh Rajan
  <span dir="ltr">&lt;<a moz-do-not-send="true"
 href="mailto:rakeshxp@gmail.com">rakeshxp@gmail.com</a>&gt;</span>
wrote:<br>
  <blockquote class="gmail_quote"
 style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
    <div>I am evaluating cassandra to implement activity streams. We
currently have over 1000000 feeds with total entries exceeding
320000000 implemented using redis ( ~320 entries / feed). Would like
hear from the community on how to use cassandra to solve the following
cases:</div>
    <div>
    <ol>
      <li>Ability to fetch entries by applying a few filters ( like
show me only likes from a given user). This would include range query
to support pagination. So this would mean indices on a few columns like
the feed id, feed type etc.</li>
      <li>We have around 3 machines with 4GB RAM for this purpose and
thinking of having replication factor 2. Would 4GB * 3 be enough for
cassandra for this kind of data? I read that cassandra does not keep
all the data in memory but want to be sure that we have the right
server config to handle this data using cassandra.</li>
    </ol>
    </div>
    <div>Thanks,</div>
    <div>Rakesh </div>
  </blockquote>
  </div>
  <br>
</blockquote>
</body>
</html>

--------------090904020503000401050305--