Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of victor.kabdebon@gmail.com
 designates 209.85.161.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        b=PCINv/6tfzskM0yHtdFqezv6RulTlK4bGeWa6ca+Z4UT2dxMSIfF1CN1lcEfaapzmd
         vLa/B9j6xYCTN2YEvwNKRN3d3mkhVpsjXq13EK1y5QSD5LMzNrQxq4fgS/Yn0V7H2YDs
         PbwTzLYamHTLs1+UYhknU4WcjJYB8bznRF7Go=
MIME-Version: 1.0
In-Reply-To: <BANLkTinN7RQGM54r+9t7D2HfMWZJ0kLq6Q@mail.gmail.com>
References: <BANLkTinN7RQGM54r+9t7D2HfMWZJ0kLq6Q@mail.gmail.com>
From: Victor Kabdebon <victor.kabdebon@gmail.com>
Date: Tue, 21 Jun 2011 13:26:24 -0400
Message-ID: <BANLkTiniByNCJ6aiM8APB2S5=CrKr7FYUA@mail.gmail.com>
Subject: Re: solandra or pig or....?
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=001517491d54e035fc04a63c27fc

--001517491d54e035fc04a63c27fc
Content-Type: text/plain; charset=ISO-8859-1

I can speak for what I know :

Pig I have taken only a quick look and maybe some guys from Twitter can
answer better than me on that particular program. Pig is not for "on demand"
queries: they are quite slow and as you said you extract relevant
information and append it to another CF where you can retrieve quickly the
statistics.

SolR is purely a search engine. It is not only text based but also time
based etc... To do statistics you need mathematical operations, statistics,
SolR won't provide that. It can do simple things in terms of statistics but
mostly it is a search engine.

Personally for what you are asking I would use Pig and stock that in CF. I
would update those CF regularly. For simple statistics you can generate them
with your favorite language or a specialized language such as R as long as
it concerns small sets.

Hope it helps,
Victor Kabdebon

2011/6/21 Sasha Dolgy <sdolgy@gmail.com>

> Folks,
>
> Simple question ... Assuming my current use case is the ability to log
> lots of trivial and seemingly useless sports statistics ... I want a
> user to be able to query / compare .... For example:
>
> --> Show me all baseball players in cheektowaga and ontario,
> california who have hit a grandslam on tuesdays where it was just a
> leap year.
>
> Each baseball player is represented by a single row in a CF:
>
> player_uuid, fullname, hometown, game1, game2, game3, game4
>
> Game's are UUID's that are a reference to another row in the same CF
> that provides information about that game...
>
> location, final score, date (unix timestamp or ISO format) , and
> statitics which are represented as a new column timestamp:player_uuid
>
> I can use PIG, as I understand, to run a query to generate specific
> information about specific "things" and populate that data back into
> Cassandra in another CF ... similar to the hypothetical search
> above....as the information is structured already, i assume PIG is the
> right tool for the job, but may not be ideal for a web application and
> enabling ad-hoc queries ... it could take anywhere from 2-....?
> seconds for that query to generate, populate, and return to the
> user...?
>
> On the other hand, I have started to read about Solr / Solandra /
> Lucandra .... can this provide similar functionality or better ?  or
> is it more geared towards full text search and indexing ...
>
> I don't want to get into the habit of guessing what my potential users
> want to search for ... trying to think of ways to offload this to
> them.
>
>
>
> --
> Sasha Dolgy
> sasha.dolgy@gmail.com
>

--001517491d54e035fc04a63c27fc
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I can speak for what I know :<div><br></div><div>Pig I have taken only a qu=
ick look and maybe some guys from Twitter can answer better than me on that=
 particular program. Pig is not for &quot;on demand&quot; queries: they are=
 quite slow and as you said you extract relevant information and append it =
to another CF where you can retrieve quickly the statistics.<br>

<div><br></div><div>SolR is purely a search engine. It is not only text bas=
ed but also time based etc... To do statistics you need mathematical operat=
ions, statistics, SolR won&#39;t provide that. It can do simple things in t=
erms of statistics but mostly it is a search engine.</div>

<div><br>Personally for what you are asking I would use Pig and stock that =
in CF. I would update those CF regularly. For simple statistics you can gen=
erate them with your favorite language or a specialized language such as R =
as long as it concerns small sets.</div>

<div><br></div><div>Hope it helps,</div><div>Victor Kabdebon</div><div><br>=
<div class=3D"gmail_quote">2011/6/21 Sasha Dolgy <span dir=3D"ltr">&lt;<a h=
ref=3D"mailto:sdolgy@gmail.com">sdolgy@gmail.com</a>&gt;</span><br><blockqu=
ote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc s=
olid;padding-left:1ex;">

Folks,<br>
<br>
Simple question ... Assuming my current use case is the ability to log<br>
lots of trivial and seemingly useless sports statistics ... I want a<br>
user to be able to query / compare .... For example:<br>
<br>
--&gt; Show me all baseball players in cheektowaga and ontario,<br>
california who have hit a grandslam on tuesdays where it was just a<br>
leap year.<br>
<br>
Each baseball player is represented by a single row in a CF:<br>
<br>
player_uuid, fullname, hometown, game1, game2, game3, game4<br>
<br>
Game&#39;s are UUID&#39;s that are a reference to another row in the same C=
F<br>
that provides information about that game...<br>
<br>
location, final score, date (unix timestamp or ISO format) , and<br>
statitics which are represented as a new column timestamp:player_uuid<br>
<br>
I can use PIG, as I understand, to run a query to generate specific<br>
information about specific &quot;things&quot; and populate that data back i=
nto<br>
Cassandra in another CF ... similar to the hypothetical search<br>
above....as the information is structured already, i assume PIG is the<br>
right tool for the job, but may not be ideal for a web application and<br>
enabling ad-hoc queries ... it could take anywhere from 2-....?<br>
seconds for that query to generate, populate, and return to the<br>
user...?<br>
<br>
On the other hand, I have started to read about Solr / Solandra /<br>
Lucandra .... can this provide similar functionality or better ? =A0or<br>
is it more geared towards full text search and indexing ...<br>
<br>
I don&#39;t want to get into the habit of guessing what my potential users<=
br>
want to search for ... trying to think of ways to offload this to<br>
them.<br>
<font color=3D"#888888"><br>
<br>
<br>
--<br>
Sasha Dolgy<br>
<a href=3D"mailto:sasha.dolgy@gmail.com">sasha.dolgy@gmail.com</a><br>
</font></blockquote></div><br></div></div>

--001517491d54e035fc04a63c27fc--