Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of fozziethebeat@gmail.com
 designates 74.125.82.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=RXuTgBN3tf5CLVNA2tBWu6P7o+H+HOXsWwNB7fhwr6au4uS0+jNKfG+MViN4Ozj4zw
         phKL3O1+1RPwKnxbjPDBIunEgxvS69cgOdGKAgqt20K/z0N3yBvtdbSgEjimyhVHgu7Q
         cyE5l9a7JPk4PFL5MwqW5SDbDeMujphB1Cir0=
MIME-Version: 1.0
In-Reply-To: <AANLkTinP52_x-9TRUpbkzu4foj-GFVZcNyBk3TzQAPJC@mail.gmail.com>
References: <AANLkTi=RBRrW7AW7CaiMN8xzN4EMPohm6T7C=Xs807ML@mail.gmail.com>
	<AANLkTinP52_x-9TRUpbkzu4foj-GFVZcNyBk3TzQAPJC@mail.gmail.com>
Date: Mon, 16 Aug 2010 18:23:13 -0700
Message-ID: <AANLkTikbxja1Tn9i_tv4qMQnXLarxJgyCFNSgW3KE6PW@mail.gmail.com>
Subject: Re: The stability of Hadoop jobs outputting to Cassandra
From: Keith Stevens <fozziethebeat@gmail.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=0016e6d58a78fde9be048dfacad1

--0016e6d58a78fde9be048dfacad1
Content-Type: text/plain; charset=ISO-8859-1

Thanks for this update.

After another day at work, and more reading into the Cassandra's underlying
model, I think the problem i am encountering is less due to HBase and more
with user error and a highly faulty cluster.

Cassandra's clean api and integration with thrift were the two biggest
factors that attracted me to it, in addition to personal vouches from people
at my university.  Another attractor is based on several remarks that it was
much simpler to set up than HBase, which has been our main point of failur.
 I have read, though, that Cassandra is not as focused on large scale
analysis of documents, via hadoop, in the way that HBase is.

I'm going to try playing around with Cassandra over the next few days and
see if it's more stable on our often failing cluster when combined with
Hadoop.  I'll definitely try the simple solution of having a thrift
connection to Cassandra in the reducer.

Thanks!
--Keith

On Sun, Aug 15, 2010 at 6:05 PM, Jonathan Ellis <jbellis@gmail.com> wrote:

> Status: Fixed, Fix version: 7.0 beta 1 means it's in the beta1 that
> was just released, although
> https://issues.apache.org/jira/browse/CASSANDRA-1315 is open to change
> the API slightly.  Either way, it won't be backported to 0.6.
>
> But you can write to Cassandra from the Hadoop job just fine w/o an
> OutputFormat.  Just create a Thrift connection in your reduce job.
>
> On Sun, Aug 15, 2010 at 6:24 PM, Keith Stevens <fozziethebeat@gmail.com>
> wrote:
> > Hello,
> > I'm currently working on a project that is using HBase and Hadoop, but
> i'm
> > currently looking into alternatives to HBase.  Cassandra seems to be the
> > next best replacement, or perhaps a better replacement, except that the
> > stable release is lacking support for hadoop jobs writing to Cassandra.
> > I found CASSANDRA-1101 and wanted to know how stable that update is.
>  Will
> > it be made part of a release any time soon?  Has anyone been using the
> > update regularly?
> > Thanks!
> > --Keith
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>

--0016e6d58a78fde9be048dfacad1
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Thanks for this update.<div><br></div><div>After another day at work, and m=
ore reading into the Cassandra&#39;s underlying model, I think the problem =
i am encountering is less due to HBase and more with user error and a highl=
y faulty cluster. =A0</div>
<div>=A0</div><div>Cassandra&#39;s clean api and integration with thrift we=
re the two biggest factors that attracted me to it, in addition to personal=
 vouches from people at my university. =A0Another attractor is based on sev=
eral remarks that it was much=A0simpler=A0to set up than HBase, which has b=
een our main point of failur. =A0I have read, though, that Cassandra is not=
 as focused on large scale analysis of documents, via hadoop, in the way th=
at HBase is.</div>
<div><br></div><div>I&#39;m going to try playing around with Cassandra over=
 the next few days and see if it&#39;s more stable on our often failing clu=
ster when combined with Hadoop. =A0I&#39;ll=A0definitely=A0try the simple s=
olution of having a thrift connection to Cassandra in the reducer.</div>
<div><br></div><div>Thanks!</div><div>--Keith</div><div><br><div class=3D"g=
mail_quote">On Sun, Aug 15, 2010 at 6:05 PM, Jonathan Ellis <span dir=3D"lt=
r">&lt;<a href=3D"mailto:jbellis@gmail.com">jbellis@gmail.com</a>&gt;</span=
> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex;">Status: Fixed, Fix version: 7.0 beta 1 mean=
s it&#39;s in the beta1 that<br>
was just released, although<br>
<a href=3D"https://issues.apache.org/jira/browse/CASSANDRA-1315" target=3D"=
_blank">https://issues.apache.org/jira/browse/CASSANDRA-1315</a> is open to=
 change<br>
the API slightly. =A0Either way, it won&#39;t be backported to 0.6.<br>
<br>
But you can write to Cassandra from the Hadoop job just fine w/o an<br>
OutputFormat. =A0Just create a Thrift connection in your reduce job.<br>
<div class=3D"im"><br>
On Sun, Aug 15, 2010 at 6:24 PM, Keith Stevens &lt;<a href=3D"mailto:fozzie=
thebeat@gmail.com">fozziethebeat@gmail.com</a>&gt; wrote:<br>
</div><div><div></div><div class=3D"h5">&gt; Hello,<br>
&gt; I&#39;m currently working on a project that is using HBase and Hadoop,=
 but i&#39;m<br>
&gt; currently looking into alternatives to HBase. =A0Cassandra seems to be=
 the<br>
&gt; next best replacement, or perhaps a better replacement, except that th=
e<br>
&gt; stable release is lacking support for hadoop jobs writing to Cassandra=
.<br>
&gt; I found=A0CASSANDRA-1101=A0and wanted to know how stable that update i=
s. =A0Will<br>
&gt; it be made part of a release any time soon? =A0Has anyone been using t=
he<br>
&gt; update regularly?<br>
&gt; Thanks!<br>
&gt; --Keith<br>
<br>
<br>
<br>
</div></div><font color=3D"#888888">--<br>
Jonathan Ellis<br>
Project Chair, Apache Cassandra<br>
co-founder of Riptano, the source for professional Cassandra support<br>
<a href=3D"http://riptano.com" target=3D"_blank">http://riptano.com</a><br>
</font></blockquote></div><br></div>

--0016e6d58a78fde9be048dfacad1--