Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of edlinuxguru@gmail.com
 designates 74.125.82.43 as permitted sender)
MIME-Version: 1.0
Date: Tue, 24 Dec 2013 15:31:49 -0500
Message-ID: 
 <CAENxBwyr1YDppLetfB5iM69V68Lkk_EMZBX36_HaLVvE+LBENw@mail.gmail.com>
Subject: Cassandra unit testing becoming nearly impossible: suggesting
 alternative.
From: Edward Capriolo <edlinuxguru@gmail.com>
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Content-Type: multipart/alternative; boundary=089e0149411a4e814e04ee4da2bf

--089e0149411a4e814e04ee4da2bf
Content-Type: text/plain; charset=ISO-8859-1

I am not sure there how many people have been around developing Cassandra
for as long as I have, but the state of all the client libraries and the
cassandra server is WORD_I_DONT_WANT_TO_SAY.

Here is an example of something I am seeing:
ERROR 14:59:45,845 Exception in thread Thread[Thrift:5,5,main]
java.lang.AbstractMethodError: org.apache.thrift.ProcessFunction.isOneway()Z
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:51)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:194)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
DEBUG 14:59:51,654 retryPolicy for schema_triggers is 0.99

In short: If you are new to cassandra and only using the newest client I am
sure everything is peachy for you.

For people that have been using Cassandra for a while it is harder to "jump
ship" when something better comes along. You need sometimes to support both
hector and astyanax, it happens.

For a while I have been using hector. Even not to use hector as an API, but
the one nice thing I got from hector was a simple EmbeddedServer that would
clean up after itself. Hector seems badly broken at the moment. I have no
idea how the current versions track with anything out there in the
cassandra world.

For a while I played with https://github.com/Netflix/astyanax, which has
it's own version and schemes and dependent libraries. (astyanax has some
packaging error that forces me into maven3)

Enter cassandra 2.0 which forces you into java 0.7. Besides that it has
it's own kit of things it seems to want.

I am guessing since hectors embedded server does not work, and I should go
to https://github.com/jsevellec/cassandra-unit not sure...really...how
anyone does this anymore. I am sure I could dive into the source code and
figure this out, but I would just rather have a stable piece of code that
brings up the embedded server that "just works" and "continues working".

I can not seem to get this working right either. (since it includes hector
I see from the pom)

Between thrift, cassandra,client x, it is almost impossible to build a sane
classpath, and that is not even counting the fact that people have their
own classpath issues (with guava mismatches etc).

I think the only sane thing to do is start shipping cassandra-embedded like
this:

https://github.com/kstyrc/embedded-redis

In other words package embedded-cassandra as a binary. Don't force the
client/application developer to bring cassandra on the classpath and fight
with mismatches in thrift/guava etc. That or provide a completely shaded
cassandra server for embedded testing. As it stands now trying to support a
setup that uses more than one client or works with multiple versions of
cassandra is major pita.  (aka library x compiled against 1.2.0 library y
compiled against 2.0.3)

Does anyone have any thoughts on this, or tried something similar?

Edward

--089e0149411a4e814e04ee4da2bf
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>I am not sure there how many people have been around =
developing Cassandra for as long as I have, but the state of all the client=
 libraries and the cassandra server is WORD_I_DONT_WANT_TO_SAY.</div><div>
<br></div><div>Here is an example of something I am seeing:</div><div>ERROR=
 14:59:45,845 Exception in thread Thread[Thrift:5,5,main]<br>java.lang.Abst=
ractMethodError: org.apache.thrift.ProcessFunction.isOneway()Z<br>	at org.a=
pache.thrift.ProcessFunction.process(ProcessFunction.java:51)<br>
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)<br>	at=
 org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(Cust=
omTThreadPoolServer.java:194)<br>	at java.util.concurrent.ThreadPoolExecuto=
r.runWorker(ThreadPoolExecutor.java:1110)<br>
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.j=
ava:603)<br>	at java.lang.Thread.run(Thread.java:722)<br>DEBUG 14:59:51,654=
 retryPolicy for schema_triggers is 0.99</div><div><br></div><div>In short:=
 If you are new to cassandra and only using the newest client I am sure eve=
rything is peachy for you.</div>
<div><br></div><div>For people that have been using Cassandra for a while i=
t is harder to &quot;jump ship&quot; when something better comes along. You=
 need sometimes to support both hector and astyanax, it happens.=A0</div>
<div><br></div><div>For a while I have been using hector. Even not to use h=
ector as an API, but the one nice thing I got from hector was a simple Embe=
ddedServer that would clean up after itself. Hector seems badly broken at t=
he moment. I have no idea how the current versions track with anything out =
there in the cassandra world.=A0</div>
<div><br></div><div>For a while I played with <a href=3D"https://github.com=
/Netflix/astyanax">https://github.com/Netflix/astyanax</a>, which has it=
9;s own version and schemes and dependent libraries. (astyanax has some pac=
kaging error that forces me into maven3)</div>
<div><br></div><div>Enter cassandra 2.0 which forces you into java 0.7. Bes=
ides that it has it&#39;s own kit of things it seems to want.=A0</div><div>=
<br></div><div>I am guessing since hectors embedded server does not work, a=
nd I should go to <a href=3D"https://github.com/jsevellec/cassandra-unit">h=
ttps://github.com/jsevellec/cassandra-unit</a> not sure...really...how anyo=
ne does this anymore. I am sure I could dive into the source code and figur=
e this out, but I would just rather have a stable piece of code that brings=
 up the embedded server that &quot;just works&quot; and &quot;continues wor=
king&quot;.</div>
<div><br></div><div>I can not seem to get this working right either. (since=
 it includes hector I see from the pom)</div><div><br></div><div>Between th=
rift, cassandra,client x, it is almost impossible to build a sane classpath=
, and that is not even counting the fact that people have their own classpa=
th issues (with guava mismatches etc).</div>
<div><br></div><div>I think the only sane thing to do is start shipping cas=
sandra-embedded like this:</div><div><br></div><div><a href=3D"https://gith=
ub.com/kstyrc/embedded-redis">https://github.com/kstyrc/embedded-redis</a><=
br>
<br></div><div>In other words package embedded-cassandra as a binary. Don&#=
39;t force the client/application developer to bring cassandra on the class=
path and fight with mismatches in thrift/guava etc. That or provide a compl=
etely shaded cassandra server for embedded testing. As it stands now trying=
 to support a setup that uses more than one client or works with multiple v=
ersions of cassandra is major pita. =A0(aka library x compiled against 1.2.=
0 library y compiled against 2.0.3)</div>
<div><br></div><div>Does anyone have any thoughts on this, or tried somethi=
ng similar? =A0</div><div><br></div><div>Edward</div><div><br></div></div>

--089e0149411a4e814e04ee4da2bf--