incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Kjellman <mkjell...@barracuda.com>
Subject Re: Cassandra 1.20 with Cloudera Hadoop (CDH4) Compatibility Issue
Date Sat, 16 Feb 2013 05:54:48 GMT
Sorry. I meant to say even though there *wasnt* a major change between 1.0.x and 0.22. The
big change was 0.20 to 0.22. Sorry for the confusion.

On Feb 15, 2013, at 9:53 PM, "Michael Kjellman" <mkjellman@barracuda.com<mailto:mkjellman@barracuda.com>>
wrote:

There were pretty big changes in Hadoop between 0.20 and 0.22 (which is now known as 1.0.x)
even though there were major change between 0.22 and 1.0.x. Cloudera hadn't yet upgraded to
0.22 which uses the new map reduce framework instead of the old mapred API. I don't see the
C* project back porting their code at this time and if anything Cloudera should update their
release!!

On Feb 15, 2013, at 9:48 PM, "Yang Song" <xfilter@gmail.com<mailto:xfilter@gmail.com>>
wrote:

It is interesting though. I am using CDH4 which contains hadoop 0.20, and I am using Cassandra
1.20.
The previous mentioned errors still occur. Any suggestions? Thanks.

2013/2/15 Michael Kjellman <mkjellman@barracuda.com<mailto:mkjellman@barracuda.com>>
That bug is kinda wrong though. 1.0.x is current for like a year now and C* works great with
it :)

On Feb 15, 2013, at 7:38 PM, "Dave Brosius" <dbrosius@mebigfatguy.com<mailto:dbrosius@mebigfatguy.com>>
wrote:

see https://issues.apache.org/jira/browse/CASSANDRA-5201


On 02/15/2013 10:05 PM, Yang Song wrote:
Hi,

Does anyone use CDH4's Hadoop with Cassandra to interact? The goal is simply read/write to
Cassandra from Hadoop direclty using ColumnFamilyInput(Output)Format, but seems a bit compatibility
issue. There are two java exceptions

1. java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext,
but class was expected
This shows when I run hadoop jar file to read directly from Cassandra. Seems that there is
a change on Hadoop that JobContext was changed from class to interface. Has anyone have similar
issue?
Does it mean the Hadoop version in CDH4 is old?

2. Another error is java.lang.NoSuchMethodError: org.apache.cassandra.hadoop.ConfigHelper.setRpcPort(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)V
This shows when the jar file contains rpc port for remote Cassandra cluster.

Does anyone have similiar experience? Any comments are welcome. thanks!


Mime
View raw message