cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeremy Hanna (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-5201) Cassandra/Hadoop does not support current Hadoop releases
Date Mon, 06 Jan 2014 17:01:59 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13862986#comment-13862986
] 

Jeremy Hanna edited comment on CASSANDRA-5201 at 1/6/14 5:00 PM:
-----------------------------------------------------------------

Thanks [~dvryaboy]!

Just for completeness the twitter thread is https://twitter.com/jeromatron/status/419607697588510721

[~bcoverston] [~jbellis] what do you think?

As for me, it sounds like the EB (or if it makes more sense Parquet) dependency makes sense.
 The hadoop incompatibility findbugs detector also sounds great to include to catch anything
before it is committed.  So I'm +1 on this approach.


was (Author: jeromatron):
Thanks [~dvryaboy]!

Just for completeness the twitter thread is https://twitter.com/jeromatron/status/419607697588510721

[~bcoverston] [~jbellis] what do you think?  Do you mind 

As for me, it sounds like the EB (or if it makes more sense Parquet) dependency makes sense.
 The hadoop incompatibility findbugs detector also sounds great to include to catch anything
before it is committed.  So I'm +1 on this approach.

> Cassandra/Hadoop does not support current Hadoop releases
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-5201
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5201
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop
>    Affects Versions: 1.2.0
>            Reporter: Brian Jeltema
>            Assignee: Dave Brosius
>         Attachments: 5201_a.txt, hadoopCompat.patch
>
>
> Using Hadoop 0.22.0 with Cassandra results in the stack trace below.
> It appears that version 0.21+ changed org.apache.hadoop.mapreduce.JobContext
> from a class to an interface.
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext,
but class was expected
> 	at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSplits(ColumnFamilyInputFormat.java:103)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:445)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:462)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:357)
> 	at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1045)
> 	at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1042)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1153)
> 	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1042)
> 	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1062)
> 	at MyHadoopApp.run(MyHadoopApp.java:163)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> 	at MyHadoopApp.main(MyHadoopApp.java:82)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:192)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message