cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeremy Hanna (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-5201) Cassandra/Hadoop does not support current Hadoop releases
Date Mon, 06 Jan 2014 13:31:51 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13862986#comment-13862986
] 

Jeremy Hanna commented on CASSANDRA-5201:
-----------------------------------------

Thanks [~dvryaboy]!

Just for completeness the twitter thread is https://twitter.com/jeromatron/status/419607697588510721

[~bcoverston] [~jbellis] what do you think?  Do you mind 

As for me, it sounds like the EB (or if it makes more sense Parquet) dependency makes sense.
 The hadoop incompatibility findbugs detector also sounds great to include to catch anything
before it is committed.  So I'm +1 on this approach.

> Cassandra/Hadoop does not support current Hadoop releases
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-5201
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5201
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop
>    Affects Versions: 1.2.0
>            Reporter: Brian Jeltema
>            Assignee: Dave Brosius
>         Attachments: 5201_a.txt, hadoopCompat.patch
>
>
> Using Hadoop 0.22.0 with Cassandra results in the stack trace below.
> It appears that version 0.21+ changed org.apache.hadoop.mapreduce.JobContext
> from a class to an interface.
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext,
but class was expected
> 	at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSplits(ColumnFamilyInputFormat.java:103)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:445)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:462)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:357)
> 	at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1045)
> 	at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1042)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1153)
> 	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1042)
> 	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1062)
> 	at MyHadoopApp.run(MyHadoopApp.java:163)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> 	at MyHadoopApp.main(MyHadoopApp.java:82)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:192)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message