incubator-cassandra-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Danhang Tang <da...@zugoservices.com>
Subject About python streaming using Cassandra as input
Date Mon, 09 May 2011 07:37:39 GMT
Hi all,

I've been trying to apply this patch to Cassandra but ran into some errors.
https://issues.apache.org/jira/browse/CASSANDRA-1497

The comments said it's fixed for version 0.7.1. But I can't directly apply
it to this version. So I apply it manually to the java files in hadoop
package. Compiling was successful. But then when executing the
hadoop_streaming_input
I encountered a runtime error:

11/05/06 17:27:21 WARN conf.Configuration: mapred.job.tracker is deprecated.
Instead, use mapreduce.jobtracker.address

packageJobJar: [./bin/../../../interface/avro/cassandra.avpr,
./bin/mapper.py, ./bin/reducer.py,
/tmp/hadoop-radfactory/hadoop-unjar8363580286439315517/] []
/tmp/streamjob4200946905356051819.jar tmpDir=null

11/05/06 17:27:23 INFO mapreduce.JobSubmitter: Cleaning up the staging area
hdfs://client1:9001/tmp/hadoop-root/mapred/staging/radfactory/.staging/job_201105051628_0015

Exception in thread "main" java.lang.InstantiationError:
org.apache.hadoop.mapreduce.JobContext

at
org.apache.cassandra.hadoop.AbstractColumnFamilyInputFormat.getSplits(AbstractColumnFamilyInputFormat.java:138)

at
org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:428)

at
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:420)

at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:338)

at org.apache.hadoop.mapreduce.Job.submit(Job.java:960)

at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:534)

at
org.apache.hadoop.streaming.StreamJob.submitAndMonitorJob(StreamJob.java:924)

at org.apache.hadoop.streaming.StreamJob.run(StreamJob.java:123)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)

at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:50)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:192)



Any ideas?

Thanks,

Danny

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message