incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tharindu Mathew <mcclou...@gmail.com>
Subject Re: Exception in Hadoop Word Count sample
Date Fri, 16 Sep 2011 09:48:02 GMT
The example works against the 7.0 branch, not against trunk.

JIRA created at https://issues.apache.org/jira/browse/CASSANDRA-3215

On Thu, Sep 15, 2011 at 3:58 PM, Tharindu Mathew <mccloud35@gmail.com>wrote:

> Now I get this,
>
> Any help would be greatly appreciated.
>
> ./bin/word_count
> 11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
> 11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
> 11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no
> local connection available
>  at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> at
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
>  at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
>  at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection
> available
>  at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
>  ... 4 more
> 11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
> 11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with
> processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
> 11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no
> local connection available
> at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
>  at
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
>  at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection
> available
> at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
>  at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> ... 4 more
> 11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
> 11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with
> processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
> 11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no
> local connection available
>  at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> at
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
>  at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
>  at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection
> available
>  at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
>  ... 4 more
> 11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
> 11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with
> processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
> 11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no
> local connection available
> at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
>  at
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
>  at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection
> available
> at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
>  at
> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> ... 4 more
> 11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
> 11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0
>
> On Thu, Sep 15, 2011 at 12:17 PM, Tharindu Mathew <mccloud35@gmail.com>wrote:
>
>> Found it. 'ant artifacts'
>>
>>
>> On Thu, Sep 15, 2011 at 12:02 PM, Tharindu Mathew <mccloud35@gmail.com>wrote:
>>
>>> Yes. That's the problem. Thanks Jonathan.
>>>
>>> I'm actually using trunk against a 0.7. How can I generate the distro in
>>> trunk?
>>>
>>> Forgive my ignorance, I'm more used to maven.
>>>
>>>
>>> On Thu, Sep 15, 2011 at 1:08 AM, Jonathan Ellis <jbellis@gmail.com>wrote:
>>>
>>>> You're using a 0.8 wordcount against a 0.7 Cassandra?
>>>>
>>>> On Wed, Sep 14, 2011 at 2:19 PM, Tharindu Mathew <mccloud35@gmail.com>
>>>> wrote:
>>>> > I see $subject. Can anyone help me to rectify this?
>>>> > Stacktrace:
>>>> > Exception in thread "main" org.apache.thrift.TApplicationException:
>>>> Required
>>>> > field 'replication_factor' was not found in serialized data! Struct:
>>>> > KsDef(name:wordcount,
>>>> > strategy_class:org.apache.cassandra.locator.SimpleStrategy,
>>>> > strategy_options:{replication_factor=1}, replication_factor:0,
>>>> > cf_defs:[CfDef(keyspace:wordcount, name:input_words,
>>>> column_type:Standard,
>>>> > comparator_type:AsciiType, default_validation_class:AsciiType),
>>>> > CfDef(keyspace:wordcount, name:output_words, column_type:Standard,
>>>> > comparator_type:AsciiType, default_validation_class:AsciiType),
>>>> > CfDef(keyspace:wordcount, name:input_words_count,
>>>> column_type:Standard,
>>>> > comparator_type:UTF8Type,
>>>> default_validation_class:CounterColumnType)])
>>>> > at
>>>> >
>>>> org.apache.thrift.TApplicationException.read(TApplicationException.java:108)
>>>> > at
>>>> >
>>>> org.apache.cassandra.thrift.Cassandra$Client.recv_system_add_keyspace(Cassandra.java:1531)
>>>> > at
>>>> >
>>>> org.apache.cassandra.thrift.Cassandra$Client.system_add_keyspace(Cassandra.java:1514)
>>>> > at WordCountSetup.setupKeyspace(Unknown Source)
>>>> > at WordCountSetup.main(Unknown Source)
>>>> > --
>>>> > Regards,
>>>> >
>>>> > Tharindu
>>>> > blog: http://mackiemathew.com/
>>>> >
>>>>
>>>>
>>>>
>>>> --
>>>> Jonathan Ellis
>>>> Project Chair, Apache Cassandra
>>>> co-founder of DataStax, the source for professional Cassandra support
>>>> http://www.datastax.com
>>>>
>>>
>>>
>>>
>>> --
>>> Regards,
>>>
>>> Tharindu
>>>
>>> blog: http://mackiemathew.com/
>>>
>>>
>>
>>
>> --
>> Regards,
>>
>> Tharindu
>>
>> blog: http://mackiemathew.com/
>>
>>
>
>
> --
> Regards,
>
> Tharindu
>
> blog: http://mackiemathew.com/
>
>


-- 
Regards,

Tharindu

blog: http://mackiemathew.com/

Mime
View raw message