cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Hanna <jeremy.hanna1...@gmail.com>
Subject Re: pig integration & NoClassDefFoundError TypeParser
Date Mon, 20 Jun 2011 20:03:10 GMT
I think you might be having environment/classpath issues with an RC of cassandra 0.8 or something.

I just downloaded 0.8 and did the following:
- Ran the examples/hadoop_word_count/bin/word_count_setup to create some data
- Ran contrib/pig/bin/pig_cassandra -x local example_script.pig (with the keyspace/columnfamily
as wordcount/input_words)
- that worked

then I added the pygmalion data with a slight change for 0.8 (key_validation_class) (listed
below) and ran the from_to_cassandra_bag_example.pig with bin/pig_cassandra -x local from_to_cassandra_bag_example.pig.
 That inputs from one column family and writes out to another column family from filtered
data.  The script is here (you just need to build pygmalion and point the register statement
to your built pygmalion jar) - https://github.com/jeromatron/pygmalion/blob/master/scripts/from_to_cassandra_bag_example.pig

That worked as well and output to cassandra.

So I suspect that for some reason your environment is messed up somehow - the CassandraStorage
class (for pig integration) doesn't point to TypeParser in 0.8.0.

create keyspace pygmalion;
use pygmalion;
create column family account with comparator = UTF8Type and default_validation_class = UTF8Type
and key_validation_class = UTF8Type and
    column_metadata=
    [
        {column_name: num_heads, validation_class: LongType},
    ];
create column family betelgeuse with comparator = UTF8Type and default_validation_class =
UTF8Type;

set account['hipcat']['first_name'] = 'Zaphod';
set account['hipcat']['last_name'] = 'Beeblebrox';
set account['hipcat']['birth_place'] = 'Betelgeuse Five';
set account['hipcat']['num_heads'] = '2';

set account['hoopyfrood']['first_name'] = 'Ford';
set account['hoopyfrood']['last_name'] = 'Prefect';
set account['hoopyfrood']['birth_place'] = 'Betelgeuse Five';
set account['hoopyfrood']['num_heads'] = '1';

set account['earthman']['first_name'] = 'Arthur';
set account['earthman']['last_name'] = 'Dent';
set account['earthman']['birth_place'] = 'Earth';
set account['earthman']['num_heads'] = '1';


On Jun 20, 2011, at 2:23 PM, Sasha Dolgy wrote:

> cassandra-0.8.0/src/java/org/apache/cassandra/db/marshal/TypeParser.java
> : doesn't exist
> cassandra-0.8.1/src/java/org/apache/cassandra/db/marshal/TypeParser.java
> : exists...
> 
> PIG integration with 0.8.0 is no longer working / doesn't work with
> 0.8.0 release, but will with 0.8.1 .. fair assumption?
> 
> On Mon, Jun 20, 2011 at 9:18 PM, Sasha Dolgy <sdolgy@gmail.com> wrote:
>> Yes ... I ran an "ant" in the root directory on a fresh download of 0.8.0 src:
>> 
>> /usr/local/src/apache-cassandra-0.8.0-src# ls
>> /usr/local/src/apache-cassandra-0.8.0-src/build/classes/main/org/apache/cassandra/db/marshal/
>> AbstractCommutativeType.class       AbstractType.class
>>  LexicalUUIDType.class               UTF8Type.class
>> AbstractType$1.class                AbstractUUIDType.class
>>  LocalByPartionerType.class          UTF8Type$UTF8Validator.class
>> AbstractType$2.class                AsciiType.class
>>  LongType.class
>> UTF8Type$UTF8Validator$State.class
>> AbstractType$3.class                BytesType.class
>>  MarshalException.class              UUIDType.class
>> AbstractType$4.class                CounterColumnType.class
>>  TimeUUIDType.class
>> AbstractType$5.class                IntegerType.class
>>  UTF8Type$1.class
>> 
>> /usr/local/src/apache-cassandra-0.8.0-src# find . | grep TypeParser
>> /usr/local/src/apache-cassandra-0.8.0-src# echo $?
>> 1
>> /usr/local/src/apache-cassandra-0.8.0-src#
>> 
>> /usr/local/src/apache-cassandra-0.8.0-src# grep -Ri TypeError .
>> /usr/local/src/apache-cassandra-0.8.0-src# echo $?
>> 1
>> /usr/local/src/apache-cassandra-0.8.0-src#
>> 
>> TypeParser does not exist...?
>> 
>> 
>> On Mon, Jun 20, 2011 at 9:11 PM, Jeremy Hanna
>> <jeremy.hanna1234@gmail.com> wrote:
>>> hmmm, did you build the cassandra src in the root of your cassandra directory
with ant?  sounds like it can't find that cassandra class.  That's required.
>> 
> 
> 
> 
> -- 
> Sasha Dolgy
> sasha.dolgy@gmail.com


Mime
View raw message