Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: Alex Burkoff <ABurkoff@clearpathnet.com>
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Date: Wed, 8 Sep 2010 15:41:57 -0700
Subject: RE: ColumnFamilyOutputFormat and
 mapreduce.output.columnfamilyoutputformat.batch.threshold 0.70beta1
Thread-Topic: ColumnFamilyOutputFormat and
 mapreduce.output.columnfamilyoutputformat.batch.threshold 0.70beta1
Thread-Index: ActPnIbVsPdiXq1bS0urCDriOMwglQACoRc2
Message-ID: <6AE62907C5654F46B056A3AB96A6E00F12F8AEEF9D@splaexch01.cpn.net>
References: 
 <6AE62907C5654F46B056A3AB96A6E00F12F8AEEF9C@splaexch01.cpn.net>,<AANLkTinVt6XOa6hB-7qhHU=Am0nnfV3CpY2PwwQOLLNq@mail.gmail.com>
In-Reply-To: <AANLkTinVt6XOa6hB-7qhHU=Am0nnfV3CpY2PwwQOLLNq@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

With the trunk version and given patches I am now getting following excepti=
on:

10/09/08 22:39:14 WARN mapred.LocalJobRunner: job_local_0001
java.lang.ClassCastException: [B cannot be cast to java.nio.ByteBuffer
        at org.apache.cassandra.hadoop.ColumnFamilyRecordWriter.write(Colum=
nFamilyRecordWriter.java:68)
        at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.writ=
e(ReduceTask.java:508)
        at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInp=
utOutputContext.java:80)
        at cassandratest.Main$TReducer.reduce(Main.java:132)
        at cassandratest.Main$TReducer.reduce(Main.java:113)
        at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
        at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.jav=
a:566)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.j=
ava:216)
10/09/08 22:39:14 INFO mapred.JobClient:  map 100% reduce 0%

Alex.
________________________________________
From: Jonathan Ellis [jbellis@gmail.com]
Sent: Wednesday, September 08, 2010 2:26 PM
To: user@cassandra.apache.org
Subject: Re: ColumnFamilyOutputFormat and mapreduce.output.columnfamilyoutp=
utformat.batch.threshold 0.70beta1

Try the patches on
https://issues.apache.org/jira/browse/CASSANDRA-1434 (or wait until
they're committed to trunk, then try a nightly build)

On Wed, Sep 8, 2010 at 4:18 PM, Alex Burkoff <ABurkoff@clearpathnet.com> wr=
ote:
> Guys,
>
> I was testing ColumnFamilyOutputFormat and found that only columns from t=
he last Reduce
> invocation get stored when mapreduce.output.columnfamilyoutputformat.batc=
h.threshold has
> the default value. Setting it to 1 changes the behavior, and all data is =
stored then. Is it the
> intended behavior, or am I missing something ?
>
> Best regards,
>
> Alex Burkoff
>


--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com